I think that's because, with Aizen fighting, he realizes his fight is basically meaningless.
If Aizen defeats those three, he'll defeat Ichigo too. And if Aizen loses, Gin knows he can't fight Urahara/Isshin/Youruichi by himself. So if it doesn't matter what he does, why waste his energy.