The ants aren't really that fast (except the King, especially in his current state). They are just stupidly tough. Without that almost cheat like toughness, they would already be dead many times over. Rather than them being great fighters, they are just great survivors.