Where do summons usually hang out? (as in when their summoner hasn't summoned them)

Gamabunta stays with the other little frogs somewhere...

Manda was annoyed that Oro summoned him to "this pathetic excuse for a land" or something along those lines.

Just wondering if it has been revealed where they originate from.