I was under the impression he judged them based of the fight but after watching it again I think you're right.
But that does mean that if a universe has a handfull of extreme powerful people, they would up the average.