Well tbh that was exactly what I thought he meant too when he said "if it was just Klein, but 2 more... or even one more" (Klein interrupted that thought by saying "I can't ask a stranger to risk his life for us/me")
It might be the case that he was an asshole all along and didn't want to share XP/Loot with so many people.
But why would he want Klein with him then...