Eh... no way.I don't know about you, but if I was one of four people from another world summoned to a new world, I'd feel some sense of belonging together with the other three in a distinct group (not something like being friend or anything, but just as being an outsiders vs all the original inhabitants).
"We were treated like "gods".. obviously 1 of us was foul and the new power/status went to his head. Even the "police" says he did it and that dude forced himself on her just because she took pity on him and joined his group... disgusting, just because she is a nice person doesn't mean she wants to have sex with him.
He took advantage of their (and her) generosity - why would I want to side with him."
It's more than just plausible... especially since they think it is a game.
And they don't just "treat" them better, they literally hail them as superior beings and are cheering for them if they do as much as walk past them.