to be fair, how was Naofumi supposed to convince him with anything other than words?

Not like he can do a whole lot? I think he handled it quite well.
He didn't even seek to talk with him. He was basically forced into it because he actually planed to go right through him across the border.