What it means is that he's not going to leave if you just tell him. He's going to leave when you force him.