Not necessarily, since Jiraiya would have been 4th's Sensei when he was just a Genin... and when he became a Chunnin or a Jounin the 4th moved on.