It's up to the Feudal Lord, not the Jounin, or even Danzou (though I guess he could have turned it down like Jiraiya did)

Admittedly, the Feudal Lord seems to have taken advice from the Jounin in the past at face value.