Maybe that was a bit of self modesty... sure he wouldn't be able to beat Oro but I'm sure he would inflict some serious damage on him... since Kabuto did some to Tsunade.

But seriouslt, Jiraiya's weakness is women, Tsunade's is blood, what's Oro's (no jackson jokes please)?