I guess he didn't have any info to judge Naofumi as innocent back then. Now Naofumi is showing his true character through his deeds.