You might very well be correct, although I don't personally think it reduces his fame either way. In any case it's given he wouldn't have ever unlocked the haki if he hadn't been pushing his skills to the max for so long and now beyond the max in his desperation.