Yeah, Brian comments on it all the time. the episode I watched last night had a Stewie flashback in a gay club, he's been seen putting on lipstick and a whole bunch of other stuff. "The evidence is really starting to pile up."

EDIT for below: Now that I think, I seem to recall one episode where he was in love with another little girl. You're probably right.