Only they are actually extremely popular and have unlimited choices in men who aren't as much of an ass as the protagonist. Being an otaku alone is a horrible reason for them to like and throw themselves at him.