Pedophilia is exclusive to real people and is a primary or exclusive attraction to prepubescents. People who like little kids sometimes but prefer mature women are NOT pedophiles (strange, I know, but that's what it is).
2D lolicon fanservice is:
1) Fictional
2) Not referring to a psychiatric disorder
3) People who do like it are not necessarily primarily or exclusively into it
4) I repeat, Fictional
Liking lolis in anime is also not equal to being attracted children in real life. Just like how liking action movies doesn't mean you want to seriously or will kill people. Same goes for video games.
And to add, a lot of people seem to associate the term pedophile as someone who does sexual acts with children, but that is completely inaccurate. Pedophilia is a disorder, not an action or a crime. If you do sexual things to a child, that's rape, child abuse, statutory rape, etc.
EDIT:
Did you seriously just say it doesn't matter if it's fiction or not? That's a very important distinction.