Why does it weird me out now?

I wouldn't stress about it. It sounds like that change from a distant image to a real relationship has violated a boundary for you. Who knew it would? Nothing for it. I would just find a new fantasy, and keep the weirdness to yourself when talking with them. No harm done.