Yeah I think I know what you mean. I had this experience with an RPF fic and I stopped reading in the fandom because my strong emotional attachment to someone I didn't even know was freaking me out. I didn't think it was that weird- the author just did a really amazing job.

ETA: And it wasn't sexual at all, as you describe. The fic had sex and I was totally bored by it.