You're not alone. I like dipping in and out and enjoying the stories and the art, but I don't often hang around. Mostly, I want to avoid the wank that happens (or inadvertently start any), but it also gets really hard to follow.

But, as said above, the point of fandom is to enjoy the book/movie/comic/whatever in a fan-based expanded format. If you like the stuff that's produced, then you've got fandom down pat!