It really depends a great deal on how YOU act once you move to a new fandom. If you then put all your effort into that fandom and those people and ignore your old friends? Well, they have EVERY right to drop you, too.

You need to learn that friendship requires effort on both parts, yours too.