Because that's pretty much your friends list. Of course people would feel insulted when someone takes you off their friendslist.

Mutual followers tend to share some of the same interests, but when they start posting stuff you don't like but you still like other stuff they post then it's easier to filter between the two if you tag it. Herp derp.