You aren't doing it wrong, but I think you're severely limiting yourself if you refuse to download a fanmix just because you don't recognize the artists on it.

I like to download by fandom - I discover a lot of great artists that way, even if they don't necessarily fit my fanon the fanmix was intended for. :) You can always delete something if you don't like it.