Not really though? I have very pale skin, but have still had people ask about my heritage because of my eyes, and the contrast between my light skin and darker features.

In a book, yeah, the writer is communicating something, but in real life, some people will respond to various features that don't match their internal idea of what people of certain races look like.