Generally speaking, and you're obviously going to find exceptions to this, Japanese women tend to have much rounder faces with fuller lower cheeks, as opposed to strongly defined cheekbones with sharper jaws, which are more common in Japanese men - Ken Watanabe has the same rough profile.

Trouble is, defined cheekbones and sharp jawlines are a marker of feminine beauty in the much of the West. I can see why it causes confusion, but it doesn't mean that in his own cultural context he doesn't look like a dude. I have these features; people from East Asia are incessantly mistaking me for a dude. They wouldn't be if such features - such features as he has - weren't coded "masculine".