I hate the phrase too. Just because you're self-conscious about your body doesn't mean you should reject and insult all others' bodies to say you're a 'real' woman.
I'm the fattest out of all my friends and I hear it. They like to say that kind of thing and I can't respond because why do you have to feel threatened by banana-shaped women??