The difference is that the Bible is inherently sexist and racist, whereas atheism is not. There is no atheism handbook telling us this and that. If you don't believe in a higher power? You're an atheist. So that includes all types of people; racists, sexists, feminists, gay people, straight people, people of all color and of all nationalities.