The setting wasn't the major problem for a lot of people, the way the non-white characters were written was. Like how the Haitian people talking in their language were said to be "gibbering". If you avoided stuff like that, I don't think you should attract much/any negative attention that the canon hasn't already (if it even did get some negative attention, anyway).

ETA: Aaaand apparently this refers to something else other than what I'm thinking, so feel free to disregard this comment. >_> <_<