One of my coworker's lifelong friends is something of a playboy and a party animal. He lives in the Costa del Concrete now, but they grew up in England together. We went out to some bar once here in California, and someone referenced him being "African American".
He was like, "WTF? I don't even have a green card here."
US has a lot of racial hang-ups for sure. But I think the difference is that our society has a strange belief that you can defeat racism, at least in part, through language.