Calling him that obviously wasn't the right or the wisest thing to do, but it doesn't make him a racist. When you play sports, you will get all kinds of talk with people trying to get under your skin.
As if people doesn't make jokes about other "races" when in the company of their own "kind". :D