I've never had a job at a callcenter, but I know a few mates of mine who did, and they said the same thing. The problem is that the people you get on the line are already annoyed because there is some sort of problem they can't handle themselves.
Just ignore the bastards, good for you that you stopped letting it get to you.