Some days I am so focused or stressed at work I manage to successfully ignore any calls or messages. I'm not bothered with replying at all later on as well, as if it had not happened.
As @Seven said, sometimes one gotta be careful to not make things about you, when they are about something...