That's not true at all, but it probably does account for a small percentage of people (5-10%). Having a tolerable job would be enough for me right now, but I know exactly what I'd like to do that I would love.
Not necessarily your job, just whatever it is you do. For most people that is a job, or it could be a job that is a passion, or just a passion itself, if you are lucky enough to be able to do that.