Aemon was the next in line to be king, but instead decided that king stuff was for losers and took the black. His brother became the king instead and went crazy, burned people alive with wildfire, and started all this gangster shit. He apparently had an affair with some high up lady, we don't know who. Could be jon's father, most likely is not.