Nah, you're just asking the wrong questions. Since you're not an atheist, you can imagine for a minute that God is real, right? There are ~7.5 billion people living right now and no idea how many have lived in the entire history before us and how many will after us. Take into account the whole universe we've little idea about, but we know that we're only a very very small part of.
Don't you think it's silly of you, a tiny person in the grand scheme of things, to try and attempt to judge Gods fairness, while knowing that you can understand probably less than 0.01% of his creation or how he operates? I won't be able to answer your every existential question, I don't think any man has all the answers. To quote Isiah (and I acknowledge that too many have done this

),
For my thoughts are not your thoughts, neither are your ways my ways