The problem of hell is a version of the problem of evil.
It might be worth reading this: https://plato.stanford.edu/entries/evil/
If it's too technical, you might try the Wikipedia article, here are a few excerpts:
The logical argument from evil is as follows:
P1. If an omnipotent, omnibenevolent and omniscient god exists, then evil does not.
P2. There is evil in the world.
C1. Therefore, an omnipotent, omnibenevolent and omniscient god does not exist.
...
If God lacks any one of these qualities – omniscience, omnipotence, or omnibenevolence – then the logical problem of evil can be resolved. Process theology and open theism are modern positions that limit God's omnipotence or omniscience (as defined in traditional theology) based on free will in others.
...
A version [of the evidential problem of evil] by William L. Rowe:
- There exist instances of intense suffering which an omnipotent, omniscient being could have prevented without thereby losing some greater good or permitting some evil equally bad or worse.
- An omniscient, wholly good being would prevent the occurrence of any intense suffering it could, unless it could not do so without thereby losing some greater good or permitting some evil equally bad or worse.
- (Therefore) There does not exist an omnipotent, omniscient, wholly good being.
Another by Paul Draper:
- Gratuitous evils exist.
- The hypothesis of indifference, i.e., that if there are supernatural beings they are indifferent to gratuitous evils, is a better explanation for (1) than theism.
- Therefore, evidence prefers that no god, as commonly understood by theists, exists.
It should also be mentioned that most lay people's concept of hell is radically different than the hell as described in various scriptures. I would be wary of any singular depiction of hell even within a religion, as scripture often has contradicting things to say about hell (with multiple plausible interpretations), and contemporary beliefs about hell are more informed by popular culture than scripture anyway.
Again, I direct to Wikipedia for the different depictions of hell: https://en.wikipedia.org/wiki/Hell