Play around with this for a bit: https://networthify.com/calculator/earlyretirement?income=50000&initialBalance=0&expenses=20000&annualPct=5&withdrawalRate=4
Consider spending 30k yearly when you're earning 50k. You can retire in about 20 years if you keep to that. You really gotta keep to it though, spending 40k means you'd have to work almost 40 years instead.
Now compare that to spending 30k when making 100k. Now you can retire in 9 years. Even if you have to spend literally twice as much time+effort doing so, you end up with more of your life leftover.
This is not to say that you should take a job you hate, but rather to say that making more money does make your life better, but only up to a point. If you find a job that you genuinely enjoy, great do that. If you're picking between different things you dislike, translate it back into years instead of trying to understand it in made up funny money numbers. And when you get there, stop.