We have made mistakes.
We wanted it all to be free. It was free. I remember the early days of the internet, the webforums, the IRC, it was mostly sites run by enthusiasts. A few companies showing their products to would-be customers. It was awesome and it was all free.
And then it got popular, it got mainstream. Running servers got expensive and the webmasters were looking for funding. And we resisted paywalls. The internet is free, that's how it's supposed to work!
They turned to advertising. That's fair, a few banners, no big deal, we can live with that. It worked for television! And for a while that was OK.
Where did it all go sideways? Well, it was much too much effort to negotiate advertisement deals between websites and advertisers one website at a time, so the advertisement networks were born. Sign up for funding, embed a small script and you're done. Advertisers can book ad space with the network and their banner appears on thousands of websites. Then they figured out they can monitor individual user's interests, and show them more "relevant" ads, and make more money for more effective ad campaigns.
And now we have no privacy online. Which caused regulators like the EU to step in and try to limit user data harvesting. With mixed results as we all know. For one it doesn't seem to get enforced enough so a lot of companies just get away with. But also the consent banners are just clumsy and annoying.
And now we're swamped with ads, and sponsored content written by AI, because capitalism's gonna capitalism and squeeze as much profit as they can, until an equilibrium is reached between maximum revenue and user tolerance for BS. Look up "enshittification"
I wonder how the web would look like if we had not resisted paid content back then. There were attempts to do things differently. flattr was one thing for a while. Patreon, ko-fi and others are awesome for small creators. Gives them independence and freedom to do their thing and not depend on big platforms or corporations. The fediverse and open source are awesome.
There's still a lot of great stuff out there for those of us who know where to look. But large parts of the internet are atrocious.