It has been in exponential growth since the signal was distinguishable from the noise, and exponentials do not have inflection points...

The only inflection we can expect is when it reaches 1/4 of saturation.

Infrastructure is a main concern every time somebody looks into buying some F-16.

(But, of course, not where the jets will land. Other kinds of infrastructure.)

That's a remarkable coincidence!

Anyway, yes, it's not disallowed or impossible.

Then, after half the car is inside the boat, the driver loses faith and gets out of it...

TBF, pushing a site to the public while adding a "no scrapping" rule is a bit of a shitty practice; and pushing it and adding a "no scrapping, unless you are Google" is a giant shitty practice.

Rules for politely scrapping the site are fine. But then, there will be always people that disobey those, so you must also actively enforce those rules too. So I'm not sure robots.txt is really useful at all.

If you are trying to seriously understand how to do it... well, you can't. Current AIs can't fully replace anybody, and it's an open question if they can partially replace (AKA improve the productivity) anybody to any impactful extent.

Do your scrum-using organization put users at the development process?!? I don't think I've seen any Agile¹ organization doing that.

1 - The one with capital "A", that is an antonym of the one with lower cap "a".

Is "Journal of Astrological Big Data Ecology" a real joke journal, a joke of a real journal, or a non-real journal made for the joke?

Companies will save so much money once they decide to replace their CEOs with AIs..

Well, most cages are made of steel instead, and thus nickfull ones.

I don’t see a way out

Free software exists. And if you have any power over a non-small organization, it's also something you can help improve to fit your needs.

They can also watch the ads and click on them to increase metrics.

Just don't let the bots get near your wallet.