this post was submitted on 31 May 2025
429 points (98.4% liked)
Fuck AI
2933 readers
929 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
So, reading this article, it's not about model collapse, but about RAG - letting the AI model google the question essentially. The problem is, the first 10 pages of google search results are all low effort adfarming slop sites, because of course it is, which is making the answers from the AI worse, as these slop sites often have incorrect or otherwise unproofed articles, which biases the AI to fork out the wrong answer.
I'm sure the major AI services will try and fix this with some slop site detection routines.
Which will be run by AI ๐
Don't forget! A lot of the slop on those first few pages of results is AI-generated.
Ouroboros is a very apt moniker for this phenomena.
We need a new, stronger name for this. Like shit ouroboros, or shouroboros. Yes, AI eating it's own shit and then regurgitating it is shouroboros.
Mad AI Disease.
Why would they? I mean how are their incentives different from that of the search engine operators themselves?
I can see a future when the internet is degraded to a point where if you try to find out how to peel an apple, you will get back word salad and 25 different porn ads.
Yesterday, there was the usual slew of artificial computer-generated news stories on YouTube about GM closing down all factories in north america (happens about once a month).
Well I typed in "is GM closing down in the US" in Google and the Gemini generated answer said "Yes, GM has announced the closure of all plants in the US" and put up those fake YT videos as reference....
They already do this through data determination routines in LLMs, unfortunately they suffer from the same type of infection as the data itself.
You probably would get better results from literally any other AI Gemini is routinely the worst. I don't know what Google are playing at surely they could actually put some real effort into this but they just seem to be doing it in the most naive way possible.
It comes to something when the Chinese are been the most innovative.
No they will not, because this will harm their short term bottom line, which is always, "add short term value for the shareholder"
Unless the shareholder also owns the search slop site, it's competition to revenue and in good interest to filter out.
Plus, it's not an easy task.