"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
I almost always get perfect responses, but I'm very limited in what I'll input. Often I'm just using ChatGPT to remember a word or event I've forgotten. Pretty much 100% accurate on that bit.
Couldn't explain how I know what will and won't work, but I have a sense of it. Also, the farther you drill into a thing, the more off-topic it gets. I'm almost always one and done with a prompt.
You are getting more surface level information from it which is probably going to be correct unless there is a major problem in training data.
The thing about LLMs is that they "store" information about the shape of their training models, not about the information contained therein. That information is lost.
A LLM will produce text that looks like the texts it was trained with, but it only can only reproduce any information contained in them if it's common enough in its training data to statistically affect their shape, and even then it has a chance to get it wrong, since it has no way to check its output for fact accuracy.
Add to that that most models are pre-prompted to sound confident, helpful, and subservient (the companies' main goal not being to provide information, but to get their customers hooked on their product and coming back for more), and you get the perfect scammers and yes-men. Auto-complete mentalists that will give you as much confident sounding information shaped nonsense as you want, doing their best to agree with you and confirm any biases you might have, with complete disregard for accuracy, truth, or the effects your trust in their output might have (which makes them extremely dangerous and addictive for suggestible or intellectually or emotionally vulnerable users).
AI as we know them today, will give you the most statistically probable series of data that fit the prompt.
~~You're not providing any information on which AI you used so what can we say? For all we know you used a highschoolers senior project trained on failed history essays.~~
Much of the Input Comedy from the Web now, not the web 2003.
¯\_(ツ)_/¯ would I get downvoted for saying skill issue lol?
I have recently used llms for troubleshooting/assistance with exposing some self hosted services publicly through a VPS I recently got. I'm not a novice but I'm no pro either when it comes to the Linux terminal.
Anyway long story short in that instance the tool (llm) was extremely helpful in not only helping me correctly implement what I wanted but also explaning/teaching me as I went. I find llms are very accurate and helpful for the types of things I use it for.
But to answer your question on why llms can be wrong, it's because they are guessing machines that just pick the next best word. They aren't smart at all, they aren't "ai" they are large language models.
It spouts out generic and outdated answers when asked specific questions, which I can identify as wrong (skill issue, lol).
If you are super confident with using them, maybe you are really not knowledgeable enough about those things. Skill issue, I guess.
I've used it a few times to quickly check some reference values, calculations and symptoms (research/physiology) and most of the time its fine but occasionally it spits out some of the craziest shit i've ever seen, like dangerously wrong but its just as confident.
its pretty bad on biology front, especially when what this does to this condition.