this post was submitted on 05 Feb 2024
666 points (87.8% liked)
Memes
45756 readers
969 users here now
Rules:
- Be civil and nice.
- Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
LLMs don't "learn" they literally don't have the capacity to "learn". We train them on an insane amount of text and then the LLMs job is to produce output that looks like that text. That's why when you attempt to correct it nothing happens. It can't learn, it doesn't have the capacity to.
Humans aren't "word guessing machines". Humans produce language with intent and meaning. This is why you and I can communicate. We use language to represent things. When I say "Tree" you know what that is because it's the word we use to describe an object we all know about. LLMs don't know what a tree is. They can use "tree" in a sentence correctly but they don't know what it means. They can even translate it to another language but they still don't know what "tree" means. What they know is generating text that looks like what they were trained on.
Here's a well made video by Kyle Hill that will teach you lot better than I could
Here is an alternative Piped link(s):
Here's a well made video by Kyle Hill
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I'm open-source; check me out at GitHub.