this post was submitted on 17 Mar 2025
555 points (96.8% liked)

Technology

66783 readers
4977 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Half of LLM users (49%) think the models they use are smarter than they are, including 26% who think their LLMs are “a lot smarter.” Another 18% think LLMs are as smart as they are. Here are some of the other attributes they see:

  • Confident: 57% say the main LLM they use seems to act in a confident way.
  • Reasoning: 39% say the main LLM they use shows the capacity to think and reason at least some of the time.
  • Sense of humor: 32% say their main LLM seems to have a sense of humor.
  • Morals: 25% say their main model acts like it makes moral judgments about right and wrong at least sometimes. Sarcasm: 17% say their prime LLM seems to respond sarcastically.
  • Sad: 11% say the main model they use seems to express sadness, while 24% say that model also expresses hope.
you are viewing a single comment's thread
view the rest of the comments
[–] gravitas_deficiency@sh.itjust.works 44 points 17 hours ago (2 children)

And you know what? The people who believe that are right.

Note that that’s not a commentary on the capabilities of LLMs.

[–] LeninOnAPrayer@lemm.ee 1 points 6 hours ago* (last edited 6 hours ago)

They are right when it comes to understanding LLMs the LLM definitely understands LLMs better than they do. I'm sure an AI could have a perfect IQ test. But has a really hard time drawing a completely full glass of wine. Or telling me how many R's are in the word strawberry. Both things a child could do.

[–] skozzii@lemmy.ca 26 points 17 hours ago* (last edited 17 hours ago) (1 children)

It's sad, but the old saying from George Carlin something along the lines of, "just think of how stupid the average person is, and then realize that 50% are even worse..."

[–] LovableSidekick@lemmy.world 2 points 13 hours ago* (last edited 13 hours ago) (1 children)

That was back when "average" was the wrong word because it still meant the statistical "mean" - the value all data points would have if they were identical (which is what a calculator gives you if you press the AVG button). What Carlin meant was the "median" - the value half of all data points are greater than and half are less than. Over the years the word "average" has devolved to either the mean or median, as if there's no difference.

[–] Cryophilia@lemmy.world 4 points 10 hours ago (1 children)

When talking about a large, regularly distributed population, there effectively IS no difference

[–] andros_rex@lemmy.world 1 points 9 hours ago* (last edited 9 hours ago) (1 children)

Not in all cases. When I teach mean, median and mode, I usually bring up household income. Mean income is heavily skewed by outliers (billionaires), median is a more representative measure.

I guess that’s your “regularly distributed” bit, but a lot of things aren’t regularly distributed.

[–] Cryophilia@lemmy.world 1 points 9 hours ago (1 children)
[–] andros_rex@lemmy.world 1 points 9 hours ago (1 children)

IQ is also garbage when it comes to the validity of what it claims to measure.

[–] Cryophilia@lemmy.world 1 points 9 hours ago

Fair, but you could just say "intelligence" generically instead.