this post was submitted on 26 Aug 2023
401 points (85.9% liked)

Technology

58033 readers
3828 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

ChatGPT generates cancer treatment plans that are full of errors — Study finds that ChatGPT provided false information when asked to design cancer treatment plans::Researchers at Brigham and Women's Hospital found that cancer treatment plans generated by OpenAI's revolutionary chatbot were full of errors.

you are viewing a single comment's thread
view the rest of the comments
[–] Ranessin@feddit.de 16 points 1 year ago (2 children)

It doesn't check the stuff it generates other than on grammatical and orthographical errors. It's not intelligent or has knowledge outside of how to create text. The text looks useful, but it doesn't know what it contains in a way something intelligent would.

[–] fsmacolyte@lemmy.world 1 points 1 year ago

Recent papers have shown that LLMs build internal world models but about a topic as niche and complicated as cancer treatment, a chatbot based on GPT-3.5 be woefully ill-equipped to do any kind of proper reasoning.

[–] PeleSpirit@lemmy.world -5 points 1 year ago (1 children)

It seems like it could check for that though, which is what chatgpt doesn't do but we all assumed would. I'm sure there are ai programs that could and do check for possibilities on only information we know to be true.

[–] ZodiacSF1969@sh.itjust.works 2 points 1 year ago

People who understand the technology did not assume that, but yes the general public has a lot of misconceptions about it.