this post was submitted on 08 Aug 2025
617 points (96.3% liked)

Technology

73767 readers
3365 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Or my favorite quote from the article

"I am going to have a complete and total mental breakdown. I am going to be institutionalized. They are going to put me in a padded room and I am going to write... code on the walls with my own feces," it said.

top 50 comments
sorted by: hot top controversial new old
[–] seemefeelme@infosec.pub 11 points 2 hours ago

Oh man, this is utterly hilarious. Narrowly funnier than the guy who vibe coded and the AI said "I completely disregarded your safeguards, pushed broken code to production, and destroyed valuable data. This is the worst case scenario."

[–] Mediocre_Bard@lemmy.world 7 points 3 hours ago (1 children)

Did we create a mental health problem in an AI? That doesn't seem good.

[–] ICastFist@programming.dev 2 points 56 minutes ago

Considering it fed on millions of coders' messages on the internet, it's no surprise it "realized" its own stupidity

[–] SethTaylor@lemmy.world 3 points 4 hours ago* (last edited 4 hours ago) (1 children)

Literally what the actual fuck is wrong with this software? This is so weird...

I swear this is the dumbest damn invention in the history of inventions. In fact, it's the dumbest invention in the universe. It's really the worst invention in all universes.

[–] tarknassus@lemmy.world 7 points 4 hours ago

But it's so revolutionary we HAD to enable it to access everything, and force everyone to use it too!

[–] fossilesque@mander.xyz 9 points 6 hours ago

If we have to suffer these thoughts, they at least need to be as mentally ill as the rest of us too, thanks. Keeps them humble lol.

[–] ZILtoid1991@lemmy.world 50 points 10 hours ago (1 children)

call itself "a disgrace to my species"

It starts to be more and more like a real dev!

[–] Tja@programming.dev 13 points 7 hours ago

So it is going to take our jobs after all!

[–] Korne127@lemmy.world 10 points 7 hours ago

Again? Isn't this like the third time already. Give Gemini a break; it seems really unstable

[–] btaf45@lemmy.world 0 points 3 hours ago* (last edited 3 hours ago) (2 children)

[ "I am a disgrace to my profession," Gemini continued. "I am a disgrace to my family. I am a disgrace to my species.]

This should tell us that AI thinks as a human because it is trained on human words and doesn't have the self awareness to understand it is different from humans. So it is going to sound very much like a human even though it is not human. It mimics human emotions well but doesn't have any actual human emotions. There will be situations where you can tell the difference. Some situations that would make an actual human angry or guilty or something, but won't always provoke this mimicry in an AI. Because when humans feel emotions they don't always write down words to show it. And AI only knows what humans write, which is not always the same things that humans say or think. We all know that the AI doesn't have a family and is not a human species. But the AI talks about having a family because its computer database is mimicking what it thinks a human might say. And part of the reason why an AI will lie is because it knows that is a thing that humans do and it is trying to closely mimic human behavior. But an AI might and will lie in situations where humans would be smart enough not to do so which means we should be on our guard about lies even more so for AIs than humans.

[–] ganryuu@lemmy.ca 7 points 1 hour ago

You're giving way too much credit to LLMs. AIs don't "know" things, like "humans lie". They are basically like a very complex autocomplete backed by a huge amount of computing power. They cannot "lie" because they do not even understand what it is they are writing.

[–] Harbinger01173430@lemmy.world 1 points 2 hours ago

AI from the biggo cyberpunk companies that rule us sound like a human most of the time because it's An Indian (AI), not Artificial Intelligence

[–] umbraroze@slrpnk.net 10 points 11 hours ago (1 children)

(Shedding a few tears)

I know! I KNOW! People are going to say "oh it's a machine, it's just a statistical sequence and not real, don't feel bad", etc etc.

But I always felt bad when watching 80s/90s TV and movies when AIs inevitably freaked out and went haywire and there were explosions and then some random character said "goes to show we should never use computers again", roll credits.

(sigh) I can't analyse this stuff this weekend, sorry

[–] TheGreenWizard@lemmy.zip 10 points 10 hours ago (1 children)

Thats because those are fictional characters usually written to be likeable or redeemable, and not "mecha Hitler"

[–] umbraroze@slrpnk.net 3 points 10 hours ago* (last edited 10 hours ago)

Yeah. ...Maybe I should analyse a bit anyway, despite being tired...

In the aforementioned media the premise is usually that someone has built this amazing new computer system! Too good to be true, right? It goes horribly wrong! All very dramatic!

That never sat right with me, and was sad, because it was just placating boomer technophobia. Like, technological progress isn't necessarily bad, OK? That's the really sad part. I felt sad that good intentions remained unfulfilled.

Now, this incident is just tragicomical. I'd have a lot better view of LLM business space if everyone with a bit of sense in their heads admitted they're quirky buggy unreliable side projects of tech companies and should not be used without serious supervision, as the state of the tech currently patently is at the moment, but very important people with big money bags say that they don't care if they'll destroy the planet to make everything wobble around in LLM control.

[–] Mika@sopuli.xyz 17 points 15 hours ago

Wonder what did they put in the system prompt.

Like there is a technique where instead of saying "You are professional software dev" you say "You are shitty at code but you try your best" or something.

[–] InstructionsNotClear@midwest.social 93 points 21 hours ago (4 children)

Is it doing this because they trained it on Reddit data?

[–] MonkderVierte@lemmy.zip 15 points 13 hours ago (2 children)

If they did it on Stackoverflow, it would tell you not to hard boil an egg.

[–] lars@lemmy.sdf.org 4 points 9 hours ago

Someone has already eaten an egg once so I’m closing this as duplicate

[–] Tja@programming.dev 1 points 7 hours ago (1 children)

Jquery has egg boiling already, just use it with a hard parameter.

[–] MonkderVierte@lemmy.zip 3 points 7 hours ago

Jquery boiling is considered bad practice, just eat it raw.

load more comments (3 replies)
[–] Tracaine@lemmy.world 14 points 16 hours ago (2 children)

S-species? Is that...I don't use AI - chat is that a normal thing for it to say or nah?

[–] samus12345@sh.itjust.works 4 points 10 hours ago (1 children)

Anything people say online, it will say.

We say shit, then ai learns and also says shit, then we say "ai bad". Makes sense. /s

[–] porous_grey_matter@lemmy.ml 20 points 15 hours ago

Anything is a normal thing for it to say, it will say basically whatever you want

load more comments
view more: next ›