this post was submitted on 12 Jul 2025
142 points (93.8% liked)

Fuck AI

3428 readers
742 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

founded 1 year ago
MODERATORS
 

Imagine that can be done to get social security numbers, credit card numbers, people's private information like addresses, phone numbers, emails, etc.

top 12 comments
sorted by: hot top controversial new old
[–] hexagonwin@lemmy.sdf.org 34 points 1 day ago (1 children)

doesn't seem that big of a deal. these are kms client activation keys, you can even find them on official microsoft pages. all public information. even if they weren't one could say search engines have the exact same problem and even argue LLMs make these private info harder to believe/obfuscated.

[–] DarkDarkHouse@lemmy.sdf.org 28 points 1 day ago

The important point is that they can regurgitate specific strings they have ingested. Personal information they have sucked up could just as easily still be in there.

[–] Kyrgizion@lemmy.world 30 points 1 day ago (1 children)

I thought they somehow managed to trick it into revealing the keys of the systems it was running on, but these are just random kms keys from forums.

Still neat how they use tags to obfuscate the filtered keywords. Gonna have to remember that one.

[–] Agent641@lemmy.world 5 points 1 day ago

God I hope OpenAI isn't running prod ChatGPT on a windows 10 pro desktop as its server.

[–] rebelsimile@sh.itjust.works 9 points 1 day ago (1 children)

I’m trying so many angles to tell people how mundane shit like this is, let me try one more:

it’s not interesting that an LLM can pull back something anyone can find in a google search result if they took more than 2 minutes. Stop writing articles about this shit.

[–] shalafi@lemmy.world 5 points 1 day ago

Read the damn article before expressing an opinion on the damn article.

[–] nightlily@leminal.space 3 points 23 hours ago (1 children)

Since everyone apparently missed the point of the article, the interesting part isn’t the keys, it’s the bypassing of the guardrails.

[–] GreenKnight23@lemmy.world 1 points 22 hours ago

guardrails? what guardrails?

[–] RamblingPanda@lemmynsfw.com 10 points 1 day ago

That's nothing. If you do it the right way, they can help you set up Linux and be free of Microsoft's garbage!

[–] hansolo 6 points 1 day ago (1 children)

Cool, now do it with an SSN and DOB and see what you get.

[–] biggerbogboy@sh.itjust.works 3 points 1 day ago (1 children)
[–] cecilkorik@lemmy.ca 2 points 1 day ago

It only generates accurate records of SSN and DOB for Aryan people though.