this post was submitted on 15 Jun 2023
57 points (100.0% liked)
Technology
37602 readers
212 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The AI does exactly what it was programmed to do. It's a machine. They fucked up making it, that's the reality here.
The cynic in me says they didn't actually fuck up. The AI being horny brought more attention to it and playing it off like "oh no! it went rogue!" gives them even more headlines. All a strategic play.
Eh, all chat bots trained on internet data become horny in the same way that virtually all AI is racist. It's merely a reflection of the data it's trained on, but a lot of people think they can magically control it by putting 'safeguards' after it's been trained. The constant game of cat and mouse with gpt3/4 and prompts to getting it to ignore safeguards are proof this doesn't work.
You can fix this through additional weighted layers and more complex upstream training tweaks, but then you have to pay to retrain which is by far the most expensive part about open AIs model.
You can also curate the training data so that it's not problematic, but then you are biasing the model in other ways.
Impossible at scale. Data is always biased, it's a matter of tradeoff
Yeah, I laughed at that part. The bot does what it interprets from the training data. Her entire schtick is leaning into sexual overtones to keep the guys subscribed. The fact that the bot started replicating that is entirely expected.
The trick there is that there is a fine line she walks between keeping it overt enough to keep the guys interested, but not so forward as to cross the terms of service boundaries on Twitch/YouTube. I think the problem is really that the bot isn't adhering to the "tone it down so we don't get banned from the service" unwritten rule. I'm not sure if I'd call that "rogue" though.
But, this is a great use case for a LLM, and if she can capitalise on it then good on her.
@alyaza @maynarkh This storied of LLMs gone rogue is just a cover to not be held accountable for the failures of the machines.