this post was submitted on 05 Oct 2023
265 points (97.5% liked)

Technology

59466 readers
4386 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Deepfake celebrities begin shilling products on social media, causing alarm::Hanks and other celebrities have recently become targets of AI-powered ad scams.

all 48 comments
sorted by: hot top controversial new old
[–] coffeebiscuit@lemmy.world 89 points 1 year ago (1 children)

“We didn’t see this coming.” - nobody.

[–] glowie@infosec.pub 22 points 1 year ago (2 children)

Yea it's a pretty bleak and dystopian future ahead. This next US election is going to be wild.

[–] coffeebiscuit@lemmy.world 25 points 1 year ago

Not just in the US.

[–] TheGrandNagus@lemmy.world 20 points 1 year ago* (last edited 1 year ago) (2 children)

Believe it or not, people outside the US also have computers and elections lol

[–] possiblylinux127@lemmy.zip 13 points 1 year ago

Where's your proof

[–] glowie@infosec.pub 7 points 1 year ago (1 children)

I am outside the US, but it's the next big, global election. You'll watch it, I'll watch it, the world will watch it.

[–] SinningStromgald@lemmy.world 6 points 1 year ago (1 children)

And the fact that it could very well be the end of any semblance of democracy the US has left if Trump and his ilk get power again.

[–] FlyingSquid@lemmy.world 64 points 1 year ago (3 children)

There's an attitude I'm seeing in this thread, I already responded to someone about it, that I find really disturbing. The attitude that the less intelligent or the less tech-savvy deserve to be scammed by this.

I don't think people deserve to be scammed for those reasons and, as I said, I'm pretty disturbed by that attitude.

[–] namelessdread@lemmy.world 16 points 1 year ago

Completely agree. Not only is it disturbing how little people care, but there's a far bigger picture.

Right now it's celebrities shilling products. What happens when it's political figures? What happens when the messages spread misinformation or violence?

It doesn't matter whether or not you fall for it as an individual. It will impact society. Full stop.

People need to be more understanding and compassionate. If you know so much and are so great at identifying these things and so technologically savvy, help educate those around you. Vote in every election, including local elections, to vote into power people who understand these issues and will act on the best interest of the people.

Those people will be the same ones using AI to troll people. They also sidestep the idea of anyone’s likeness being their own, and the obvious slippery slope of AI being used to tell straight up lies using the faces of people who should be able to be trusted.

[–] SkyNTP@lemmy.ca 1 points 1 year ago* (last edited 1 year ago) (1 children)

There's a fine line between deserving of being scammed because of who they are and consequences of actions or inaction and it's important we do not cross that line.

People have to take some responsibility to think critically about the content they consume. If people are not capable of consuming content responsibly, perhaps they should not consume content at all.

The alternative is policing content itself, and that is a very dangerous place to be for a whole host of other reasons.

[–] FlyingSquid@lemmy.world 2 points 1 year ago

If people are not capable of consuming content responsibly, perhaps they should not consume content at all.

And how do you propose to block them from it? Do you think the corporations that create that content care if their consumers are responsible?

[–] serial_crusher@lemmy.basedcount.com 12 points 1 year ago (2 children)

I guess if you’re stupid enough to buy a dental plan based on Tom Hanks’s recommendation, you’re also dumb enough to think Tom Hanks still looks that young.

[–] FlyingSquid@lemmy.world 24 points 1 year ago (2 children)

Stupid people deserve consumer protection too. Don't be a snob.

[–] winkerjadams@lemmy.dbzer0.com 6 points 1 year ago (2 children)

Problem is a lot of the stupid people are the ones voting to destroy the protections they need.

[–] FlyingSquid@lemmy.world 3 points 1 year ago (1 children)

A lot of them or all of them? Because if it isn't all of them, they deserve those protections.

I don't know... that argument seems to me like saying because some poor people are Republicans and vote against it, they don't deserve universal healthcare.

Protections should be universal.

[–] winkerjadams@lemmy.dbzer0.com 1 points 1 year ago (1 children)

I didn't say they don't deserve it, just that they don't make the best decisions when it comes to what is best for themselves.

[–] FlyingSquid@lemmy.world 2 points 1 year ago

Even more reason why they need protection.

[–] lemann@lemmy.one 2 points 1 year ago

Feels like a symptom of poor education to me.

Society in general seems to give up quickly on people who might need extra support to learn, without really considering the consequences

[–] RobotToaster@mander.xyz 0 points 1 year ago

The point is these people are already being scammed, regardless of if it's the real Tom Hanks.

[–] admin@lemmy.my-box.dev 1 points 1 year ago

Unfortunately, still "smart" enough to vote.

[–] doctorn@r.nf 12 points 1 year ago

Been going on for years already,... They only noticed this now? 😅

[–] sir_reginald@lemmy.world 12 points 1 year ago

People who buy stuff just because a celebrity tells them make me lose hope in humanity. And I'm not talking about deepfakes, which are bad for their own reasons. But I find the fact that people buy a product just because there's a famous face next to it rather stupid.

[–] Wooki@lemmy.world 11 points 1 year ago

Digital advertisement platforms need significantly harder ad regulation. We do it for other mediums, digital should be more regulated considering the reach and revenue.

[–] RobotToaster@mander.xyz 11 points 1 year ago (3 children)

Did anyone ever think that celebrities that appeared in advertisements actually used or liked the products they are paid to promote?

This seems like false outrage.

[–] Dellyjonut@lemmy.world 15 points 1 year ago (1 children)

I think the issue is more that people think something is legitimate, and when they go to purchase it or something they get their identity stolen

[–] Rodeo@lemmy.ca 8 points 1 year ago

The celebrities may pay lip service to that, but really they're concerned about unlicensed use of their image.

[–] Mac@mander.xyz 6 points 1 year ago (1 children)
[–] RobotToaster@mander.xyz 3 points 1 year ago

I know, I have a bad habit of underestimating the collective stupidity of people.

[–] ChaoticEntropy@feddit.uk 4 points 1 year ago

They particularly liked the part of their partnership when the cheque cleared in their bank account.

[–] autotldr@lemmings.world 4 points 1 year ago

This is the best summary I could come up with:


The next day, CBS anchor Gayle King warned of a similar scheme using her likeness to sell a weight-loss product.

Also on Monday, YouTube celebrity MrBeast posted on social media network X about a similar scam that features a modified video of him with manipulated speech and lip movements promoting a fraudulent iPhone 15 giveaway.

As we've warned, convincing AI deepfakes are an increasingly pressing issue that may undermine shared trust and threaten the reliability of communications technologies by casting doubt on someone's identity.

Currently, companies like Google and OpenAI have plans to watermark AI-generated content and add metadata to track provenance.

Meanwhile, social media networks will likely need to step up moderation efforts, reacting quickly when suspicious content is flagged by users.

Almost a year later, with technology advancing rapidly, a small taste of that chaos is arguably descending upon us, and our advice could just as easily be applied to video and photos.


The original article contains 585 words, the summary contains 155 words. Saved 74%. I'm a bot and I'm open source!

[–] banneryear1868@lemmy.world 0 points 1 year ago

"Elon has an invention that can turn anyone in to a millionaire in 30 days!"

[–] Touching_Grass@lemmy.world -2 points 1 year ago (1 children)

These celebrities should be making $60,000 to $150,000 like the rest of us anyways. What the hell do they produce

[–] Tikiporch@lemmy.world 5 points 1 year ago (2 children)

Many actors make that, or much less. The big names put asses in seats though. No one is paying money to watch my loser brother in law pretending to be stranded on an island yelling at volleyballs.

[–] pineapplepizza@lemm.ee 1 points 1 year ago

I'd pay $1 to see that.

[–] Touching_Grass@lemmy.world 0 points 1 year ago

They would. But still doesn't justify the pay. Many people come together to make films and actors are the least hard working of all of them. They exploited the system just like these AI systems are. Its not something I have sympathy for and if they replace actors with computer generated models and the profession goes back to just a regular job, I feel like we haven't lost anything