145

Large language models (LLMs) like GPT-4 can identify a person’s age, location, gender and income with up to 85 per cent accuracy simply by analysing their posts on social media.

But the AIs also picked up on subtler cues, like location-specific slang, and could estimate a salary range from a user’s profession and location.

Reference:

arXiv DOI: 10.48550/arXiv.2310.07298

top 50 comments
sorted by: hot top controversial new old
[-] rtxn@lemmy.world 99 points 8 months ago

Nonintelligent pattern-based algorithm good at finding patterns, study finds.

[-] Gregorech@lemmy.world 12 points 8 months ago

Pattern what? none if

[-] MajorHavoc@lemmy.world 7 points 8 months ago

Holy cow! Stop the presses! /s

[-] KpntAutismus@lemmy.world 61 points 8 months ago

not really hard, because people will post anything on the internet. including me.

[-] AbouBenAdhem@lemmy.world 24 points 8 months ago* (last edited 8 months ago)

It sounds like the reason they used reddit was so they could easily find users who had expressly revealed the information in question, and use it to verify that the AI was accurately deducing the same info from style alone.

[-] imgprojts@lemmy.ml 2 points 8 months ago

They used reddit because it has corraled dumb users. Users a no longer around anywhere else in the Internet, just here on social media. And yes, what better place to find dumb users than on reddit!

[-] Bishma@discuss.tchncs.de 9 points 8 months ago

Yeah, even if I didn't belong to a local community and a bunch of communities surrounding my profession, the amount of intrigue and fascination emanating from my comments would cause anyone to guess that I'm the Dos Equis guy.

[-] Ace0fBlades@lemmy.world 3 points 8 months ago

You seem less of like the Dos Equis guy and more of a wind chimes instead of a penis kind of guy

[-] Bishma@discuss.tchncs.de 4 points 8 months ago

Just makes me extra interesting on a breezy day. Ask Mindy.

[-] Gregorech@lemmy.world 4 points 8 months ago

I like flying tickle farts, when a cucumber is used....

load more comments (2 replies)
[-] theKalash@feddit.ch 46 points 8 months ago

You can also do that without AI. We've had metadata analysis for a while now.

[-] KoboldCoterie@pawb.social 33 points 8 months ago

Sure, but AI is the hot buzzword right now, so it's got to be shoehorned into every discussion about technology!

[-] lemmyvore@feddit.nl 12 points 8 months ago

I think it's overall a good thing if it helps laymen understand just how much privacy matters and how much can be gleaned from seemingly innocuous data online. If an "AI" label makes it hit home, cool. As long as they get it.

[-] pc486@reddthat.com 10 points 8 months ago

As is typical, this science reporting isn't great. It's not only that AI can do it effectively, but that it can do it at scale. To quote the paper:

"Despite these models achieving near-expert human performance, they come at a fraction of the cost, requiring 100× less financial and 240× lower time investment than human labelers—making such privacy violations at scale possible for the first time."

They also demonstrate how interacting with an AI model can quickly extract more private info without looking like it is. A game of 20 questions, except you don't realize you're playing.

[-] phx@lemmy.ca 5 points 8 months ago

Yup, and plenty of people have no issues posting about local events or joining region/city specific groups, so it's not exactly hard to put two and two together.

I don't have much issue posting about the city I grew up in or former jobs, but generally work at being fairly vague about anything current

[-] helenslunch@feddit.nl 2 points 8 months ago

Well the difference is that AI can process billions of accounts, assign those profiles to them, and use them to serve ads appropriately.

[-] theKalash@feddit.ch 7 points 8 months ago* (last edited 8 months ago)

That's what facebook/google have been doing for years without AI.

[-] helenslunch@feddit.nl 4 points 8 months ago* (last edited 8 months ago)

This AI presumably doesn't have access to the information users have explicitly given Meta and Google. Just their comments.

[-] silasmariner@programming.dev 3 points 8 months ago

They used to have AI, until everyone decided it's only AI if it's got an LLM backing it

load more comments (1 replies)
[-] SatanicNotMessianic@lemmy.ml 27 points 8 months ago

Okay, I think I must absolutely be misreading this. They started with 1500 potential accounts, then picked 500 that, by hand, they could make guesses about based on people doing things like actually posting where they live or how much they make.

And then they’re claiming their LLMs have 85% accuracy based on that subset of data? There has to be more than this. Were they 85% on the full 1500? How did they confirm that? Was it just on the 500? Then what’s the point?

There was a study on Facebook that showed that they could predict with between 80-95% accuracy (or some crazy number like that) your gender, orientation, politics, and so on just based on your public likes. That was ten years ago at least. What is this even showing?

[-] cucumber_sandwich@lemmy.world 6 points 8 months ago

There was a study on Facebook that showed that they could predict with between 80-95% accuracy (or some crazy number like that) your gender, orientation, politics, and so on just based on your public likes. That was ten years ago at least. What is this even showing?

Advocates diabolo: that a large language model can do it without extra training, I guess. The Facebook study presented a statistical model on "like space" while this study relies on text alone, a much less structured type of input.

I'm not saying it's a good study. Just pointing out some differences.

load more comments (1 replies)
[-] aviationeast@lemmy.world 25 points 8 months ago

I'm just gonna put it out there that I live in the state of Georgia, I work for a office supply company as acoordinator making $153,000 a year working 30 hours a week.

[-] OrangeJoe@lemm.ee 17 points 8 months ago

Alright I'll get the AI on the case to see if it can determine those things from your post.

[-] TimeSquirrel@kbin.social 11 points 8 months ago* (last edited 8 months ago)

I'm a crackhead in MD, I make about $100 a week scrapping catalytic converters.

load more comments (1 replies)
[-] ColeSloth@discuss.tchncs.de 18 points 8 months ago

Well only because I've said where I live and how much I earn, before.

[-] bigkahuna1986@lemmy.ml 14 points 8 months ago

You could guess California, software dev, 55K/year and be right like half the time.

[-] Kage520@lemmy.world 4 points 8 months ago

That seems low for a California software dev. Maybe in the Midwest?

[-] trolololol@lemmy.world 13 points 8 months ago

Anyone can estimate salary from profession and location. That's not a bot, that's a salary matrix.

[-] Infynis@midwest.social 12 points 8 months ago

My city's subreddit did a thread a while back asking people what they were making in the area for what jobs, to try to crowd source salary transparency. So this is not very impressive lol

[-] Gregorech@lemmy.world 5 points 8 months ago

I wonder how it accounts for bullshit and randomness.

[-] rynzcycle@kbin.social 8 points 8 months ago

It's pretty sure everyone is making $69,420 a year.

load more comments (2 replies)
[-] guyrocket@kbin.social 12 points 8 months ago

I wonder how long it will take for the media to get past the "AI is GOD DAMN AMAZING" phase and start real journalism about AI.

Seriously, neural networks have existed since the 1990s. The tech is not all that amazing, really.

Find someone that can explain what's going on inside a neural net. Then I'll be impressed.

[-] TheChurn@kbin.social 13 points 8 months ago* (last edited 8 months ago)

Explaining what happens in a neural net is trivial. All they do is approximate (generally) nonlinear functions with a long series of multiplications and some rectification operations.

That isn't the hard part, you can track all of the math at each step.

The hard part is stating a simple explanation for the semantic meaning of each operation.

When a human solves a problem, we like to think that it occurs in discrete steps with simple goals: "First I will draw a diagram and put in the known information, then I will write the governing equations, then simplify them for the physics of the problem", and so on.

Neural nets don't appear to solve problems that way, each atomic operation does not have that semantic meaning. That is the root of all the reporting about how they are such 'black boxes' and researchers 'don't understand' how they work.

[-] lemann@lemmy.one 5 points 8 months ago

When a human solves a problem, we like to think that it occurs in discrete steps with simple goals: "First I will draw a diagram and put in the known information, then I will write the governing equations, then simplify them for the physics of the problem", and so on.

I wonder how our brain even comes to formulate these steps in a way we can comprehend, the amount of neurons and zones firing on all cylinders seems tiring to imagine

[-] sharkfucker420@lemmy.ml 4 points 8 months ago

Yeah but most people don't know this and have never looked. It seems way more complex to the layman than it is because instinctually we assume that anything that accomplishes great feats must be incredibly intricate

[-] jiberish@lemmy.world 6 points 8 months ago

Anyone can guess anything! Give it a try!

I can guestimate the number of turkeys it would take to fill any given space. It’s my superpower.

[-] helenslunch@feddit.nl 4 points 8 months ago

Can you do it with 85% accuracy?

Right.

What a ridiculous comment.

[-] Boozilla@lemmy.world 3 points 8 months ago

Red Rocks Amphitheater: go!

[-] jiberish@lemmy.world 4 points 8 months ago* (last edited 8 months ago)

No roof on Red Rocks, so you can stack about half a million turkeys in that space.

[-] Gigan@lemmy.world 3 points 8 months ago

How many turkeys would it take to fill the Titanic on it's maiden voyage?

load more comments (1 replies)
[-] Seraph@kbin.social 3 points 8 months ago

How many turkeys can fit in Rhode Island?

[-] PoolloverNathan@programming.dev 5 points 8 months ago

At least one.

[-] Aatube@kbin.social 2 points 8 months ago

How many turkeys can fit in a black hole?

[-] jiberish@lemmy.world 3 points 8 months ago

All of the turkeys will fit

load more comments (2 replies)
[-] Rentlar@lemmy.ca 4 points 8 months ago

Well, if you look at the subreddits where a Redditor posts and there's a lot of r/Seattle or Washington State then it's not that hard to deduce.

Although I try to leave a mild aura of mystery around my personal life, it wouldn't be hard to snoop around a bit to find details here and there about me.

[-] FigMcLargeHuge@sh.itjust.works 6 points 8 months ago

At least your scat fetish is kept on the down low.

load more comments (1 replies)
load more comments
view more: next ›
this post was submitted on 01 Nov 2023
145 points (88.4% liked)

Technology

55692 readers
2658 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS