this post was submitted on 27 Sep 2024
660 points (98.7% liked)

Technology

58292 readers
3925 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Anyone who has been surfing the web for a while is probably used to clicking through a CAPTCHA grid of street images, identifying everyday objects to prove that they're a human and not an automated bot. Now, though, new research claims that locally run bots using specially trained image-recognition models can match human-level performance in this style of CAPTCHA, achieving a 100 percent success rate despite being decidedly not human.

ETH Zurich PhD student Andreas Plesner and his colleagues' new research, available as a pre-print paper, focuses on Google's ReCAPTCHA v2, which challenges users to identify which street images in a grid contain items like bicycles, crosswalks, mountains, stairs, or traffic lights. Google began phasing that system out years ago in favor of an "invisible" reCAPTCHA v3 that analyzes user interactions rather than offering an explicit challenge.

Despite this, the older reCAPTCHA v2 is still used by millions of websites. And even sites that use the updated reCAPTCHA v3 will sometimes use reCAPTCHA v2 as a fallback when the updated system gives a user a low "human" confidence rating.

you are viewing a single comment's thread
view the rest of the comments
[–] mosiacmango@lemm.ee 81 points 1 day ago* (last edited 1 day ago) (4 children)

This is actually a good sign for self driving. Google was using this data as a training set for Waymo. If AI is accurately identifying vehicles and traffic markings, it should be able to process interactions with them easier.

[–] iAmTheTot@sh.itjust.works 63 points 1 day ago (4 children)

As I understand it, the point of those captchas was never really "bots can't identify these things" (though you're right on that it was used to train). They use cursor movement, clicks, and other behaviours while you're solving it to detect if you are a bot or not.

[–] nieceandtows@lemmy.world 5 points 10 hours ago (1 children)

Is that why I'm asked to do this over and over for 14 million times when I'm on a VPN?

[–] iAmTheTot@sh.itjust.works 4 points 8 hours ago

It is probably part of it, yeah. But to be clear I'm not a captcha expert or anything, just a layman.

[–] Grimy@lemmy.world 31 points 1 day ago

The image choosing was always just to train their own bots

[–] Takumidesh@lemmy.world 9 points 1 day ago* (last edited 1 day ago)

It's a combination.

Most captchas goals generally aren't 100% prevention, it's to put a workload in front, this makes spamming the site cost money, a bankrolled attempt could just as easily outsource the captchas to real humans.

[–] Mushroomm@sh.itjust.works 9 points 1 day ago

Since I started getting good at yosu and that fishing mini game in farmrpg I've been failing more captchas. I wonder if they're related knowing this

[–] grue@lemmy.world 29 points 1 day ago

The annoying thing is that they held us hostage for our free labor, but the results are proprietary for Google's benefit only.

That training data ought to be forced to be made freely available to the public, since we're the ones who actually created it.

[–] crusa187@lemmy.ml 3 points 1 day ago

Afaik this is precisely what the captcha data was intended for - training AI models. Originally leveraged machine learning. LLMs are a slightly different paradigm but same purpose and results here.

[–] cypherpunks@lemmy.ml 1 points 1 day ago (2 children)

i hope you're joking. please, tell me you're joking?

[–] x00za@lemmy.dbzer0.com 14 points 1 day ago

Well reCaptcha v1 was used for the digitization of books. And that they proudly talked about.

But to be honest, the pictures were in fact used to dether bots. But also to teach selfdriving cars. I think I also remember a time they used to ask to fill in house numbers probably for their Maps accuracy.

[–] mosiacmango@lemm.ee 12 points 1 day ago* (last edited 1 day ago) (1 children)

Its never been confirmed by Google, so I may be wrong. It still tracks that the data harvesting company with a AI self driving car project would use free human labor to identify road hazards.