TechTakes

1480 readers

181 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

dgerard@awful.systems

208

Whoops! AI tenant-screening tool SafeRent pays $2.28 million settlement for being massively racist (pivot-to-ai.com)

submitted 3 weeks ago by dgerard@awful.systems to c/techtakes@awful.systems

24 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] RamblingPanda@lemmynsfw.com 2 points 3 weeks ago (1 children)

My friend, not every AI rates people for their skin tone.

[–] Gullible@sh.itjust.works 8 points 3 weeks ago (1 children)

Pretty sure every single one since Tay has been fairly racist. They get around that fact in many modern AIs by forcing subject changes but it’s still fairly racist on the backend. Early “jailbreaking” proved as much.

[–] RamblingPanda@lemmynsfw.com 4 points 3 weeks ago (1 children)

My coding AI is bullshit and almost every Kotlin, SQL, Java or whatever snippet is a hallucination, but I'm pretty sure it's not racist.

Not all AIs are made for the topic here. But all suffer from the same issues. Shit in, shit out.

[–] YourNetworkIsHaunted@awful.systems 2 points 2 weeks ago

I mean, it's operating in a domain where racism doesn't come up nearly as often, but I'm pretty sure if you managed to get an appropriate edge case it would end up at least as racist as the average StackOverflow user, which is to say more racist than we should be comfortable accepting uncritically.