this post was submitted on 03 Aug 2023
145 points (95.0% liked)
Technology
55973 readers
3207 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It doesn't really matter that it was her in this image. When you put "professional" into it then you can expect something along these results:
https://www.google.com/search?q=professional+woman
And overall in I'd say.. 7 out of 10 images this is a white woman in a Google search. So the probability is high that the training data also has a bias towards that.
Someone in the original lemmy.nz post said they did the exact same thing, same image, same prompt, and it turned her Indian. So if you have very wide training data the result would be rather "random". Or you have very narrow training data and the result will always be looking similar.
Grab an app focused on an Asian audience with beauty filters for example and it will turn a white person into an Asian one. But no one complains there that the app is racist.
Notice how not a single woman there is wearing a university sweatshirt.
My point still stands. It didn’t touch her clothing to make it more “professional.” Just her race. It screwed up on multiple levels here.
It’s ok to admit that you don’t understand how the models were trained and that it in no way “screwed up”.
Sounds like they fucked up training the AI then. For a user it doesn't matter whether the AI is designed poorly or trained poorly, it's behaving poorly.