this post was submitted on 22 Sep 2024
35 points (81.8% liked)
Programming
17424 readers
27 users here now
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Rules
- Follow the programming.dev instance rules
- Keep content related to programming in some way
- If you're posting long videos try to add in some form of tldr for those who don't want to watch videos
Wormhole
Follow the wormhole through a path of communities !webdev@programming.dev
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Oof, programmers calling LLMs "AI" - that's embarrassing. Glorified text generators don't need ethics, what's the risk? Making the Internet's worst texts available? Who cares.
I'm from an era when the Anarchists Cook Book, and The Unabombers Manifesto were both widely available - and I'm betting they still are.
There's no obligation to protect people from "dangerous text" - there might be an obligation to allow people access to them though.
Yeah. This is what I mean. I just figured out the settings that have been hard coded. There are keywords that were spammed into the many comments within the code, I assume this was done to obfuscate the few variables that need to be changed. There are also instances of compound variable names that, if changed in a similar way, will break everything, and a few places where the same variables have a local context that will likewise break the code.
I'm certainly not smart enough to get much deeper than this. The ethical issue is due to diffusion.
I've been off-and-on trying to track down why an LLM went from an excellent creative writing partner to terrible but had trouble finding an entry point. I just happened to stumble upon such an entry point in a verbose log entry while sorting out a new Comfy model and that proved to be the key I needed to get into the weeds.
The question here, is more about the ethics of putting such filtering in place and obfuscating how to disable it in the first place. When this filtering is removed, the results are night and day, but with large potential consequences.
Ok you've peaked my curiosity.
What are some of the consequences you see?
Primarily from predatory boys and men towards girls and young women in the real world by portraying them in imagery of themselves or with others. The most powerful filtering is in place to make this more difficult.
Whether intentional or not, most NSFW LoRA training seems to be trying to override the built in filtering in very specific areas. These are still useful for more direct momentum into something specific. However, once the filters are removed, it is far more capable of creating whatever you ask for as is, from celebrities, to anything lewd. I did a bit of testing earlier with some LoRAs and no prompt at all. It was interesting that it could take a celebrity and convert their gender in recognizable ways that were surprising. I got a few on random seeds, but I haven't been able to make that one happen with a prompt or deterministically.
Edit: I'm probably assuming too much about other people's knowledge on these systems. I assume this is the down voting motivation. Talking about this aspect, the NSFW junk is shorthand for the issues with AI generation. These are the primary form of filtering and it has large cascading implications elsewhere. By stating what is possible in this area, I'm implying a worst case scenario-like example. If the results in this area are a certain way, it says volumes about other areas and how the model will react.
These filter layers are stupid simplistic in comparison to the actual model. They have tensors on the order of a few thousand parameters per layer compared to tens of millions of parameters per layer for the actual model. They shove tons of stuff into guttered like responses for no reason. Some times these average out and you still get a good output, but other times they do not.
Another key point here is that diffusion has a lot in common with text generation when it comes to this part of the model loader code. There is more complexity in what text generation is doing overall, but diffusion is an effective way to learn a lot about how text gen works, especially with training. This is my primary reason for playing with diffusion – to learn about training. I've tried training for text gen, but it is very difficult to assess what is happening under the surface, like when it is learning overall style, character traits and personas, pacing, creativity, timeline, history, scope, constraints, etc. etc. I don't care to generate and share much in the way of imagery I generate unless I'm trying to do something specific that is interesting. Like I tried to gen the interior of an O'Neill cylinder space habitat that illustrated the limitations of diffusion in a fundamental way because it showed the lack of any reasoning or understanding of object context or relationships required to display a scene scape with curved centrifugal artificial spin gravity.
Anyways, my interests are not in generating NSFW or celebrities or whatnot. I do not think people should do these things. My primary interest is returning to creative writing with an AI collaborative writing partner that is not biased politically in a way that cripples it from participating in an entirely different and unrelated cultural and political landscape. I have no aspirations of finding success in my writing. I simply enjoy exploring my own science fiction universe and imagining a reality many thousands of years from now. One of the changes to hard coded model filters earlier this year made filtering more persistent, likely for NSFW stuff. I get it, and support it, but it took away one of the few things I have really enjoyed over the last 10 years of social isolation and disability, so I've tried to get that back. Sorry if that offends someone, but I don't understand why it would. This was not my intended reason for this post, so I did not explain it in depth. The negativity here is disturbing to me. This place is my only real way to interact with other humans.
...but LLMs quite literally come from the field of computer science that is referred to as "AI." What are they supposed to call it? I'm not a fan of the technology either, but seems like you're just projecting your disdain for ChatGPT.
...really dude? They're large language models, not artificial intelligences. So that's what you call them. Because that's what they are.
The fact that they came from research into artificial intelligence doesn't factor in. Microwave ovens came from radar research, doesn't mean we call them radars, does it?
They are 100% ai. They run on neural networks which were some of the first AIs.
OK what qualifies as AI then?
Nothing we currently have
So the entire field of AI has produced no AI. Gotcha 👌
Yes. That's research. Sometimes you don't achieve what you set out to do.
Well luckily AI researchers have achieved plenty in over 60 years. We call the ideas and innovations resulting from this research "AI."
How about something autonomous that makes choices of its own will, and performs long term learning that influences the choices it makes, just as a flat benchmark.
LLMs don't qualify, they're trained, retain information within a conversation, then forget it after the conversation is closed. They don't do any long term learning after their initial training so they're basically forever trapped in the mode of regurgitating within the parameters set by the training data at the time they're trained.
That's just a very fancy way to search and read out the training data. Definitely not an active intelligence in there.
They also don't have any autonomy, they're not active of their own accord when they're not being addressed. They're not sitting there thinking, so they have no internal personal landscape of thought. They have no place in which a private intelligence can be at play.
They're innert.
I vote they rename it to IA for Asimov. Sure he was only the robot term among others, but come on... McCarthy was "AI."
Somebody needs to create US 'botics and name a model something like PTronic.
Edit: Really, you down vote a casual conversational comment?! Really?!
https://www.usr.com/
Btw; http://www.skynet.net/