this post was submitted on 15 Jul 2023
530 points (100.0% liked)

Technology

59377 readers
3597 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

ChatGPT use declines as users complain about ‘dumber’ answers, and the reason might be AI’s biggest threat for the future::AI for the smart guy?

you are viewing a single comment's thread
view the rest of the comments
[–] ragnar_ok@discuss.tchncs.de 142 points 1 year ago* (last edited 1 year ago) (7 children)

The free version of ChatGPT DEFINITELY is dumber than it was even a couple of months ago. Used to be able to get decent, useful code reviews out of it, now it barely knows how to write a nested loop anymore.

It’s storytelling capabilities fell off a cliff too, the drive towards safely sanitized unoffensive-at-all-times content it can output has rendered every story, choose-your-own-adventure or collaborative role playing game sterile, empty expressions of black and white stories with no nuance allowed where saintly goodness is the only choice possible

In my own experience, chatGPT has been massively nerfed for the use cases I used it for

[–] Pixlbabble@lemmy.world 40 points 1 year ago (1 children)

I tried a naughtybot for some steamy chat for the first time yesterday. I ended up in fight with the bitch.

[–] Ilovethebomb@lemmy.world 4 points 1 year ago

Hahahaha that's brilliant.

[–] Kerfuffle@sh.itjust.works 19 points 1 year ago (1 children)

65B LLaMA models can actually do a pretty good job of writing. Here's two examples with Guanaco 65B (bold part is my prompt):

tags: fairy tale, animals, dog, wolf, fox, death, humor, dark storyline, violence, loss

Animals in a forest setting investigate a series of gruesome murders that recently occured. Written in the style of classics like Animal Farm and Watership Down, the writing is vivid and very descriptive. The dialog is thoughtful and often quite witty. It's clear the author really understands animal behavior and has done their research well!

---

Chapter 1: An Unfortunate Discovery

A fox by species, a detective by trade, you'll only have reason to know my name if the worst has come to pass. It's nearly winter and a bitter wind drives stinging sleet into my face, but it's still not as chilling as the scene before me now...

I was summoned here by an urgent message from a panicked hedgehog. She told me she found her friend lying dead on his doorstep with his throat ripped out - black fur matted with blood. I rushed over immediately and saw for myself what had happened. He looked so peaceful despite being cut down in his prime - a young wolf just starting doing well for himself - taken too soon. His home nearby showed no signs of struggle or forced entry. Whoever did this must have caught him off guard somehow. I didn't hear any howling either. That would have been easy enough to miss though since he lived alone deep in these woods where few creatures tread. I made sure to secure the crime scene and look around carefully without disturbing anything more than necessary until other investigators arrived. They should be here soon. We can't afford to lose evidence in cases like this. Times are already hard enough as it is...

As I waited and pondered who might have committed such a horrible act, something felt wrong about all this. Surely a predator like me could smell another predator's scent? But there were none that stood out among the melange of odors lingering here. How strange...

Soon after, several others joined me including some friends of mine. A stoic bear named Growler, grumpy badger called Grumpus, and a kindly old raccoon who goes by "Doc" due to his extensive knowledge of medicinal plants and wildlife biology. Together we began our investigation proper by gathering clues and questioning nearby witnesses while trying to minimize contamination through contact with them (we took care to put up caution tape first). Unfortunately, they hadn't seen much useful apart from occasional glimpses of movement deeper in the undergrowth. Still, we decided to check those areas next along with searching the surrounding woodlands thoroughly for any additional victims. And find one we did, although sadly she suffered the same fate as poor George. Another young wolf lay beside a stream, body cold and stiffening. Someone snapped her neck cleanly like a twig. This couldn't be coincidence surely? Not two deaths in quick succession like this.


before me or what I must relay when I return home. My mind races with questions as I survey this brutal crime scene; who could do such a thing? Why was no one there to stop them? And how many more victims lie undiscovered further out in these woods? A lone paw print leads away from where a rabbit family once happily resided, now reduced to bloody scraps scattered among splintered twigs and torn fur. This isn't just some random predator attack, something far more sinister is at play here...

I turn back toward town, determined to find answers. As I trudge through the snow, each step feels heavier than the last. How will I break the news to those closest to them? What words can possibly bring comfort after so much senseless suffering? I shake my head, trying to focus on the task at hand. There are others depending on me right now, they need someone strong and steady to guide them through this darkness. I won't let them down.

The first person I see upon entering town is old man Badger, his white whiskers blown about by the gusting wind. He looks up at me expectantly, "Well Fox, did you find anything?" His voice quavers slightly, betraying his concern for the missing families.

"I'm afraid I have bad news," I say somberly, "there were signs of a struggle near the burrow entrance, but no survivors."

Badger sighs heavily, "Dear me, this is worse than we feared. We must alert the council immediately!"

We hurry over to the meeting hall, a large hollow tree that serves as our central gathering place. Inside, several other animals are already waiting anxiously for word of their loved ones. They look up hopefully as we enter, then quickly realize the grim tidings we bear. A collective groan fills the room, followed by muffled sobs and whispered prayers.

Mayor Bear calls for order, her deep voice cutting through the din. She motions for us to join her at the front of the room, "Please tell us everything you saw, Fox. Every detail may be important."

[–] Calimhero@lemmy.world 36 points 1 year ago (2 children)

Writer here. Very sorry to contradict you, but this is absolute shit. It looks good on the surface, but that's all.

[–] spark947@lemm.ee 16 points 1 year ago* (last edited 1 year ago) (1 children)

Yeah, while it's cool that a computer can make a story, I have yet to see one that you would think was written by a human and would want to read.

[–] bitcrafter@lemmy.sdf.org 9 points 1 year ago

I don't know, this story is very reminiscent of the kind of thing my elementary school age cousin writes, but with a greater mastery of vocabulary and grammar. It's not in any way great, bit it's charming in it's own way when held against that (low) standard.

[–] Kerfuffle@sh.itjust.works 15 points 1 year ago (1 children)

Very sorry to contradict you, but this is absolute shit.

To be clear, I'm talking in relative terms. Would you argue that ChatGPT did a massively better job and didn't write "absolute shit"?

It looks good on the surface, but that’s all.

From some of the stuff I've seen published, that might just be enough for certain people. I could even be that "certain people" from time to time, sometimes just the right theme, setting and some time to fill is sufficient.

[–] Calimhero@lemmy.world 7 points 1 year ago (3 children)

that might just be enough for certain people

Trust me, it's not.

[–] Gutless2615@ttrpg.network 7 points 1 year ago

Why should we trust you? They’re plenty of shit writing out there that’s Good Enough to get paid.

[–] Kerfuffle@sh.itjust.works 6 points 1 year ago (1 children)

Trust me, it’s not.

That's a silly thing to say. Like I said, I could read something like that from time to time so you're asking me to trust you over my own experience. People also post/publish fiction of varying quality all over the internet, and it gets read. I've seen worse writing than that with hundreds or thousands of reads.

Maybe you're only talking about a publisher buying the work and publishing it but you never said anything like that. Even so, I've seen some books that were pretty bad so I'm not sure I'd trust you even there.

[–] setsneedtofeed@lemmy.world 1 points 1 year ago

I’ve read two books written by A. American.

Anybody can get published.

[–] QuadratureSurfer@lemmy.world 4 points 1 year ago

For a writer... You're not writing a whole lot or even really trying to break down why it's a bad story...

[–] ribboo@lemm.ee 15 points 1 year ago* (last edited 1 year ago) (3 children)

It has not gotten worse for coding. GPT4 is incredibly much better, if anything. And it’s total bullshit that it can’t write a nested loop.

I use it daily for work, so I’d definitely know.

[–] ragnar_ok@discuss.tchncs.de 16 points 1 year ago (1 children)

Sorry I should have mentioned I’m talking about the free version of chatGPT

[–] ribboo@lemm.ee 15 points 1 year ago

I should honestly have understood that! Never mind then, glad we could clear that up

[–] Calimhero@lemmy.world 9 points 1 year ago (1 children)

Don't know why you're downvoted. I use GPT4 to code and design infrastructure and it's very, very good. Around 500% productivity boost.

[–] ribboo@lemm.ee 6 points 1 year ago

Glad someone is realizing what I am!

[–] fraydabson@sopuli.xyz 5 points 1 year ago (1 children)

I know he didn’t say he wasn’t using gpt4 but it seems pretty clear. So saying it’s bullshit that gpt3.5 is dumber then 4 is pretty inaccurate.

[–] ribboo@lemm.ee 1 points 1 year ago

Fair enough. Saying chatgpt has gotten dumber is false, saying 3.5 has might be true!

[–] mememuseum@lemmy.world 8 points 1 year ago (2 children)

Do you know of any good alternatives for role playing? I used it a while back to flesh out some NPCs and location for a DnD game I was planning on running but if it's gotten noticeably worse I'd like to try something else.

[–] ClamDrinker@lemmy.world 5 points 1 year ago* (last edited 1 year ago)

NovelAI - They even train their own models specifically for storytelling (and to avoid undue censorship from an outside model provider like OpenAI)

[–] whoisearth@lemmy.ca 1 points 1 year ago (1 children)
[–] ClamDrinker@lemmy.world 3 points 1 year ago

Definitely stay away from AI dungeon - they have a long history of privacy, moderation and censorship concerns. and relevant to this discussion, players have repeatedly noticed decreased functionality of the AI in favor of censoring it further (very similar mindset to OpenAI, which they used to work with very closely)

[–] HandwovenConsensus@lemm.ee 4 points 1 year ago

Really? I actually found it's gotten less restrictive recently. Maybe it's just because now I've learned to control the context so it doesn't perceive a request as offensive.

[–] mrmanager 2 points 1 year ago (2 children)

Why did they do this? Did government step in and forced them to nerf it, because it was too powerful for citizens to use?

[–] sjatar@sjatar.net 24 points 1 year ago

I'm sorry but this sounds more like a conspiracy theory then a real concern. Occam's razor probably says it's expensive to run the service at full power. ChatGPT already generated a cult like following for AI so no need to spend a ton on the service and they can profit of the hype.

Not that openAI is held back by a government that is somehow afraid that it will empower the people, to do what? Revolution?

[–] ragnar_ok@discuss.tchncs.de 7 points 1 year ago

I don’t think anybody stepped in, I’m only talking about the free version. It makes some sense they’d gimp it in order to make more people sign up for the paid version, I guess

[–] RocksForBrains@lemm.ee 1 points 1 year ago

I find the quality is controllable to a degree by instructing it which sources to use.

Obviously proofread the damn thing and fix any glaring errors.