Technology

58306 readers

4273 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

founded 1 year ago

MODERATORS

530

submitted 1 year ago by L4s@lemmy.world to c/technology@lemmy.world

155 comments fedilink hide all child comments

ChatGPT use declines as users complain about ‘dumber’ answers, and the reason might be AI’s biggest threat for the future::AI for the smart guy?

you are viewing a single comment's thread
view the rest of the comments

[–] nottheengineer@feddit.de 6 points 1 year ago (1 children)

It definitely got more stupid. I stopped paying for plus because the current GPT4 isn't much better than the old GPT3.5.

If you check downdetector.com, it's obvious why they did this. Their infrastructure just couldn't keep up with the full size models.

I think I'll get myself a proper GPU so I can run my own LLMs without worrying that they could stop working for my use case.

[–] anlumo@feddit.de 3 points 1 year ago (1 children)

GPT4 needs a cluster of around 100 server-grade GPUs that are more than 20k each, I don’t think you have that lying around at home.

[–] nottheengineer@feddit.de 3 points 1 year ago

I don't, but a consumer card with 24GB of VRAM can run a model that's about as powerful as the current GPT3.5 in some use cases.

And you can rent some of that server-grade hardware for a short time to do fine-tuning, which lets you surpass even GPT4 in some niches.