this post was submitted on 06 Jan 2025
774 points (99.9% liked)
TechTakes
1532 readers
257 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Much like uber and netflix, all of these ai chatbots that are available for free right now will become expensive, slow, and dumb once the investor money runs out and these companies have to figure out a business model. We're in the golden age of LLMs right now, all we can do is enjoy the free service while it lasts and try not to make it too much a part of our workflow, because inevitably it will be cut off. Unless you're one of those people with a self-hosted LLM I guess.
Not LLM but there Google Assistant has gotten much more stupid over the past several years. They realized that it was too expensive and had to lobotomize it.
Can't even set a timer with it anymore which was pretty much all I used it for. That and navigation with Android Auto
Huh? I set a timer with a voice command just two days ago. I'm not using "Gemini" though, does opting into that literally remove functionality?
Just tried it again, and it worked but for whatever reason, did not use my actual timer app on the phone, and used Google Assistant. For whatever reason the timer was muted by default, so that's why I thought it didn't work at the last time I used it.
I believe that coincided with the Sonos debacle.
IMHO, Google Now > Google Assistant
Agreed - bring back the golden age where the Google Now app existed and could actually do useful things
This. AI Hype beasts keep saying "This is the worst AI will ever be" and "It'll just get better" but really it's just going to get worse as they actually try to turn the bubble into a profit
Wouldn't they have to become smart first?
I was about to say, a selfhosted LLM means I'm not competing with every market analysis tool, customer service replacement, and 10 y/o kid bombarding the service with junk. It doesn't need to be ultra fast if I'm the only one using the hardware.
and who’ll supply the model and training and updates and data curation, dom? is it as manna from heaven? do you merely step upon the path and receive the divine wisdom of fresh llm updates?
fucking hell
Honestly, the data used to create these models was ripped from the public and I think that they are owed back to the public. OpenAI started as a non profit, and I think it should stay that way.
The FOSS model works well enough for other projects and I think that corporate AI will be exactly the same as the industrial revolution, progress at the cost of humanity. This isn't a problem to solve, it's a solution looking for problems.
Base open source model.
Topic expert models.
Community lora.
Program extensions.
Look what comfy UI + Stable Diffusion can achieve.
Base open source model just means some company commanding a great deal of capital and compute made the weights public to fuck with LLMaaS providers it can't directly compete with yet, it's not some guy in a garage training and RLFH them for months on end just to hand the result over to you to fine tune for writing caiaphas cain fanfiction.
And with the pruned llama models, it runs really quickly on a 2070.
Once they are cut off self hosted focus will explode and will see huge improvements in terms of ability and ease of use.
your Tech Friend is giving you bad advice, stop listening to them
What advice?
oh, I guess then you must be the Tech Friend
either way you probably want to stfu
That they will not fight self hosted methods tooth and nail
Until their legislated into illegality.
Is it gonna be "to protect the children", "to stop criminals", or "to save the environment"? Place your bets!
"We're not running AI on these servers, officer! Just good old-fashioned crypto hashes."