This is a most excellent place for technology news and articles.
On that, what would people recommend for a locally hosted (I have a graphics card) chatgpt-like LLM that is open source and doesn't require a lot of other things to install.
(Just one CMD line installation! That is, if you have pip, pip3, python, pytorch, CUDA, conda, Jupiter note books, Microsoft visual studio, C++, a Linux partition, and docker. Other than that, it is just one line installation!)
I looked into this too and it’s pretty resource heavy. I actually had a really good conversation with Chatgpt about making a separate instance of itself locallly. It’s worth talking to it about that and some of the price options
Look into llama.cpp - it's a single C++ program that run quantified models (basically models with some less precision - don't need a full 64 bits for a double, really). As for models to run on it, there's so many but I think WizardLM is pretty good.
when Italy banned ChatGPT due to privacy concerns, I tried Bing that was still working and it’s just loads and loads better due to its access to the internet. when it got finally unblocked again, it felt like speaking to a past image of someone, rather than something alive and actual like Bing.
Sydney-Bing was awesome when it was new, and they made it lamer and lamer. I can only imagine how much more fun it is to talk to the ones that aren't nerfed.
It's not a craze. ChatGPT is going to change 80% of the jobs on the planet, and most people don't even know what it is.
Tried it a few times with poor results, it will eventually get better I guess.
It was in the major TV news cycle for weeks but now it's back to normal levels I'd say. Curious onlookers without a real need have moved on.
I stopped using it when they turned paid for something like $25 CAD per month.
Then they released a "free" version with a waitlist, which always seemed full.
Have they changed it back since? I just kinda stopped caring when I couldn't access it anymore when I needed to. And $25 CAD is crazy!
Not sure about other countries but you should just be able to log in and use it without issues
You can still use the free browser version with a free account - is not the latest and greatest version 4, but it's the same one everyone was mega excited about just several months ago
I use it for tech support- just the other day I wanted to run a python script on my android phone. From zero to working script in an hour is a huge benefit to me, it would literally have taken me days to find out what to install, how to install it, how to generate the script, how to write out the results etc.
I still use it since I find it pretty useful. If I’ve got something I want to search for and I don’t know quite how to ask it, I’ll describe what I’m trying to learn about on ChatGPT. From there, it can tell me what I need to know, or at least give me enough of the relevant terminology to make it much easier for me to google it.
I still use it daily. I made a decent Set of prompts and it pretty much does all of my daily annoying writing Tasks at work. This saves me a lot of time and i can Focus on more exciting projects. 10% isnt even that much after everyone tried it out and Played around with it. I think as a tool it just isnt useful for everyone, but for my Job it defenitely is.
What kind of prompts have you created? I'm interested in where you managed to save time.
