Technology

921 readers

5 users here now

A tech news sub for communists

founded 2 years ago

MODERATORS

muad_dibber@lemmygrad.ml

Open-source ChatGPT Alternative (jan.ai)

submitted 6 months ago by yogthos@lemmygrad.ml to c/technology@lemmygrad.ml

4 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] yogthos@lemmygrad.ml 4 points 6 months ago (1 children)

I've been using GPT4All locally, and that does work pretty well. It's worth noting that a lot of these will work with the same models. So, the difference is mostly in the UI ergonomics.

[–] Comprehensive49@lemmygrad.ml 4 points 6 months ago (1 children)

Good point. I've been dabbling with Khoj myself, which connects with Obsidian, the Markdown notemaking software I use. This lets the AI draw from my notes on the fly.

I'm waiting to build a PC with the RTX 5090 or something before diving deeper into local AI. The integrated GPU I'm using right now is just too slow.

[–] yogthos@lemmygrad.ml 1 points 6 months ago

That's a pretty neat use case. And yeah dedicated GPU is kind of a must for running locally.