Technology

998 readers

111 users here now

A tech news sub for communists

founded 2 years ago

MODERATORS

muad_dibber@lemmygrad.ml

LocalAI is the free, open source locally run drop-in replacement REST API for OpenAI (github.com)

submitted 1 month ago by yogthos@lemmygrad.ml to c/technology@lemmygrad.ml

15 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Kultronx@lemmygrad.ml 2 points 1 month ago (1 children)

what is the advantage of doing something like this? i am a layperson

[–] yogthos@lemmygrad.ml 6 points 1 month ago (1 children)

Privacy and ability to generate content you want. Using commercial services like OpenAI means your data is sent to their servers, so anything you query is known to the company, and their models are often restricted in terms of content they will allow you to generate. For example, Google's Gemini will refuse to deal with many political subjects.

[–] Kultronx@lemmygrad.ml 2 points 1 month ago (1 children)

is there a guide how to use this? i downloaded the zip file but i have no idea what to do with it

[–] yogthos@lemmygrad.ml 2 points 1 month ago (1 children)

Oh haha it's a bit tricky if you're not technical, the easiest way is to use docker, but that's a whole thing of itself. If you want just an app you can run, one of these is easier to get going with

[–] Kultronx@lemmygrad.ml 2 points 1 month ago

Thanks for the tips, I will check those out