this post was submitted on 13 Jun 2024
72 points (84.0% liked)

Open Source

31396 readers
190 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
all 18 comments
sorted by: hot top controversial new old
[–] MalReynolds@slrpnk.net 17 points 5 months ago (1 children)

OSS, local llm, SearXNG. I likey, is there a demo ? SearXNG via VPN has helped unshittifying my search, but GIGO still applies.

[–] vort3@lemmy.ml 2 points 5 months ago (2 children)

Dumb question, why do you need VPN to use SearxNG?

[–] MalReynolds@slrpnk.net 4 points 5 months ago

You don't, I like it coz it minimizes profiling for the component search engines, and gluetun is right there, just point SearxNG at the proxy. I still get reasonable localized results by chosing a nearby exit node.

[–] Evotech@lemmy.world 10 points 5 months ago (1 children)

Google using ai, everyone hates it

Some upstart uses ai search, everyone is like woooowowow???

[–] PM_ME_VINTAGE_30S@lemmy.sdf.org 14 points 5 months ago (1 children)

LLMs are not necessarily evil. This project seems to be free and open source, and it allows you to run everything locally. Obviously this doesn't solve everything (e.g., the environmental impact of training, systemic bias learned from datasets, usually the weights themselves are derived from questionably collected datasets), but it seems like it's worth keeping an eye on.

Google using ai, everyone hates it

Because Google has a long history of doing the worst shit imaginable with technology immediately. Google (and other corporations) must be viewed with extra suspicion compared to any other group or individual because they are known to be the worst and most likely people to abuse technology.

Literally if Google does literally anything, it sucks by default and it's going to take a lot more proof to convince me otherwise for a given Google product. Same goes for Meta, Apple, and any other corporations.

[–] Evotech@lemmy.world 6 points 5 months ago

The main complaints towards Google was LLM maturity, bias and other factors. The same things will be true for any LLM

[–] Jake_Farm@sopuli.xyz 6 points 5 months ago (1 children)

Better not tell perplexity about this.

[–] Beaver@lemmy.ca 2 points 5 months ago (1 children)
[–] peregus@lemmy.world 2 points 5 months ago

I haven't tried it, but having tried Perplexity, I can say that it's difficult to have something that's worse than it!

[–] governorkeagan@lemdro.id 5 points 5 months ago (2 children)
[–] Willem@kutsuya.dev 8 points 5 months ago

I've used it, it's pretty rough and unfinished, the current main branch doesn't build without help and you'll need ollama or openai keys.

The results however are impressive, even with a small model like phi3 mini through ollama. They got some good prompts behind it and the results name the sources + have some good followup questions.

[–] SuckMyWang@lemmy.world -3 points 5 months ago

I haven’t no

[–] therealjcdenton@lemmy.zip 1 points 5 months ago (1 children)

You mean chatgpt or real ai?

It can use ChatGPT I believe, or you could use a local GPT or several other LLM architectures.

GPTs are trained by "trying to fill in the next word", or more simply could be described as a "spicy autocomplete", whereas BERTs try to "fill in the blanks". So it might be worth looking into other LLM architectures if you're not in the market for an autocomplete.

Personally, I'm going to look into this. Also it would furnish a good excuse to learn about Docker and how SearXNG works.

[–] ceddy@lemmy.ml 1 points 5 months ago* (last edited 5 months ago)

Super nice!

[–] Kuvwert@lemm.ee 1 points 5 months ago

Seems broken, couldn't get the yarn to build. I'll try again another day