this post was submitted on 02 Nov 2023
46 points (89.7% liked)

LocalLLaMA

2237 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
 

I don't get why a group of users that are willing to run their own LLMs locally and do not want to relay on centralized corporations like openAI or google prefer to discuss using a centralized site like Reddit

top 17 comments
sorted by: hot top controversial new old
[–] kakes@sh.itjust.works 30 points 1 year ago (1 children)

Maybe they don't know about Lemmy, or maybe they want to run LLMs locally for reasons other than idealism?

[–] SamXavia@kbin.run 17 points 1 year ago (3 children)

@acec I think it's a mix of reasons why really;

  1. They've been using it for years
  2. A lot of there favourite subs are on there and they are admins of those subs giving them power
  3. A good amount of them don't know about the Fediverse and that they could run a similar sub on the Fediverse
  4. Change, a good amount of Redditors are most likely Autistic and don't want things to change.
[–] Serinus@lemmy.world 5 points 1 year ago (1 children)

Niche subs on Reddit are more active, making them more useful in a simple Catch 22.

Basically the way all shitty social media retains market share, the users go where the users are.

[–] SamXavia@kbin.run 2 points 1 year ago

@Serinus It's why I hope that smaller Niche subs do move away as they won't get as much views.

[–] drkt@feddit.dk 3 points 1 year ago* (last edited 1 year ago)

Change, a good amount of Redditors are most likely Autistic and don’t want things to change.

Resistance to change is not an autistic thing in this context; people just don't want to fiddle with things that work.

[–] EatYouWell@lemmy.world -1 points 1 year ago

Not just redditors, but people in the tech sector.

[–] rufus@discuss.tchncs.de 10 points 1 year ago

We only got about 40000 active users here on Lemmy. Guess most people like to see dozens of posts per day even in a niche community. I like it here. But I guess it's going to be difficult to attract users from /r/LocalLLaMA And as far as I know we haven't advertised there yet. I'm still not sure if we should...

[–] Cheers@sh.itjust.works 6 points 1 year ago

Personally speaking, the issue isn't I don't want to rely on them, it's that I can't use them for my use case because it'd be a HIPPA violation.

The alternative is a run a local/cloud version that I control. Discussing the set up process can be done on reddit without endangering patients.

[–] wandermind@sopuli.xyz 6 points 1 year ago* (last edited 1 year ago) (1 children)

Because it's not ideological, they just want to generate porn, which is against OpenAI TOS.

[–] rufus@discuss.tchncs.de 3 points 1 year ago* (last edited 1 year ago)

To be fair, I saw /r/LocalLLaMA referenced in a scientific paper ("bloc97" in the paper about Streaming-LLM) talking about NTK-aware RoPE scaling. Which is kind of an awesome achievement.

And to me it's fascinating that Reddit is generally friendly towards porn. I think they have started to restrict adult content with their API change but so far there are lots of corners where you can even post pictures of your member. And that's not really possible on many of the other big commercial online platforms. I wonder where they're headed in the long term.

[–] mixtral@sh.itjust.works 1 points 10 months ago

For me, I found only one group about LLM here in search. You can make Lemmy better if share another groups for similar topics since search feature doesn't work well yet.

[–] cro_magnon_gilf@sopuli.xyz -1 points 1 year ago (1 children)

Because reddit is a comfy echo chamber where people are banned for opposing the ruling dogmas in the subs. People love that

[–] corrupts_absolutely@sh.itjust.works 4 points 1 year ago (1 children)

as opposed to any other form of communication where non-conformance is sought out

[–] cro_magnon_gilf@sopuli.xyz 1 points 1 year ago (1 children)

Not sure what you're saying

[–] Maalus@lemmy.world 2 points 1 year ago

That everywhere gets you banned for doing exactly what you said. Hell, lemmy is full of powertripping moderators. There is a log full of bullshit one word explanations for banning people.