this post was submitted on 02 Nov 2023
47 points (89.8% liked)

LocalLLaMA

2102 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
 

I don't get why a group of users that are willing to run their own LLMs locally and do not want to relay on centralized corporations like openAI or google prefer to discuss using a centralized site like Reddit

all 17 comments
sorted by: hot top controversial new old
[–] [email protected] 30 points 8 months ago (1 children)

Maybe they don't know about Lemmy, or maybe they want to run LLMs locally for reasons other than idealism?

[–] [email protected] 18 points 8 months ago (3 children)

@acec I think it's a mix of reasons why really;

  1. They've been using it for years
  2. A lot of there favourite subs are on there and they are admins of those subs giving them power
  3. A good amount of them don't know about the Fediverse and that they could run a similar sub on the Fediverse
  4. Change, a good amount of Redditors are most likely Autistic and don't want things to change.
[–] Serinus 7 points 8 months ago (1 children)

Niche subs on Reddit are more active, making them more useful in a simple Catch 22.

Basically the way all shitty social media retains market share, the users go where the users are.

[–] [email protected] 3 points 8 months ago

@Serinus It's why I hope that smaller Niche subs do move away as they won't get as much views.

[–] EatYouWell 0 points 8 months ago

Not just redditors, but people in the tech sector.

[–] [email protected] 10 points 8 months ago

We only got about 40000 active users here on Lemmy. Guess most people like to see dozens of posts per day even in a niche community. I like it here. But I guess it's going to be difficult to attract users from /r/LocalLLaMA And as far as I know we haven't advertised there yet. I'm still not sure if we should...

[–] [email protected] 6 points 8 months ago

Personally speaking, the issue isn't I don't want to rely on them, it's that I can't use them for my use case because it'd be a HIPPA violation.

The alternative is a run a local/cloud version that I control. Discussing the set up process can be done on reddit without endangering patients.

[–] [email protected] 6 points 8 months ago* (last edited 8 months ago) (1 children)

Because it's not ideological, they just want to generate porn, which is against OpenAI TOS.

[–] [email protected] 3 points 8 months ago* (last edited 8 months ago)

To be fair, I saw /r/LocalLLaMA referenced in a scientific paper ("bloc97" in the paper about Streaming-LLM) talking about NTK-aware RoPE scaling. Which is kind of an awesome achievement.

And to me it's fascinating that Reddit is generally friendly towards porn. I think they have started to restrict adult content with their API change but so far there are lots of corners where you can even post pictures of your member. And that's not really possible on many of the other big commercial online platforms. I wonder where they're headed in the long term.

[–] [email protected] 1 points 6 months ago

For me, I found only one group about LLM here in search. You can make Lemmy better if share another groups for similar topics since search feature doesn't work well yet.

[–] [email protected] -1 points 8 months ago (1 children)

Because reddit is a comfy echo chamber where people are banned for opposing the ruling dogmas in the subs. People love that