LocalLLaMA

2326 readers

2 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

[email protected]

Any suggestions for this community? (sh.itjust.works)

submitted 1 year ago by [email protected] to c/[email protected]

16 comments fedilink hide all child comments

Just wondering if anyone has any suggestions to keep things moving and growing, was thinking of doing a daily quantized models post just for keeping up with the bloke, thoughts?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 5 points 1 year ago* (last edited 1 year ago) (1 children)

Please don't make this a place that is just spammed by automatic re-posts of something inconsequential. If i want to know what TheBloke recently published, I can simply go to huggingface and have a look myself. That way i can even filter by ggml/gptq llama1 or 2 and if I'm even interested at all.

That said, if you found a (new) model you like and you have any additional information or your story to offer... Please go ahead. That's someting i very much like to read.

I personally like to read / discuss:

Groundbreaking AI news
Questions from intermediate/pro users (not things you can simply look up in the README file)
Personal experience / lessons learned by other people
Other people's use cases for the Llama. Your perspectives on LLMs.
Prompt engineering (especially that. 95% of information on the internet is about ChatGPT. We need info for Llama)
Current issues / technical problems and brand new features of frequently used software like Oobabooga's or SillyTavern / whatever
free software projects that do different things than the usual roleplaying chatbot
Tools and software i don't know yet.
Developer talk: Experience with frameworks like langchain / ms guidance / LMQL
Language Processing (NLP) tasks like sentiment analysis, extraction of whatever to make information usable for a 'normal' computer program, summarization, translation, document analysis and things like that, done with free and open tools
Role play / text adventures / fantasy and/or ERP
Storytelling tips and tricks
AI in game development
Philosophical questions, politics, the future of/with AI, the singularity and/or your personal opinion about the upcoming robot apocalypse
Benchmarks / word of mouth about which models excel at which tasks

Maybe guides / tutorials / a wiki or megathread with useful information.

For me, Lemmy is kind of a mix between several things. I like the link-aggregator aspect and like to read news, have blog posts recommended to me. And I (even more) like the forum aspect. Discussing/debating things in the comments and have a community to talk about nerdy stuff. The second thing is why I'm here.

And of course related to LocalLLaMA. As i understand we're mainly discussing DIY things here, not just what OpenAI offers.

[–] [email protected] 3 points 1 year ago (1 children)

I don't think there's harm in a sticky that contains the latest model releases, I agree that it shouldn't devolve into spamming automated posts, maybe weekly is more appropriate or every X days

I agree overall with your list, the question is just about how do we foster that, and I'm wondering if discussion threads will be a good middle ground until we have a reasonable flow of new posts

Either way I want to keep an eye on it and find a way to help the community grow organically

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

maybe weekly is more appropriate

Well, a summary of recent news / developments is always useful. What about something like aicg on 4chan or just a few lines like ggerganov does with the "Hot topics" on llama.cpp's github page? Of course there's also hundreds of other wikis and maintained pages on rentry.org I'll let someone else suggest a useful format for that.

find a way to help the community grow organically

I don't know how this community came into existence. I believe we're currently mostly expats from r/LocalLlama?? I don't know if people over there know there is this alternative community? Also there is [email protected] which might have substantial overlap with us.

Edit: I hope i don't sound too negative here. I think you/we should just try a few things and see what's good for this community. Maybe have a semi-regular feedback poll or a stickied (monthly) post so people can complain. At this point I'm not sure what's best. If it's too many automated news posts with zero interaction, i can also complain after the fact.

And I appreciate what you're doing here.

[–] [email protected] 2 points 1 year ago

Yeah no for sure didn't sound too negative, your concerns are definitely valid

As for whether people on Reddit know about this one, it's likely several don't cut also not sure how well the mods there would take to advertising an alternative, probably best bet is to have some high value posts here that get posted on Reddit for awareness and maybe some people will feel like joining :D