this post was submitted on 10 Aug 2023
30 points (91.7% liked)
ChatGPT
8905 readers
1 users here now
Unofficial ChatGPT community to discuss anything ChatGPT
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Localllama is a small community now but there is a Reddit one too
Llama is metas ai model that is open sourced the community took it and it keeps improving.
Look at or oobabooga which is a gui to run the models
You need a gaming computer in terms of specs or an m1 apple chip
There are also services that can run it for you on the cloud but privacy isn’t as strong as a completely offline setup.
I use it to run scenarios when it goes off rails that chatgpt doesn’t want to continue out to get some ideas. It’s not as good but it has its own fun factor.