All kinds. You should look at GPT4ALL at gpt4all.io. Its a gui for downloading and running LLM models locally. Its a great project. Of course, everything is local and private.
Privacy
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn't great, if contents of the website are behind a paywall maybe copy them into the post
- Don't promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
> privacy community
> "give me free LLM"
> gets free LLMs
> "I'm not concerned with privacy"
Then depart
Doesn't explain
Leaves
I've learned something from the other people here and I don't even want an LLM. There was even some degree of handholding here, despite you being in the privacy community but apparently not caring about privacy.
Registering an account is just a username, no password or email. (Generated API key is your password)
one would think someone that calls himself THE MASTERMIND would know all... also LM Studio and no i'm not going to give you a link, your browser can do that for you
How many times do you think i have heard that remark
not enough obv.
And your suggestion isn't even what i asked stupid .
They are expensive to run. Why would someone pay the cost and offer it for you to use for free? When it appears free it’s most likely not free.
The word privacy based in your post probably explains it.
There is Lelapa, llamafile, GPT-NeoX-20B, BLOOM, Mixtrai8x7B come to mind which are not included at gpt4all.io.
Nextcloud can do it
use ollama to run dolphin-mixtral locally on linux