Selfhosted

40394 readers

608 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago

MODERATORS

Looking for beginner friendly free or cheaper solutions for a chatbot (self.selfhosted)

submitted 1 year ago by borzthewolf to c/selfhosted

15 comments fedilink hide all child comments

Hello all, you all seem to be well versed in this stuff and I can't seem to find many ai or chatbot communities at all. Anyway, I've just been using the free, outdated gpt3.5 on the openai site and it really opened my eyes to how useful of a tool it is. I mean it helps me with everything, especially computer related and troubleshooting... But of course it has its flaws. Its limited in capabilities, knowledge cutoff at 2021, assuming its highly restrictive and censored as well.

I would love a solution, probably gpt4, but I entered the hugging face rabbit hole and now I'm completely lost lmao. What are some good options for someone who wants basically same functions of the free chatgpt but up to date, smarter, and just better. I'm willing to put in some work to build something, if its not too tricky. I get lost easily at this technical level. Or an out of box option is preferred. I have no clue about models other than gpt4 and I guess that's what I'm looking for or something better for either free or a lower cost than openai's $20 a month. And preferably something more private and less restrictive for the nsfw and darker questions lol

I hope this ramble makes some sense at least. I just opened my eyes to this field and its pretty deep. As of now, newb friendly,user friendly for someone with some OK tech/computing knowledge. Thanks

you are viewing a single comment's thread
view the rest of the comments

[–] cal4 14 points 1 year ago (1 children)

GPT4ALL sounds like your best bet. It's one of the easiest to set up solutions at the moment. As best as I can tell none of the open and local options are gpt4 level yet. that's it, there are lots of models to play with and they seem to be getting better very quickly. GPT4ALL makes it pretty simple I specifically linking the models that work and helping you download them.

the one downside is that I don't believe they have implemented GPU models yet. that means things are easy to set up, but it's going to be a slow experience, especially if you don't have a really beefy CPU and lots of RAM.

[–] borzthewolf 2 points 1 year ago (1 children)

Ahh darn that probably won't work then, but I'll still give it a look. Thanks