Install Alpaca if you are on gnome on Linux
this post was submitted on 19 Jan 2025
43 points (86.4% liked)
Selfhosted
41202 readers
685 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 2 years ago
MODERATORS
Have it pretend to be Gandalf working in a coffee shop
Link it to openweb-ui makes things easier Then can knowledge it on say all the manuals in your house Or your home insurance policy or soemthing.
Link it to "speaches" and then you can make a voice chat.
Link it to continue.dev for coding
I think alot of the use case come from developing system prompts You can them make a "custom" model for specific tasks. I.e this model knows about my home insurance policy but writes back lile it's pirate with a stutter
Nothing useful but gets your toes wet.
Ollama is very useful but also rather barebones. I recommend installing Open-Webui to manage models and conversations. It will also be useful if you want to tweak more advanced settings like system prompts, seed, temperature and others.
You can install open-webui using docker or just pip, which is enough if you only care about serving yourself.
Edit: open-webui also renders markdown, which makes formatting and reading much more appealing and useful.
Edit2: you can also plug ollama into continue.dev, an extension to vscode which brings the LLM capabilities to your IDE.
Instruct it to be your dungeon master and do some roleplay.
I put on my robe and wizard hat.
Sure. I think that's a valid use case. Maybe use one of the community fine-tunes for that... 😆
Great job trying to learn! Ignore the naysayers here, as a fellow programmer like it or not, you're going to need to learn how to interact with it. That's the real way we'd lose our jobs, if you don't keep up with this stuff you're doomed to fall behind.
I recommend trying to first build a simple CLI API that you can work with and ask questions similar to chat gpt. This will give you a good foundation on the APIs and how it works. Then you can move up into function calling for things like HomeAssistant, and then maybe even later training loras. Start small, just getting basic stuff working first, and build from there.
Ask it to do stupid things. Like a to-do list I. Web assembly, or why does a triangle have 4 sides and keep saying it is wrong till it believes you.
Make a bot that viscously rips Into people based off their username lol
But for real, nice. I get by with kobold for my uses. How far do you think you'll take this?
Exactly