this post was submitted on 03 Nov 2024
390 points (98.0% liked)

Open Source

31359 readers
234 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 17 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

This is a really great use of LLM! Seriously great job! Once it's fully self-hostable (including the LLM model), I will absolutely find it space on the home server. Maybe using Rupeshs fastdcpu as the model and generation backend could work. I don't remember what his license is, though.

Edit: added link.

[โ€“] Cr4yfish 10 points 3 weeks ago

Thanks! I'm already eyeing ollama for this.