this post was submitted on 03 Nov 2024
390 points (98.0% liked)

Open Source

31359 readers
95 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] AliasAKA 14 points 3 weeks ago (3 children)

Is there any interest in getting local models to run using this? I’d rather not use Gemini, and then all the data can reside locally (and not require a login).

I’d be happy to work on this, though I’m a python developer not a typescript one.

[–] Cr4yfish 6 points 3 weeks ago (2 children)

Yeah, good idea. It's possible to do that with WebLLM & Langchain. Once Langchain is integrated, it's kinda similar to the Python Version so should be do-able I think.

[–] AliasAKA 2 points 3 weeks ago (1 children)

Ah interesting — again happy to help out if there’s anything I can contribute to. I can make a feature request on github if there’s interest.

[–] Cr4yfish 2 points 3 weeks ago

Please do :). I take any help I can get.