LocalLLaMA

2218 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

[email protected]

How do I get LLaMA going on a GPU? (sh.itjust.works)

submitted 1 year ago by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

Everyone is so thrilled with llama.cpp, but I want to do GPU accelerated text generation and interactive writing. What's the state of the art here? Will KoboldAI now download LLaMA for me?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 1 year ago

there's a bit more setup involved but I would look into https://github.com/oobabooga/text-generation-webui

permalink
fedilink
source