LocalLLaMA

2328 readers

35 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

submitted 11 months ago by [email protected] to c/[email protected]

8 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] fhein 1 points 9 months ago

GGUF q2_K works quite well IMO, I've run it with 12GB vram + 32GB ram