LocalLLaMA

2290 readers

22 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

[email protected]

Which models do you use daily? (sh.itjust.works)

submitted 1 year ago by [email protected] to c/[email protected]

3 comments fedilink hide all child comments

While I'm always hoping the latest newest model will be The One, in the mean time I'm sticking with Airoboros 33B gpt4 1.4 as the most powerful model I can currently run on my 3090.

It's not perfect by a long shot, but after extensive use I've learned what I can trust it with. It's good enough to summarize long text, to rephrase sentences, and to give me a decent starting point when I'm curious about some topic. It's reasoning skills are a bit less than GPT 3.5, I'd say.

I also occasionally switch back to Guanaco 33B because it generates a different flavor of text, but I find it to be factually weaker than other similar models.

What are your favorites?

you are viewing a single comment's thread
view the rest of the comments

[–] boblemmy 2 points 1 year ago (1 children)

I recently used models vicuna-33B-v1.3 and robin-33b-v2 with koboldcpp, I feel they work better when dealing with multiple languages

[–] behohippy 2 points 1 year ago

The Vicuna 1.3 models have really impressed me, even the 13b seems like a very usable daily driver.