this post was submitted on 31 Jul 2023
9 points (90.9% liked)

LocalLLaMA

2249 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
9
What are the best models you use? (self.localllama)
submitted 1 year ago* (last edited 1 year ago) by cll7793 to c/[email protected]
7 comments fedilink hide all child comments
 

Leaderboard scores often can be a bit misleading since there are other factors to consider.

  • Censorship: Is the model censored?
  • Verbosity: How concise is the output?
  • Intelligence: Does the model know what it is talking about?
  • Hallucination: How much does the model makes up facts?
  • Domain Knowledge: What specialization a model has.
  • Size: Best models for 70b, 30b, 7b respectively.

And much more! What models do you use and would recommend to everyone?

The model that has caught my attention the most personally is the original 65b Llama. It seems genuine and truly has a personality. Everyone should chat with the original non-fine tuned version if they can get a chance. It's an experience that is quite unique within the sea of "As an AI language model" openai tunes.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 1 year ago

I've been very partial lately to anything ORCA tuned, i'm not sure if it's placebo but it always feels like they're just that much smarter and have a bit more ability to think things through

for instance, I have a character in oobabooga, and in its description/pre-prompt I told it to ask questions about what it doesn't know with "It only answers questions it knows the answer to, choosing to ask for additional context when information is unclear." and anything that's tuned on orca is 10x more likely to actually consider what it doesn't know and ask for context rather than hallucinating information

lately I've been playing with Dolphin which is llama 1 based, and it's an absolute pleasure https://huggingface.co/ehartford/dolphin-llama-13b