this post was submitted on 26 Sep 2023
11 points (78.9% liked)

Free Open-Source Artificial Intelligence

2900 readers
1 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] j4k3 2 points 1 year ago
  • Technical/general/code - Llama2 70B GGUF Q5k_M instruct

  • Learning - Llama2 70B GGUF Q5k_M chat

Chat/Roleplay

  • Pygmalion 2 (the trick to using it in Oobabooga [without code mods] is to add the special tokens to the chat character profile sections. I can't type the tokens directly in Lemmy because the way Lemmy is coded, but you should be able to figure this out. The readme for the model has the special token syntax. Put the user and character (model) tokens in front of the names in the top boxes, then start the context with the system token. Don't use the user or model tokens in the context, use the names instead. This isn't perfect, like you can't also use Silero TTS with this method, but it will work.)
  • GPT4chan sourcing instructions and links are in the main Oobabooga readme.