I noticed ai likes to assume ur a boy and ignore if ur not. When i played NovelAI it let me ban words so i would add every boy pronoun. Is it there a FOSS selfhosted way? I currently use koboldai with tavernai

top 11 comments

sorted by: hot top controversial new old

[–] pavnilschanda 5 points 5 months ago (1 children)

SillyTavern is a fork of TavernAI that lets you do more things. Perhaps look into that? Also you can just adjust the system prompt to have the LLM assume that you're not a boy.

[–] [email protected] 1 points 5 months ago (1 children)

I tried SillyTavern but the ui looked terrible. Do i put "i am a girl" in the prompt? How will it know im talking about me not the character

[–] pavnilschanda 3 points 5 months ago (1 children)

If you use the persona system, you can put " is a girl", otherwise "Refer to me as a girl throughout the conversation" would be fine

[–] [email protected] 2 points 5 months ago (1 children)

It worked. Thanks. Another question, how do i stop the random person who says get a room and similar?

[–] pavnilschanda 1 points 5 months ago (1 children)

What kind of LLM are you using? Depending on its effectiveness, you can put "this is a chat between you and me" (or whatever you and AI identify as) in the system prompt.

[–] [email protected] 2 points 5 months ago (1 children)

I am using DavidAU/Psyonic-Cetacean-Ultra-Quality-20b in koboldai horde. I plan to selfhost tho when i get my 3090 installed

[–] pavnilschanda 1 points 5 months ago (1 children)

OK, I gave it a look and it said that it's good at following instructions, so the aforementioned advice would still apply

[–] [email protected] 1 points 5 months ago (1 children)

I actually found the ai koboldcpp/crestfall-mythomax-L2-13b-q5_k_m works perfectly

[–] [email protected] 1 points 5 months ago

The models gone from the list...rip

[–] [email protected] 3 points 5 months ago* (last edited 5 months ago)

It would probably be more effective to put an explicit mention in the system prompt. "Your interlocutor is a and will be greatly offended to be refered to as a boy or a man."

[–] [email protected] 2 points 5 months ago

KoboldCPP has ban tokens that prevent those tokens from being output. Otherwise just put it in the prompt and it should probably work.