ChatGPT

8999 readers

1 users here now

Unofficial ChatGPT community to discuss anything ChatGPT

founded 2 years ago

MODERATORS

marcar

How to jailbreak ChatGPT: get it to really do what you want | Digital Trends (www.digitaltrends.com)

submitted 10 months ago by ooli to c/chatgpt

18 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] ooli 2 points 9 months ago (1 children)

Super useful! Thanks! I installed the oobabooga stugg. The http://localhost:7860/?__theme=dark open fine. But then nothing works. how do I train the model with that 8gb .kbin file I downloaded? There are so much option, and I dont even know what I'm doing

[–] cygon 4 points 9 months ago* (last edited 9 months ago)

There's a "models" directory inside the directory where you installed the webui. This is where the model files should go, but they also have supporting files (.yaml or .json) with important metadata about the model.

The easiest way to install a model is to let the webui download the model itself:

Screenshot of Oobaboga's WebUI with the model tab open and the model names from HuggingFace entered

And after it finishes downloading, just load it into memory by clicking the refresh button, selecting it, choosing llama.cpp and then load (perhaps tick the 'CPU' box, but llama.cpp can do mixed CPU/GPU inference, too, if I remember right).

Screen of the model page in Oobaboga's WebUI with the model ready to be loaded

My install is a few months old, I hope the UI hasn't changed to drastically in the meantime :)