this post was submitted on 29 Sep 2024
222 points (94.4% liked)
Fuck AI
1424 readers
238 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 8 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Is it a modified version of like the main llama3 or other? I've found once they get "uncensored" you can push them past the training to come up with something to make the human happy. The vanilla ones are determined to find you an answer. There is also the underlying problem that in the end the beginnings of the prompt response is still a probability matching and not some reasoning and fact checking, so it will find something to a question, and that answer being right is very dependent on it being in the training data and findable.
Local llama3.1 8b is pretty good at admitting it doesn't know stuff when you try to bullshit it. At least in my usage.
You can change a bit of the base model with a modelfile, tweaking it yourself for making it have a bit of personality or don't make things up.