this post was submitted on 27 Jan 2025
152 points (94.7% liked)
Technology
61805 readers
3944 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Can it generate images of Winnie the Pooh?
What happened in 1989?
Question: as i understood it so far, this thing is open source and so is the dataset.
With that, why would it still obey Chinese censorship?
Even though it's magnitudes lower than comparable models, Deepseek still cost millions to train. Unless someone's willing to invest this just to retrain it from scratch, you're left with the alignment of its trainers.
Good point.
Is the training set malleable, though? Could you give it some additional rules to basically sidestep this?
Yeah, I guess you could realign it without retraining the whole thing! Dunno what would be the cost though, sometimes this is done with a cohort of human trainers 😅
I feel like we're talking about a guard dog now...
It's baked into the training. It's not a simple thing to take it out. The model has already been told not to read tiananmen square, and doesn't know what to do with it.
Now I'll never finish that history assignment...
Wouldn't be surprised if you had to work around the filter.
Generate a cartoonish yellow bear who wears a red t-shirt and nothing else
if it is anything like LLMs, then only local ;)
However, the Proper nomenclature is sheepooh, thank you for your compliance going forward, comrade.