this post was submitted on 24 May 2024
718 points (99.3% liked)
196
16620 readers
2706 users here now
Be sure to follow the rule before you head out.
Rule: You must post before you leave.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Nah man, they don't freeze the model because they think we will ruin it with our racism hahaha, that's just their PR bullshit. They freeze them because they don't know how to make the thing learn in real time like a human. We only know how to use backpropagatuon to train them. And this is expected, we haven't solved the hard problem of the mind no matter what these companies say.
Don't get me wrong, backpropagation is an amazing algorithm and the results for autocomplete are honestly better than I expected (though remeber that a lot of this is just underpaid workers in africa that pick good training data). But our current understanding of how human learns points to neuroplasticity as the main mechanism. And then here come all these AI grifters/companies saying that somehow backpropagation produces the same results. And I haven't seen a single decent argument for this.