Not wholly surprising, and will be interesting to see what is developed to deal with this collpase.
this post was submitted on 14 Jun 2023
2 points (75.0% liked)
Machine Learning
1772 readers
11 users here now
founded 4 years ago
MODERATORS
I wonder whether there even is something to deal with this collapse. It just seems to me that data generated by the model itself will never have any new cases to learn from. I think it will just keep reinforcing the current knowledge already in the model. This is not always a bad thing, we have been doing that(the reinforcing) for so long now under "epochs". But even with epochs you end up overfitting after a while