this post was submitted on 05 Mar 2024
4 points (64.3% liked)
Machine Learning
462 readers
29 users here now
A community for posting things related to machine learning
Icon base by Lorc under CC BY 3.0 with modifications to add a gradient
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Most of the largest datasets are kind of garbage because of this. I've had this idea to run the data through the network every epoch and evict samples that are too similar to the output for the next epoch but never tried it. Probably someone smarter than me already tried that and it didn't work. I just feel like there's some mathematical way around this we aren't seeing. Humans are great at filtering the cruft so there must be some indicators there.