this post was submitted on 30 Aug 2024
76 points (93.2% liked)
Technology
59388 readers
3706 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Turns out analogies are not the actual thing they're analogizing, though. Synthetic data - when properly created and curated - has proven to be very useful and effective in training AI.
Except when it's not, or else this article would have no point.
ETA: also, it seems like a terrible idea to train science models on data you essentially invented. The reason science works is because it follows the extant evidence, not the other way around.
It's not doing scientific discovery though it's doing analysis of known facts. You're just trying to get the AI to ingest that knowledge and to crystallize it.
Think about doing flashcards when revising for an exam, it's the same process really, the same information presented in a different way, in the hope that one of those ways, sticks.
You need to give the AI new data for it to learn anything new (which isn't surprising when you think about it), but for it to just get better at internalizing existing knowledge synthetic data works quite well, and since AI start off knowing nothing most of what you want them to learn is in fact already established knowledge.