this post was submitted on 30 Sep 2023
1068 points (98.7% liked)
Open Source
31359 readers
210 users here now
All about open source! Feel free to ask questions, and share news, and interesting stuff!
Useful Links
- Open Source Initiative
- Free Software Foundation
- Electronic Frontier Foundation
- Software Freedom Conservancy
- It's FOSS
- Android FOSS Apps Megathread
Rules
- Posts must be relevant to the open source ideology
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
Community icon from opensource.org, but we are not affiliated with them.
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I feel the issue with AI models isn’t their source not being open but the actual derived model itself not being transparent and auditable. The sheer number of ML experts who cannot explain how their model produces a given result is the biggest concern and requires a completely different approach to model architecture and visualisation to solve.
Unfortunately, the nature of the models is that it's very difficult to get an understanding of the innards. That's part of the point, you don't need too. The best we can do is monitor how it's built and what connects in and out of it.
The open source bits let you see that it's not passing data on without your permission. If the training data is also open source, you can get for biases e.g. 90% of faces being white males.
No amount of ML expertise will let someone know how a model produced a result, exactly. Training the model from the data requires a lot of very delicate math being done uncountable times to get a model that results in something useful, and it simply isn't possible to comprehend how the work inside is done in a meaningful way other than by doing guesswork.
We already know how these models fundamentally work. Why exactly does it matter how a model produced some result? /gen