this post was submitted on 02 Jun 2024
53 points (98.2% liked)
Free Open-Source Artificial Intelligence
2930 readers
2 users here now
Welcome to Free Open-Source Artificial Intelligence!
We are a community dedicated to forwarding the availability and access to:
Free Open Source Artificial Intelligence (F.O.S.A.I.)
More AI Communities
LLM Leaderboards
Developer Resources
GitHub Projects
FOSAI Time Capsule
- The Internet is Healing
- General Resources
- FOSAI Welcome Message
- FOSAI Crash Course
- FOSAI Nexus Resource Hub
- FOSAI LLM Guide
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Based on the post title alone, I call bull because I could buy enough storage and pirate enough books in order to create an AI, using copyrighted material as the training data. Yes it would be an absolutely horrible AI since I don't have a clue what I'd be doing, but it's possible.
Then go ahead and buy 2000 Nvidia cards.
The training data is important, but currently the bottleneck is computing power. Buying so many chips and having them run full blast 24/7 costs a lot of money.
You can get your hands on books3 or any other dataset that was exposed to the public at some point, but large companies have private human-filtered high-quality datasets that perform better. You're unlikely to have the resources to do the same.
It's not clear if this is piracy. In the US, it's obviously an ongoing fight. Basically, what you describe is "books3", put together with scripts by Aaron Swartz.
It's legal in Japan, if the purpose is only AI training and not enjoyment. I'm not sure if there are issues regarding DRM or such.
In the EU, the dataset and resulting model would be illegal. Any business offering the model would be in hot water, but I think internal use would be fine.