this post was submitted on 28 Jan 2025
1087 points (97.6% liked)
Microblog Memes
6325 readers
4628 users here now
A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.
Created as an evolution of White People Twitter and other tweet-capture subreddits.
Rules:
- Please put at least one word relevant to the post in the post title.
- Be nice.
- No advertising, brand promotion or guerilla marketing.
- Posters are encouraged to link to the toot or tweet etc in the description of posts.
Related communities:
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don't understand why everyone's freaking out about this.
Saying you can train an AI for "only" 8 million. It is a bit like saying that it's cheaper to have a bunch of university professors do something than to teach a student how to do it. Yeah and that is true, as long as you forget about the expense of training the professors in the first place.
It's a distilled model, so where are you getting the original data from if not for the other LLMs?
They implied it wasn't something that could be caught up to in order to get funding, now ppl that believed that finally get that they were bsing, thats what they are freaking out over, ppl caught up for way cheaper prices on a moden anyone can run open source
Right but my understanding is you still need Open AIs models in order to have something to distill from. So presumably you still need 500 trillion GPUs and 75% of the world's power generating capacity.
The message that OpenAI, Nvidia, and others which bet big on AI delivered was that no one else could run AI because only they had the resources to do that. They claimed to have a physical monopoly, and no one else would be able to compete. Enter Deepseek doing exactly what OpenAI and Nvidia said was impossible. Suddenly there is competition and that scared investors because their investments into AI are not guaranteed wins anymore. It doesn't matter that it's derivative, it's competition.
Yes I know but what I'm saying is they're just repackaging something that openAI did, but you still need openAI making advances if you want R1 to ever get any brighter.
They aren't training on large data sets themselves, they are training on the output of AIs that are trained on large data sets.
Oh I totally agree, I probably could have made my comment less argumentative. It's not truly revolutionary until someone can produce an AI training method that doesn't consume the energy of a small nation to get results in a reasonable amount of time. Which isn't even mentioning the fact that these large data sets already include everything and that's not enough. I'm glad that there's a competitive project even if I'm going to wait a while and let smarter people than me sus it out.
If you can make a fast, low power, cheap hardware AI, you can make terrifying tiny drone weapons that autonomously and networklessly seek out specific people by facial recognition or generally target groups of people based on appearance or presence of a token, like a flag on a shoulder patch, and kill them.
Unshackling AI from the data centre is incredibly powerful and dangerous.
The other LLMs also stole their data, so it's just a last laugh kinda thing
Dead internet theory (now a reality) has become the dead AI theory.
Tis true. I'm not a real person writing this but rather a dead AI