this post was submitted on 19 Jul 2024
118 points (80.1% liked)
Privacy
32173 readers
606 users here now
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn't great, if contents of the website are behind a paywall maybe copy them into the post
- Don't promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Yeah, and if that's the case, it seems like people just hate AI for the sake of it now.
LLM's are actually good at some things. Just not everything.
Just look at the most recent ecological reports about it and combine them with the AI industry growth plans. You'll get an interesting perspective.
A lot of work has been going into making AIs more energy efficient, both in training and in inference stages. Electricity costs money, so obviously everyone's interested in more efficient AIs. That makes them more profitable.
Still you can't improve it that much. It's like blockchain. Computers always consume a lot of power, no matter how efficient they are.
Funny you should mention blockchains. Ethereum, the second-largest blockchain after Bitcoin, switched from proof-of-work to a proof-of-stake validation system two and a half years ago. That cut its energy use by 99.95%. The "blockchains are inherently a huge waste of energy" narrative is just firmly lodged in the popular view of them now, though, despite it being long proven false.
But that's really good! And also means that cloud based AI is even worse than blockchain in terms of environmental impact.
It means that even if AI is having more environmental impact right now, there's no reason to say "you can't improve it that much." Maybe you can improve it. As I said previously, a lot of research is being done on exactly that - methods to train and run AIs much more cheaply than it has so far. I see developments along those lines being discussed all the time in AI forums such as /r/localllama.
Much like with blockchains, though, it's really popular to hate AI and "they waste enormous amounts of electricity" is an easy way to justify that. So news of such developments doesn't spread easily.
You can improve it hugely. These things are very young.
There was a paper recently about removing the need for matrix multiplication from them which is a hugely expensive operation.
Dedicated hardware is also at a very early stage.
They're really good at burning hug amounts of electricity.