this post was submitted on 21 Dec 2024
285 points (98.6% liked)

Technology

60212 readers
2052 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
top 18 comments
sorted by: hot top controversial new old
[–] spankmonkey 94 points 1 week ago (1 children)

Wow, so much energy spent to get worse search results compared to 10 years ago.

[–] [email protected] 27 points 1 week ago

But the data mining is off the charts Bob! More AI! More server things! We must be ready for our robot overlords!

[–] cogman 39 points 1 week ago (1 children)

And I'll bet roughly 50->90% of that usage is idiots doing crypto/ai garbage.

[–] [email protected] 6 points 1 week ago (2 children)

No lol the amount of power that cloud services use is atrocious. The serverless trend makes things add up. It's cheaper in terms of hardware but oh boy do all those layers of abstraction make things heavy, especially loading of the applet, communication to other applets. (I'm forgetting if applets is the correct name).

I actually don't belive the ~5% figure at all—especially with the track record of honesty (or the lack of it) these companies have.

Sure, datacenters are rather efficent, but times 330 million people in the US adds up.

[–] cogman 23 points 1 week ago* (last edited 1 week ago)

The amount of power AI and Crypto require is orders of magnitude the amount of power required by pretty much any regular application. The company I work at uses somewhere around 2000 CPU cores worth of compute at AWS (and we have ~100 microservices. We are a fairly complex org that way).

Generally speaking, an 80CPU core system takes up ~200W worth of power. That means my companies entire fleet operating eats about 5kW of power when running full bore (it isn't doing that all the time). My company is not a small company.

Compare that to what a single nvidia A100 eats up. Those GPUs take up to 400W of power. When doing AI/crypto stuff you are running them as hard as possible (meaning you are eating the full 400W). That means just 12 AI or crypto apps will eat all the same amount of power that my company with 100 different applications eats while running full bore. Now imagine that with the model training of someone like chatgpt which can eat pretty much as many GPUs as you can throw at it.

To put all of this in perspective. 5kW is roughly what a minisplit system will consume.

Frankly, I'm way more concerned about my companies travel budget in terms of CO2 emissions than I am our datacenter usage.

[–] [email protected] 7 points 1 week ago

I would bet that hardware being way more efficient and corporate IT infrastructure being consolidated in data centers is much more energy efficient than the alternative. The fact that we are running much more layered and compute-intensive systems doesn't really change that.

[–] [email protected] 15 points 1 week ago (1 children)

Good thing US taxpayer will finally pay for the grid upgrades that are much needed after decades of malinvestment by the capitans of the industry.

We will pay higher rates to becuase industry deserves lower rates 🤡

[–] [email protected] 18 points 1 week ago (1 children)

That's a small price to pay for having no healthcare and a shorter lifespan than those in poorer Western countries.

[–] [email protected] 5 points 1 week ago

I want my daddy owner to live his best live and an adequate social policy for peasamts is the sacrifice he is willing to make. I respect my daddy

[–] [email protected] 7 points 1 week ago

I hope we have another carrington event. That'll fix it.

[–] [email protected] 4 points 1 week ago (3 children)

I have a solution: spin up a dozen nuclear power plants to fuel AI to solve the problem. If there's not enough nuclear, just burn coal.

[–] Coreidan 3 points 1 week ago

The factory must grow

[–] [email protected] 2 points 1 week ago (1 children)

This but essentially just build SMRs or microreactors into colo plans.

Maybe not so great for the ones that are in the middle of cities, where space is at a premium...but a lot of colo's are in unassuming spaces in suburbs or BFE.

[–] [email protected] 1 points 1 week ago

Can you point me towards a commercial microreactor product? Apart from the Russian Federation ones, I mean.

[–] [email protected] 1 points 1 week ago (1 children)

Just spin up a dozen nuclear plants, huh? So who's going to build that, how long is the construction time and who is going to fund that, given that new nuclear is the most expensive power there is?

[–] [email protected] 1 points 1 week ago (1 children)

More questions for AI to answer.

[–] [email protected] 1 points 1 week ago (1 children)

A gen AI in charge of nuclear engineering and just put in charge of the world in general. What a wonderful idea! You people sure deserve what you'll get.

[–] [email protected] 2 points 1 week ago

What exactly will "we" get?

Also, go back and study my initial comment. You don't need to study it that hard. Just read it again.