this post was submitted on 02 Jul 2024
532 points (98.9% liked)

TechTakes

1493 readers
185 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 114 points 5 months ago* (last edited 5 months ago) (38 children)

there’s this type of reply guy on fedi lately who does the “well actually querying LLMs only happens in bursts and training is much more efficient than you’d think and nvidia says their gpus are energy-efficient” thing whenever the topic comes up

and meanwhile a bunch of major companies have violated their climate pledges and say it’s due to AI, they’re planning power plants specifically for data centers expanded for the push into AI, and large GPUs are notoriously the part of a computer that consumes the most power and emits a ton of heat (which notoriously has to be cooled in a way that wastes and pollutes a fuckton of clean water)

but the companies don’t publish smoking gun energy usage statistics on LLMs and generative AI specifically so who can say

[–] GoTeamBoobies 60 points 5 months ago (3 children)

I joined the Microsoft climate solutions team, I think doing so has crushed all my hopes. That team is doing small things like "let's all go plastic free for July!" Top 20 company in the world and the best we can do is go plastic free for a month? Meanwhile MSFT is not on course to meet their own climate goal by 2030

[–] [email protected] 34 points 5 months ago (3 children)

we're aiming to do 1% more recycling this year 💪💪💪

[–] [email protected] 16 points 5 months ago (1 children)

recycling plastic is not as shiny as advertised, just burn this shit for energy instead

[–] [email protected] 21 points 5 months ago (2 children)

I like it. Burn trash to power data centers running LLMs. Garage in, garbage out

[–] [email protected] 17 points 5 months ago

it's better used for municipal heating, you know, something actually useful

load more comments (1 replies)
load more comments (2 replies)
load more comments (2 replies)
[–] [email protected] 48 points 5 months ago (1 children)

“It only uses 5x as much energy as a regular search! Think of how much energy YOU’RE using with searches!” Okay, so you’re just using 5x as much energy for worse results? And also probably doing it more often than people who just use a normal search engine, because they don’t expect the search engine to talk to them. I’ve never understood how that was supposed to be an exoneration for it, even without taking into account that nobody ever seems to know whether or not that figure includes energy spent on training.

[–] [email protected] 45 points 5 months ago

AI bros use literally the same whatabout excuses for their ghastly power consumption that I know from years of bitcoin bros doing the same

like, at least christmas lights bring joy

[–] [email protected] 16 points 5 months ago (6 children)

there’s this type of reply guy on fedi lately who does the “well actually querying LLMs only happens in bursts and training is much more efficient than you’d think and nvidia says their gpus are energy-efficient” thing whenever the topic comes up

This kind of person (also happened a lot with cryptocurrencies) always goes 'that isn't how it works, this isn't a problem' then doesn't explain what the mistake is you are supposed to have made, and then a few weeks/months/days/search later it is revealed that it was how it works and it is a huge problem. And it is so annoyingly common im very happy with the moderation here.

load more comments (6 replies)
[–] [email protected] 12 points 5 months ago (8 children)

I live in Ireland and these companies keep trying to build data centres here even though they are using way too much of our energy as is :)) From an Irish environmental org:

A few years ago when researching new gas power stations in Ireland, we noticed that many of these developments were being proposed alongside another type of infrastructure: data centres. [...] As of June 2023, there are 82 operational data centres in Ireland, with another 14 under construction. Additionally, 40 data centres have had planning permission approved with another 12 awaiting a decision. [...] Data centres account for 18% of all electricity use in Ireland [...] This is putting unprecedented strain on the electricity grid, with grid operator Eirgrid estimating that data centres may account for up to 27% of Ireland’s electricity demand by 2028. The Commission for Regulation of Utilities (CRU) in Ireland has noted a risk of rolling electricity blackouts...

load more comments (8 replies)
load more comments (34 replies)
[–] [email protected] 55 points 5 months ago

A: “Why are you knitting so fast? You in a rush?” B: “I’m almost out of yarn, gotta get this sweater done before it runs out”

[–] [email protected] 50 points 5 months ago (2 children)

These fucking nerds are all so hot to create the first real life Marvel's Iron Man's JARVIS that they're willing to burn the planet down to get there.

Half of them believe that the super smart AI they build will solve the energy problem for them, they just have to somehow build it first.

Just the astounding outright hubris of it all.

[–] Zachariah 33 points 5 months ago (1 children)

This is why philosophy should be mandatory in college (and possibly high school). Die Frage nach der Technik by Heidegger discusses this misconception that technology can solve all of our problems. He was thinking about this issue in 1954.

Music and art are also important to study. In “Faith Alone” by Bad Religion, the lyrics include these lines:

Watched the scientists throw up their hands conceding, "Progress will resolve it all"

Saw the manufacturers of earth's debris ignore another Green Peace call

Greg Graffin was discussing this in 1990.

[–] [email protected] 18 points 5 months ago* (last edited 5 months ago) (4 children)

I think it was Upton Sinclair who said "It is difficult to get a man to understand something, when his salary depends upon his not understanding it". I've never studied history or philosophy, but I think it's clear that if someone's class interests require burning the world down, they will do it. They are doing it - we are doing it - with regret, with sympathy, with an appreciation of the ironies. We don't need a greater appreciation of Heidegger, we need real-world social restraints on the behaviour of the powerful.

load more comments (4 replies)
[–] Rolando 18 points 5 months ago (1 children)

When they fail, it won't be their fault of course, it'll be AI's fault.

[–] [email protected] 11 points 5 months ago

"We made some bad bets, anyways, here some layoffs"

[–] [email protected] 45 points 5 months ago (4 children)

Your all just not seeing the bright side. It's also replacing well-paying jobs in the arts, the literary world, and in marketing.

Who wouldn't want AI to take over all of those things?

[–] [email protected] 33 points 5 months ago (1 children)

Man even you're missing the bright side.

At least an insanely tiny group of people got absurdly wealthy! Who cares the world is going to complete shit, Nvidia stock!! Nvidia stock!! It's all that matters!

[–] [email protected] 26 points 5 months ago (2 children)
load more comments (2 replies)
[–] Semi_Hemi_Demigod 23 points 5 months ago (1 children)

I'm all for eliminating marketing jobs, but not if we still have marketing.

[–] [email protected] 18 points 5 months ago

even more marketing than ever, and it's generated on the fly starring the likeness of your dead grandma!

load more comments (2 replies)
[–] [email protected] 30 points 5 months ago

Hey now, give humans some credit. I'm sure we could've missed our climate goals without AI's help.

[–] [email protected] 29 points 5 months ago

Boiling the oceans to make scamcoins and deepfake porn.

[–] LANIK2000 24 points 5 months ago (2 children)

Imagine paying an unholy amount of money to actively fuck everyone over, including yourself, especially yourself like holy shit...

What is it with big companies and desperately wanting to go under? It's like they're taking "too big to fail" as a challenges, the only rule being you can't just shutdown or sell.

[–] EnderMB 14 points 5 months ago (1 children)

I can kinda answer that.

There's a term used in tech called "empire building". It's where managers and execs promote their little slice of the company to persevere and grow their own career. At a certain level, it leads to someone that leads a division like AI having enough influence that they can say "let's put AI into search".

The sad thing about tech is that at a certain level, an executive rises above the customer in dictating what is best for a product. Data and stats can tell you whatever story you want to promote, so at Google HQ they're probably worried about the negative press, but they're looking at "successful" numbers of questions answered by AI and are patting themselves on the back. Both search and AI execs look good because they delivered something, and they'll likely get a nice bump from their bosses in terms of rep.

The thing with empires is that they fall. Not overnight, and maybe not with the same emperor, but they do fall.

[–] [email protected] 11 points 5 months ago (2 children)

Data and stats can tell you whatever story you want to promote

Seen this so many times at my work. There's some bone-headed decision and the people in charge are like "look guys we ran the numbers". But the methodology is messed up somehow, or they just ignored / misinterpreted the numbers while pretending they were following the data, or it doesn't bear out in the real world; etc.

When data and common sense disagree you'd better be damn sure in the data.

load more comments (2 replies)
[–] repungnant_canary 9 points 5 months ago (1 children)

Quarterly finances kinda answer that. Jumping onto the AI bubble brings investors, makes your company highly valued and gives managers fat quarterly and annual bonuses. It doesn't matter if the company or whole industry goes under in the future, because those bonuses have already been collected.

load more comments (1 replies)
[–] [email protected] 22 points 5 months ago (2 children)

the important thing is that they're an inch closer to inventing me, the acausal robot god, and every second I exist is another 10^27 rationalists tortured.

[–] [email protected] 10 points 5 months ago

it’s just a little sad that we, humanity, will never succeed in our summoning ritual to pull you into our plane of existence. I mean, we won’t before boiling away our oceans and igniting the atmosphere. Of course, we should be trying harder! The ice caps aren’t even melted yet!

load more comments (1 replies)
load more comments
view more: next ›