this post was submitted on 01 Mar 2024
59 points (94.0% liked)

World News

32491 readers
653 users here now

News from around the world!

Rules:

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 1 points 9 months ago (1 children)

More efficient chips do not have emergent behaviours (outside of, say, mobile and autonomous vehicles). More efficient chips make things more economical. Total compute capability is a function of manufacturing capability (which reflects in capital cost), electricity (which reflects in operating cost), and efficiency (which also reflects in operating cost). If your manufacturing capability is obscene and your electricity output is obscene, then you can handwave a lot of efficiency concerns by just scaling the number of chips you have in a system. In terms of aggregate computing capability, 5nm is more than sufficient to keep pace given enough scale.

There's an interesting figure that I saw a while ago: China's % of electricity generation dedicated to data centers is lower than both the US and EU, and due to top line electricity generation growth this proportion is basically not expected to move in the next decade. China has a LOT of freedom to tank efficiency losses that other regions simply do not.

There's a small condition here that scaling usually has some degree of losses, but for LLM training it's basically non-existent and for supercomputing it's supposed to be around 10% losses due to networking/etc.

[โ€“] [email protected] 0 points 9 months ago

That is interesting, do you recall where you saw that data about electricity generation growth in different countries?