Futurology

1801 readers

118 users here now

founded 1 year ago

MODERATORS

111

AI PCs flood the market. Their makers hope someone wants them; Despite 49% surge in shipments, buyers seem unconvinced. (www.theregister.com)

submitted 1 week ago by [email protected] to c/[email protected]

52 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 12 points 1 week ago (16 children)

And it's hard to tell what the difference is. Apples 'built from the ground up for AI' chips just have more RAM. What's the difference with CPUs? Do they just have more onboard graphics processing that can also be used for matrix multiplication?

[–] [email protected] 2 points 1 week ago (3 children)

The Apple chips also have a wide interface to the RAM. That means you can run chatbots (LLMs) and other AI workloads that are memory-bound at crazy speeds compared to an Intel (or AMD) computer.

[–] [email protected] 3 points 1 week ago (2 children)

Really? How fast is the memory bus compared to x86? And did they just double the bus bandwidth by doubling the memory?

I'm dubious because they only now went to 16gb ram as base, which has been standard on x86 for almost a decade.

[–] brucethemoose 1 points 4 days ago* (last edited 4 days ago)

Apple is also much faster because the integrated graphics are actually usable for LLMs.

The base M is just a big faster than an Intel/AMD laptop if you can get their graphics working. The M Pro is 2x is fast (as its memory bus is 2x as wide). The M Max is 4x as fast.

AMD is coming out with something more competitive in 2025 though, Strix Halo.

load more comments (1 replies)

load more comments (13 replies)