this post was submitted on 01 Apr 2024
54 points (75.5% liked)

Technology

59982 readers
3902 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

cross-posted from: https://lemmy.world/post/13805928

It's a long vid. I suggest prepping your fav drink before viewing.

It's re Nvidia's new gpu architecture for ai, NVlink switch, RAS diagnostics and other Nvidia announcements.

Nvidia knows it's the star of the backbone of the current ai boom and seems to be going full steam. I'm hoping for more innovations on tools for ai and gaming in the future.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] kromem 5 points 8 months ago* (last edited 8 months ago) (1 children)

Nvidia has the short term covered, but I'm skeptical they are going to end up leading the AI chip market in about 5 years or so without acquisitions.

Recent research has shown not only efficiency gains but also actual performance gains with binary or ternary weights instead of floats.

This means you don't need FP calculations or matrix multiplication.

It requires being trained from scratch with that architecture in mind, so it will probably be 12 to 18 months before we see leading models with light weights, but once we do the market may go more towards faster and more energy efficient options that don't need to rely on Nvidia's legacy of IP for FP ops.

So while an unmatched king in how things are currently done, the magic phrase that brings any monarch to tears is "this too shall pass."

[โ€“] [email protected] 2 points 8 months ago

While I agree with everything you said, I thought the same that after Crypto, Nvidia is done. They did have a dip, before AI jackpot hit.

Once models hit, new chips are bought and installed, it will be another year or two. So they are good for 2-3 years. They are also aware of this issue, I think they are working on CPUs and other businesses, so it won't be total loss. But I agree, sustaining stock at this price level seems unrealistic as of now.