this post was submitted on 19 Aug 2023
75 points (91.2% liked)

PC Master Race

15444 readers
102 users here now

A community for PC Master Race.

Rules:

  1. No bigotry: Including racism, sexism, homophobia, transphobia, or xenophobia. Code of Conduct.
  2. Be respectful. Everyone should feel welcome here.
  3. No NSFW content.
  4. No Ads / Spamming.
  5. Be thoughtful and helpful: even with ‘stupid’ questions. The world won’t be made better or worse by snarky comments schooling naive newcomers on Lemmy.

Notes:

founded 2 years ago
MODERATORS
 

...Both Intel and AMD optimized their software stacks to get massive speedups in generative AI which has seen AMD's RTX 7900 XTX get higher performance per dollar than an NVIDIA RTX 4080 in generative AI (specifically Stable Diffusion with A111/Xformers). Considering Stable Diffusion accounts for the vast majority of non-SaaS, localized generative AI right now - this is a major milestone and finally offers some competition to NVIDIA.

top 11 comments
sorted by: hot top controversial new old
[–] FunnyUsername 21 points 2 years ago

Even more reason for GPUs for PC gaming to continue increasing in price and scarcity. Awesome!

[–] [email protected] 15 points 2 years ago (1 children)

You love to see it. AMD has been notorious for being bad at AI, hopefully with improvements they can be a real competitor to Nvidia.

[–] [email protected] 13 points 2 years ago (1 children)

I just want better support from developers. I'm fine with AMD being slower, but a ton of projects just don't even run with AMD hardware. I wish there was a psuedo-vulkan style interface for AI, so that GPU makers and developers could target that in the same way game developers target vulkan/opengl.

[–] NegativeInf 1 points 2 years ago

Blame the dominance of cuda in college cs.

[–] [email protected] 7 points 2 years ago (1 children)

I haaaaaaaate when things say 900% instead of 9x. It's so transparent that they're trying to make it seem bigger than it is.

Just be honest. 9x is great. Call it what it is.

[–] [email protected] 2 points 2 years ago

Technically I believe 900% increase is 10 times (compare that 100% increase is doubling = 2x). To me this makes these hundreds of percents reporting even more annoying.

[–] [email protected] 5 points 2 years ago

And then here I am, still unable to run StableDiffusion on my 6650xt because pytorch apparently hates it.

TBF llama.cpp runs like a wonder on ROCm.

All aside the improvements in the AI ecosystem by AMD are appreciated and overall tangible. Let's hope they'll keep it up.

[–] [email protected] 5 points 2 years ago

RTX 7900 XTX

[–] [email protected] 3 points 2 years ago

Isn't this whole article comparing apples with oranges? You can also use Microsoft Olive for Nvidia GPUs. But it isn't used in this comparison.

Nvidia at least talked about a 2x increase in performance when using Microsoft Olive on their GPUs. So that would leave the 7900 XTX in the dust again.

Tech news should be objective, doesn't matter what team you root for.

[–] [email protected] 1 points 2 years ago

Do Olive models work with LoRA yet?

[–] [email protected] 1 points 2 years ago

There's a plugin for Blender I saw a while ago that uses Stable Diffusion to create dynamic textures for objects, the example that was shown was a low-poly AC unit. The GPU generate option was greyed out for AMD GPUs because the Nvidia option uses CUDA, I wonder if this update would change that? Because that's something I really wanna be able to use for prototyping