this post was submitted on 11 Mar 2025

34 points (100.0% liked)

PC Master Race

16140 readers

57 users here now

A community for PC Master Race.

Rules:

No bigotry: Including racism, sexism, homophobia, transphobia, or xenophobia. Code of Conduct.
Be respectful. Everyone should feel welcome here.
No NSFW content.
No Ads / Spamming.
Be thoughtful and helpful: even with ‘stupid’ questions. The world won’t be made better or worse by snarky comments schooling naive newcomers on Lemmy.

Notes:

PCMR Community Name - Our Response and the Survey

founded 2 years ago

MODERATORS

What to replace an Nvidia GTX 1080 with (self.pcmasterrace)

submitted 1 week ago by damnthefilibuster to c/pcmasterrace

19 comments fedilink hide all child comments

Hey team,

Years ago, SO gifted me an Alienware Aurora R7.

It has an Intel I7-8700 and Nvidia GTX 1080 (8GB VRAM), 16 GB of DDR 4 RAM. (what else is relevant to this question?)

My question to you is basically this -

Given that I'm not gaming with it anymore, I want to use it for only two things -

Plex Server
Running random local LLM stuff like Kotaemon (https://github.com/Cinnamon/kotaemon)

Let's say I have $1000 to throw at a GPU and I'd like to get 16 GB VRAM (or 24 if it's possible). I want to install it myself rather than take it into a shop.

What's a GPU I can buy that will fit,

within my budget?
within the chassis?
with the CPU and motherboard without issues?
with the needs I've detailed (namely Plex transcoding, and running ML models)?

I am an absolute noob when it comes to figuring out what hardware to buy (hey, we got us an Alienware sucker here).

So lemmings, help me out! I'd rather not ask ChatGPT.

top 19 comments

sorted by: hot top controversial new old

[–] simple@lemm.ee 9 points 1 week ago (1 children)

Not 100% sure about the chassis and compatibility with the rest of your rig so hopefully someone follows up on me, but in general I would try getting the AMD 9070 XT if you can find it near its real price ($600). That might be a bit difficult since it just released, so I would wait until it starts being more available if you can.

If not that, I'd recommend the 4060 Ti (16GB). Note that there's an 8GB version too, do NOT buy that one. Nvidia is generally better when it comes to running AI, but the new AMD gpus are pretty good too.

[–] damnthefilibuster 4 points 1 week ago (2 children)

Thank you for that! I’ll look at the AMD. I thought most ML tools don’t have outright compatibility with AMD though? Is that no longer the case?

The 4060 Ti 16 GB version… that sounds good. About $500?

[–] simple@lemm.ee 7 points 1 week ago* (last edited 1 week ago) (1 children)

AMD's compatibility has gotten better the past year, and ones that aren't compatible usually have workarounds. But yeah, Nvidia is probably better if LLMs are important for you.

The 4060 Ti 16 GB version… that sounds good. About $500?

More like ~$800-900 unless you're okay with buying used. The market is pretty darn bad, and it's gotten SO much worse due to the tariff scare. Like I said, you're better off waiting a few months if you can.

[–] damnthefilibuster 2 points 1 week ago (2 children)

I don’t shy away from buying refurb electronics. But is there a problem with buying used GPUs?

Not looking forward to buying new during this tariff era. So perhaps my local marketplaces might be best…

[–] Mistic 3 points 1 week ago

Not really. You just have to make sure you got what you ordered by doing a bunch of tests. Plus, you usually don't get a warranty.

[–] deepfriedchril 3 points 1 week ago

I've bought used for my last 2 gpus, no issues.

[–] Pogogunner@sopuli.xyz 3 points 1 week ago (1 children)

https://github.com/ollama/ollama/blob/main/docs/gpu.md

Ollama supports AMD and Nvidia GPUs, including your existing 1080

[–] damnthefilibuster 2 points 1 week ago

Wow; thanks for finding that doc. Yeah, I’ve made it work on my system. But I’d like to use some of the bigger models.

[–] newthrowaway20 7 points 1 week ago* (last edited 1 week ago) (1 children)

These are the exact specs of my old computer.

I got myself a new one a year ago. My old one is now running unraid, and runs all my downloading apps and Plex server. Just bumped it up to 80Tb and it's going strong. Enable GPU support and the 1080 is more than enough for any transcoding that might pop up.

But LLM stuff is a different question. I haven't begun to dabble with that. But I hear Framework just announced a new desktop that'll end up being an awesome little box for machine learning.

[–] damnthefilibuster 2 points 1 week ago

Oh yeah, I’ve got an external 140 TB nigh impossible to fill up! I don’t have download ware any more though. So there’s that. I’ve yet to explore unraid. I’m stuck with windows for now because I got on windows 11 bleeding edge for some reason I can’t remember. Stepping away means I’d have to wipe or dual boot. And I’m… lazy… haha!

[–] Lyra_Lycan@lemmy.blahaj.zone 2 points 1 week ago* (last edited 1 week ago)

I had a long running plan that played out with my GTX 1080. I wanted my server (in my bedroom) to be as quiet as possible, and the (Gigabyte) 1080's fans, with one slightly dodgy bearing, wasn't going to cut it. I deshrouded it and ran thermal tests in my main PC. Long story short, while in the server machine it blitzed a local Piper model (<1s processing voice commands) and Emby transcoding with Max 5GB used. I know Piper is a far cry from an LLM, but at least you'll know that its more than capable of everything else.

Edit: Here are my notes in case it helps anyone lol

[–] Acidbath 1 points 1 week ago

I think for ML and stuff, I am currently waiting for the release of the 24gb intel battlemage cards.

Our college has a lot of alienware aurora r7's and i think its a pretty okay sized case. Like the ones we have are loaded with 4090's, so I assume you should be fine. If you are upgrading anything, you should make sure your powersupply covers the requirements.

I've never tinkered with alienware but two of my friends had issues trying to upgrade cpus because the bolts and screws were installed super tight. Maybe you wont have this issue. Best of luck hope this helps :]

[–] JackGreenEarth@lemm.ee 1 points 1 week ago* (last edited 1 week ago) (1 children)

https://www.ebay.co.uk/itm/166828062009

This looks cool

[–] damnthefilibuster 2 points 1 week ago (1 children)

This thing is just a 150 euro… what is it? A GPU on top of my GPU?

[–] JackGreenEarth@lemm.ee 2 points 1 week ago (2 children)

As far as I understand it, it's a GPU optimised for ML, prioritising VRAM over speed.

[–] remer 4 points 1 week ago

I think the K80 can only use 12GB of vram for llm stuff. I’d look into it before buying. I’m no expert.

[–] damnthefilibuster 2 points 1 week ago (1 children)

Yeah I just read up a little on it. Seems it doesn’t have video out? So it only does processing? That’s kinda cool!

[–] fuckwit_mcbumcrumble@lemmy.dbzer0.com 1 points 1 week ago

It’s only good for data processing and can’t be used for gaming. It’s basically like two GTX 760s glued together with a fuck ton of vram. Also you need a server to use it properly. You can funnel air through it using desk fans but you cannot use this thing unmodified in a desktop.

[–] Yokozuna 1 points 1 week ago

I have the same GPU and settled on a 4070 Ti Super for my next upgrade. Do what you will with that information and happy gaming!