PC Master Race

16150 readers

1 users here now

A community for PC Master Race.

Rules:

No bigotry: Including racism, sexism, homophobia, transphobia, or xenophobia. Code of Conduct.
Be respectful. Everyone should feel welcome here.
No NSFW content.
No Ads / Spamming.
Be thoughtful and helpful: even with ‘stupid’ questions. The world won’t be made better or worse by snarky comments schooling naive newcomers on Lemmy.

Notes:

PCMR Community Name - Our Response and the Survey

founded 2 years ago

MODERATORS

What to replace an Nvidia GTX 1080 with (self.pcmasterrace)

submitted 1 week ago by damnthefilibuster to c/pcmasterrace

19 comments fedilink hide all child comments

Hey team,

Years ago, SO gifted me an Alienware Aurora R7.

It has an Intel I7-8700 and Nvidia GTX 1080 (8GB VRAM), 16 GB of DDR 4 RAM. (what else is relevant to this question?)

My question to you is basically this -

Given that I'm not gaming with it anymore, I want to use it for only two things -

Plex Server
Running random local LLM stuff like Kotaemon (https://github.com/Cinnamon/kotaemon)

Let's say I have $1000 to throw at a GPU and I'd like to get 16 GB VRAM (or 24 if it's possible). I want to install it myself rather than take it into a shop.

What's a GPU I can buy that will fit,

within my budget?
within the chassis?
with the CPU and motherboard without issues?
with the needs I've detailed (namely Plex transcoding, and running ML models)?

I am an absolute noob when it comes to figuring out what hardware to buy (hey, we got us an Alienware sucker here).

So lemmings, help me out! I'd rather not ask ChatGPT.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 1 week ago* (last edited 1 week ago) (1 children)

https://www.ebay.co.uk/itm/166828062009

This looks cool

[–] damnthefilibuster 2 points 1 week ago (1 children)

This thing is just a 150 euro… what is it? A GPU on top of my GPU?

[–] [email protected] 2 points 1 week ago (2 children)

As far as I understand it, it's a GPU optimised for ML, prioritising VRAM over speed.

[–] remer 4 points 1 week ago

I think the K80 can only use 12GB of vram for llm stuff. I’d look into it before buying. I’m no expert.

[–] damnthefilibuster 2 points 1 week ago (1 children)

Yeah I just read up a little on it. Seems it doesn’t have video out? So it only does processing? That’s kinda cool!

[–] [email protected] 1 points 1 week ago

It’s only good for data processing and can’t be used for gaming. It’s basically like two GTX 760s glued together with a fuck ton of vram. Also you need a server to use it properly. You can funnel air through it using desk fans but you cannot use this thing unmodified in a desktop.