This is a most excellent place for technology news and articles.
Edward Snowden doing GPU reviews? This timeline is becoming weirder every day.
Does he work for Nvidia? Seems out of character for him.
Legitimately thought this was a hard-drive.net post
I bet he just wants a card to self host models and not give companies his data, but the amount of vram is indeed ridiculous.
Exactly, I'm in the same situation now and the 8GB in those cheaper cards don't even let you run a 13B model. I'm trying to research if I can run a 13B one on a 3060 with 12 GB.
I'm running deepseek-r1:14b on a 12GB rx6700. It just about fits in memory and is pretty fast.
Every one who bought the 7900xtx laughing their arse off running 20GiB models with MUCH better performance than a 4080/4080Super lol
He's not wrong
I legit tried to understand how a lackluster VRAM capacity could spy on us.
You depend on the cloud instead~
The video card monopoly (but also other manufacturers) have been limiting functionality for a long time. It started with them restricting vGPU to enterprise garbage products, which allows Linux users to virtualize their GPU for things like playing games with near-native speeds using Windows on Linux. This is one of the big reasons Windows still has such a large marketshare as the main desktop OS.
Now they want to restrict people running AI locally so that they get stuck with crap like Copilot-enabled PCs or whatever dumb names they want to come up. These actions are intentional. It is anti-consumer & anti-trust, but don't expect our government to care or do anything about it.
But that’s assuming there is actual high demand for running big models locally, so far I’ve only seen hobbyists do it.
I agree with you in theory that they just want more money but idk if they actually think locally run AI is that big of a threat (I hope it is).
