this post was submitted on 14 Sep 2023
14 points (93.8% liked)

Buildapc

3808 readers
2 users here now

founded 1 year ago
MODERATORS
14
submitted 1 year ago* (last edited 1 year ago) by ruhe to c/buildapc
 

I'm looking to build a high-end pc to be an all-in-one general build (gaming, productivity, daily driver, LLM/AI tinkering). How does the list below seem for a high-end build? Is there anything I've forgotten? Haven't thought of? Am un aware of? Basically I'm asking for a sanity check or for any additional insight I should be aware of before I commit to purchasing.

PCPartPicker Part List

Type Item Price
CPU Intel Core i9-13900K 3 GHz 24-Core Processor $585.11 @ B&H
CPU Cooler ARCTIC Liquid Freezer II 420 72.8 CFM Liquid CPU Cooler $144.15 @ Amazon
Motherboard Gigabyte Z790 AERO G ATX LGA1700 Motherboard $286.19 @ B&H
Memory TEAMGROUP T-Create Expert 96 GB (2 x 48 GB) DDR5-6800 CL36 Memory $392.19 @ Newegg
Storage Samsung 990 Pro 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive $143.09 @ B&H
Video Card Gigabyte AERO OC GeForce RTX 4090 24 GB Video Card $1854.99 @ B&H
Case Lian Li O11 Dynamic EVO XL ATX Full Tower Case $259.69 @ Newegg Sellers
Power Supply Super Flower LEADEX VII XG 1300 W 80+ Gold Certified Fully Modular ATX Power Supply $196.09 @ Newegg Sellers
Custom Thermalright TFX 2g Thermal Paste $11.23 @ Amazon
Custom LIAN LI O11DEXL Upright GPU Bracket (White) $6.99
Custom LIAN LI PCIe 4.0 16X 900mm Riser Cable (White) $99.99

Now for a bit of a rambling of my ideas. I'm not sure how much response or discussion I'll get from any of this, but at least the process of writing everything down has been helpful. :shrug:

Goals:

  • Migrate from Windows 10 to Linux
  • Game in Linux using Steam and Proton as much as possible
  • Use a Windows in a Virtual Machine (with VFIO) in Linux, when necessary
  • Experiment with LLMs and other AI things, possibly one day adding a used 3090 if I decided I want to dive deeper into LLMs/AI
    • Case has room for a second massive GPU
    • PSU calculations are showing that adding a 3090 would put me around 1285W usage
    • I'd probably limit the power draw on the 3090 too, at the cost of a bit of its performance, but I'll still need a very beefy PSU when I do get around to using dual GPUs

Case/Aesthetics:

  • Going for a white/black mix color aesthetic
  • Going with some budget ARCTIC case fans (not listed above) until Noctua releases their new 140mm fan (sometime within the next year, I hope?)

Intel vs AMD, and RAM:

  • Intel and AMD seem to be pretty much neck and neck with their current generations, so it was kind of a tough choice
    • I decided on Intel
    • I do a bit of everything, and not just gaming, otherwise I might've picked the 7950X3D or even the 7800X3D (wow! what an amazing gaming processor!)
    • I was ready to pull the trigger on the i9-13900k ... but I just saw that the 14th gen Raptor Lake-S refresh is dropping next month, so I guess I'm waiting for that now.
      • Supposedly the current line of motherboards (z790) will need a BIOS update, but should be able to use the 14th gen processors
  • I opted for faster/denser RAM
    • I'll be messing around with LLMs/AI, and I know (llama.cpp) wants as much RAM as possible, but I ended up settling for 2x48 GB
    • I've heard that 12th/13th Intel generation has issues running DDR5 at high speeds when running heavy RAM configurations
    • AMD can't run much faster than 6000 and/or also has issues with RAM amount and speed
    • Memory controllers are antagonized by both dual-rank DIMMs and number of slotted DIMMs, basically more RAM means more problems and the speed has to drop to maintain stability
    • I'm pretty sure the 48GB DIMMs are dual-rank, but the tradeoff is I'm keeping it in two slots
    • If I find myself desperate for more RAM, then I'll up to 192GB and drop the speed to whatever it has to go to

GPU and Motherboard:

  • I've read that Gigabyte GPUs have little to no coil whine, which was a major factor in selecting their hardware, in addition to the aesthetic pairing
  • ...I've also read that Gigabyte has terrible customer support and a horrible RMA process, so I think I'll be purchasing an insurance plan for the GPU through B&H. :unamused:
  • I'm hoping a combination of a high-quality GPU, high-quality Motherboard, and high-quality PSU will prevent any coil whine from occurring
    • Also, hoping to avoid any buzz in my head phones -- I seem to have stumbled upon a ground loop or something with my current setup and the buzzing increases in intensity when my GPU increases its power consumption :frown:
    • Worst case scenario, I buy a dedicated sound card or SPDIF DAC or something
  • The Z790 Aero motherboard has 1 PCIe 5.0 x16 channel (which I don't plan on splitting with the SSD) and 2 PCIe 4.0 x4 channels (in x16 slots)
    • The 4090 can take the main slot,
    • When I slot a second GPU, it'll take the x4 slot. I'll take the performance hit on the bandwidth, which should be okay since the LLM workload is split and contained within separate GPUs and there isn't any transfer between the two
    • NVLink isn't necessary AFAIK, but the AI field seems so crazy right now that it'll probably change in the future

PSU:

  • Most troublesome part to choose, I want something that was future proof with the following features
    • Dual native GPU support via 12VHPWR (12+4 pin) adapters (even though I'm tentatively planning on a 4090 + 3090 combo)
    • ATX 3.0 support
      • Is ATX 3.0 support required at this time? Probably not, but I wanted to future proof if the chance provided itself
    • At least 1300W, but preferably 1600W
  • I've been a SeaSonic stan for ages and I saw they had a 1600W PSU, the Prime ATX3.0 PX-1600 Platinum (SSR-1600PD2), but...
    • The PX-1600 nearly costs as much as the CPU, and the Titanium TX-1600 variant cost more than the CPU. I can't consciously spend more on a PSU than a top of the line CPU :frown:
    • Apparently its TX-1600 variant doesn't even meet the full 3.0 ATX specification and I doubt the PX would either
  • Corsair's AX1600i is supposedly still the king of PSUs, despite its age and lack of modern features, but it seems pointless to buy at this time
    • It doesn't have an 12VHPWR cables or any ATX 3.0 support
    • I'm guessing that Corsair (or all brands, in general) will start releasing new PSUs that support these new features sooner, rather than later
  • Additionally, it's possible that PSUs might change even more in the in the near future with 12V-2×6 terminals/cables?
    • The same technician even goes on to suggest the RM1000e as a semi-future-proofed PSU for 12v-2x6, though I'd still use it as a stop gap until the next generation of top-tier PSUs.
    • ...maybe this 12V-2x6 pin terminal/cable is part of the reason why there aren't many ATX 3.0 PSUs yet?
  • So there aren't many PSUs that meet my criteria and I decided to settle on the bare minimum until I need a dual-GPU PSU and have set a rigid $200 price limit, which these PSUs should I choose?

edits:

  • updated PSU
you are viewing a single comment's thread
view the rest of the comments
[–] ruhe 3 points 1 year ago (2 children)

Thanks.

Yeah, the PSU is a holdover until something a more favorable 1600W PSU appears as an option. I don't really like buying a stop gap, but I don't even have a spare 1000W PSU laying around.

AMD cards didn't really have much of a chance when I'm planning on working with AI stuff, though. I've read they're working on some things to make them more competitive, but without CUDA they've always been lagging behind in performance, implementation, and favor.

I'll try researching shitty driver issues and see what sort of pain I'm in for.

[–] [email protected] 4 points 1 year ago

You'll be fine with nvidia. Install the proprietry driver and it will just work.

The OS driver does lag behind, last time i did an install my 3070 was a glitchy mess until I got the nvidia driver installed, and then it was fine.

[–] [email protected] 3 points 1 year ago

I agree. Nvidia is the easy choice if you're interested in ML, regardless of driver issues. A lot of projects do support non-CUDA backends these days but even so, Nvidia performs better. Choose your distro carefully. I strongly recommend an LTS distro that is officially supported by Nvidia.

That said, if you're dealing with medium-sized LLMs leveraging that 96GB of RAM, that means you'll be running them on the CPU anyway. 24GB of VRAM will only support smaller LLMs. Consumer hardware can't run the largest networks at all (e.g. Bloom needs 360GB, and consumer mobos typically only support up to 192GB). Just something to keep in mind.