this post was submitted on 22 Jul 2023
17 points (90.5% liked)

Selfhosted

40736 readers
469 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

Hi! I’m currently running a bunch of docker containers on an old optiplex desktop I got from a local used PC store a year or so ago. Since I’ve been really enjoying this hobby and it’s stuck around, I now want to upgrade my hardware while also downsizing the physical size. I was thinking of getting an Intel NUC but it doesn’t seem like I can fit a 3.5” drive in there and I’m hoping to get a 10Tb HDD for lots of storage. I was wondering if you guys had some suggestions or even just good hardware resources I could look into. Thanks!

you are viewing a single comment's thread
view the rest of the comments
[–] corroded 7 points 1 year ago* (last edited 1 year ago) (1 children)

I have a full-height server rack with large, loud, noisy, power-inefficient servers, so I can't provide much of a good suggestion there. I did want to say that you might want to seriously reconsider using a single 10Tb hard drive.

Hard drives fail, and with a single drive, in the event of a failure, your data is gone. Using several smaller drives in an array provides redundancy, so that in the event of a drive failure, parity information exists on the other drives. As long as you replace the failed drive before anything else fails, you don't lose any data. There are multiple different ways to do this, but I'll use RAID as an example. In RAID5, one drive stores parity information. If any one drive fails, the array will continue running (albeit slower); you just need to replace the failed drive and allow your controller to rebuild the array. In a RAID5 configuration, you lose the space of one drive to parity. So if you have 4 4TB drives in a RAID5 configuration, you would have a total of 12TB of usable space. RAID6 lets you lose two drives, but you also lose two drives worth of space to parity, meaning your array would be more fault-tolerant, but you'd only have 8TB of space.

There are many different RAID configurations; far too many for me to go into them all here. You also have something called ZFS, which is a file system with many similarities to RAID (and a LOT of extra features... like snapshots). As an example, I have 12 10TB hard drives in my NAS. Two groups of 6 drives are configued as RAIDZ2 (similar to RAID6), for a total of 40TB usable space in each array. Those two arrays are then striped (like RAID0, so that data is written across both arrays with no redundancy at the striped level). In total, that means I have 80TB of usable space, and in a worst-case scenario, I could have 4 drives (two on each array) fail without losing data.

I'm not suggesting you need a setup like mine, but you could probably fit 3 4TB drives in a small case, use RAID5 or ZFS-RAIDZ1, and still have some redundancy. To be clear, RAID is not a substitution for a backup, but it can go a long way toward ensuring you don't need to use your backup.

[–] AFLYINTOASTER 2 points 1 year ago (1 children)
[–] corroded 2 points 1 year ago

Oops. Yeah, I meant ZFS. Fixed.