this post was submitted on 18 Oct 2024
357 points (99.7% liked)

Technology

58990 readers
7809 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 26 points 1 week ago (5 children)

Assuming that these have fairly impressive 100 MB/s sustained write speed, then it's going to take about 93 hours to write the whole contents of the disk - basically four days. That's a long time to replace a failed drive in a RAID array; you'd need to consider multiple disks of redundancy just in case another one fails while you're resilvering the first.

[–] [email protected] 11 points 1 week ago

This is one of the reasons I use unRAID with two parity disks. If one fails, I'll still have access to my data while I rebuild the data on the replacement drive.

Although, parity checks with these would take forever, of course..

[–] [email protected] 8 points 1 week ago (1 children)

That's a pretty common failure scenario in SANs. If you buy a bunch of drives, they're almost guaranteed to come from the same batch, meaning they're likely to fail around the same time. The extra load of a rebuild can kill drives that are already close to failure.

Which is why SANs have hot spares that can be allocated instantly on failure. And you should use a RAID level with enough redundancy to meet your reliability needs. And RAID is not backup, you should have backups too.

[–] kalleboo 1 points 1 week ago

Also why you need to schedule periodical parity scrubs, then the "extra load of a rebuild" is exercised regularly so weak drives will be found long before a rebuild is needed.

[–] [email protected] 2 points 1 week ago (1 children)

My 16TB ultrastars get upwards of 180MB/s sustained read and write, these will presumably be faster than that as the density is higher.

[–] [email protected] 2 points 1 week ago (1 children)

I'm guessing that only works if the file is smaller than the RAM cache of the drives. Transfer a file that's bigger than that, and it will go fast at first, but then fill the cache and the rate starts to drop closer to 100 MB/s.

My data hoarder drives are a pair of WD ultrastar 18TB SAS drives on RAID1, and that's how they tend to behave.

[–] [email protected] 1 points 1 week ago* (last edited 1 week ago)

This is for very long sustained writes, like 40TiB at a time. I can't say I've ever noticed any slowdown, but I'll keep a closer eye on it next time I do another huge copy. I've also never seen any kind of noticeable slowdown on my 4 8TB SATA WD golds, although they only get to about 150MB/s each.

EDIT: The effect would be obvious pretty fast at even moderate write speeds, I've never seen a drive with more than a GB of cache. My 16TB drives have 256MB, and the 8TB drives only 64MB of cache.

[–] [email protected] 2 points 1 week ago (1 children)

2 parity is standard and should still be adequate. Likelihood of two failures within four days on the same array is small.

[–] [email protected] 2 points 1 week ago

It's more likely if you bought all the drives from the same store (since that increases the likelihood that they're from the same batch), so you should make sure that you buy them from different stores.

[–] [email protected] -3 points 1 week ago (1 children)

Except these drives are SMR - not something you'd want in a RAID.

[–] Telodzrum -3 points 1 week ago

Title literally says SMR for one size and CMR for another. Not that I should expect much from a .ml account.