this post was submitted on 03 Nov 2024
30 points (78.8% liked)

Selfhosted

40658 readers
151 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
ruud
Loki
CannaVet
devve
HybridSarcasm
[email protected]
30
How RAID system reliable? possible of raid system failure (lemm.ee)
submitted 1 month ago by [email protected] to c/selfhosted
49 comments fedilink hide all child comments
 

I know how RAID work and prevent data lost from disks failures. I want to know is possible way/how easy to recover data from unfunctioned remaining RAID disks due to RAID controller failure or whole system failure. Can I even simply attach one of the RAID 1 disk to the desktop system and read as simple as USB disk? I know getting data from the other RAID types won't be that simple but is there a way without building the whole RAID system again. Thanks.

you are viewing a single comment's thread
view the rest of the comments
[–] computergeek125 2 points 1 month ago (1 children)

I never said I didn't use software RAID, I just wanted to add information about hardware RAID controllers. Maybe I'm blind, but I've never seen a good implementation of software RAID for the EFI partition or boot sector. During boot, most systems I've seen will try to always access one partition directly and a second in order, which is bypassing the concept of a RAID, so the two would need to be kept manually in sync during updates.

Because of that, there's one notable place where I won't - I always use hardware RAID for at minimum the boot disk because Dell firmware natively understands everything about it from a detect/boot/replace perspective. Or doesn't see anything at all in a good way. All four of my primary servers have a boot disk on either a Startech RAID card similar to a Dell BOSS or have an array to boot off of directly on the PERC. It's only enough space to store the core OS.

Other than that, at home all my other physical devices are hypervisors (VMware ESXi for now until I can plot a migration), dedicated appliance devices (Synology DSM uses mdadm), or don't have a redundant disks (my firewall - backed up to git, and my NUC Proxmox box, both firewalls and the PVE are all running ZFS for features).

Three of my four ESXi servers run vSAN, which is like Ceph and replaces RAID. Like Ceph and ZFS, it requires using an HBA or passthrough disks for full performance. The last one is my standalone server. Notably, ESXi does not support any software RAID natively that isn't vSAN, so both of the standalone server's arrays are hardware RAID.

When it comes time to replace that Synology it's going to be on TrueNAS

[–] [email protected] 0 points 1 month ago (1 children)

Your information is about 10 years out of date. It is trivial to do boot with raid as in EFI you just set both drives as bootable.

I think hardware raid is only for the last resort as Windows has Storage sense and Linux has ZFS, LVM and mdadm. I've never heard of a hardware raid system that has the features a lot of these systems have like data integrity checking and ram caching.

Essentially I don't really see a need for hardware raid in a home environment and there isn't a huge need in the business.

[–] computergeek125 1 points 1 month ago
  • I never said anything about EFI not supporting multi boot. I said that the had to be kept in lockstep during updates. I recognize the term "manual" might have been a bit of a misnomer there, since I included systems where the admin has to take action to enable replication. ESXi (my main hardware OS for now) doesn't even have software RAID for single-server datastores (only vSAN). Windows and Linux both can do it, but its a non-default manual process of splicing the drives together with no apparent automatic replacement mechanism - full manual admin intervention. With a hardware RAID, you just have to plop the new disk in and it splices the drive back into the array automatically (if the drive matches)
  • Dell and HPe both have had RAM caching for reads and writes since at least 2011. That's why the controllers have batteries :)
    • also, I said it only had to handle the boot disk. Plus you're ignoring the fact that all modern filesystems will do page caching in the background regardless of the presence of hardware cache. That's not unique to ZFS, Windows and Linux both do it.
  • mdadm and hardware RAID offer the same level of block consistency validation to my current understanding- you'd need filesystem-level checksumming no matter what, and as both mdadm and hardware RAID are both filesystem agnostic, they will almost equally support the same filesystem-level features (Synology implements BTRFS on top of mdadm - I saw a small note somewhere that they had their implementation request block rebuild from mdadm if btrfs detected issues, but I have been unable to verify this claim so I do not consider it (yet) as part of my hardware vs md comparison)

Hardware RAID just works, and for many, that's good enough. In more advanced systems, all its got to handle is a boot partition, and if you're doing your job as a sysadmin there's zero important data in there that can't be easily rebuilt or restored.