this post was submitted on 01 Oct 2023
27 points (100.0% liked)

datahoarder

6792 readers
2 users here now

Who are we?

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

We are one. We are legion. And we're trying really hard not to forget.

-- 5-4-3-2-1-bang from this thread

founded 4 years ago
MODERATORS
 

Good afternoon all, I have half-assed my backups for 15 years, and it is not sustainable, and I need your help! I have the following setup: 1x Raspberry Pi 4 with a WD USB3 MyBook 4TB as a NAS target using OpenMediaVault. This works well enough, but is not in my mind a long term viable solution. 1x Apple Airport TimeCapsule A1355 2TB

I also have a smattering of other drives collected from over the years in MyBooks, all USB 2.0 drives, a 2TB mirror edition (2x 1TB drives in RAID 0 or RAID1), 1TB, and 500GB. This does not include the random 750 GBs, 500 GB and old 250 GB drives that I’ve taken out of my Macs and PCs over the years as I’ve upgraded them. I’ve got files scattered everywhere on them, plus on my MacBook and several other PCs and Macs around the house.

I need some help consolidating this into a single solution with priority to my photos and family home videos for data integrity. Then to a lesser extent, maybe PC backups and file storage.

Currently all of my photos are backed up to Google Photos or Amazon photos. With the fact that neither google or amazon is to be trusted with my photos, I’m ok with dumping them. Web based backup solutions are iffy, it takes forever for a backup to complete, as I am on a 60megabit download, with about a 5megabit upload connection. According to some things I’ve seen advertised nearby, fiber is being ran throughout the area, but it may be a year or two before it comes to my neighborhood.

For other hardware I have laying about, I have a 1st gen i7 980x system that is idle nowadays and is full of low capacity drives by today’s standards, a 2008 MacBook, the above mentioned 2012 MacBook Pro, an Atom n450 netbook, and an AMD Ryzen 5700g based prebuilt. None of them really seem to be something that would be useful as a ZFS based NAS or anything. But is a ZFS NAS or BTRFS system something that I need, or would my needs be better met by something else?

I have also looked at an OWC Mercurydisk M-Disc compatible burner for photo and video backup.

What are some options to look into? Preference would be on not breaking the bank and not necessarily set and forget it, but something I haven’t got to fight with to keep running.

you are viewing a single comment's thread
view the rest of the comments
[–] fury 9 points 1 year ago

Take a look at hosting your own Nextcloud instance. It'll replace Google drive, photos, docs, everything--there's phone apps for iPhone and android. If you want to store your PC backups on it, that's probably fine too. It might even work ok on the Pi 4 (though some parts it has integrations with may have trouble, like Nextcloud Office, since they may not have ARM binaries in their distribution).

It should work great on your local network and still be acceptable when uploading out and about (photos can auto sync if you turn that on on your Nextcloud phone app).

If 4TB is enough for your needs, I'd suggest getting another 4TB and making them a RAID1 pair using mdadm, and then probably also another 4TB to make backups of Nextcloud and Nextcloud data onto to keep offsite. You can never have too many copies of your data.

I'm not sure what to do about the variety of smaller drives. I can say I wouldn't recommend consolidating them onto a single drive, because I did that once (many drives ranging from 60 gigglebytes to 300, onto one 1.5 TB drive) and then formatted or got rid of the smaller ones...and then dropped the 1.5 TB drive on the floor while it was running. Rip. But just like the above, a RAID1 array composed of two big drives would probably be fine.

Just make sure to set up some alerts for when a drive fails.