A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
I believe a resource pool, is just a group of resources, so adding a resource pool of 2 devices is exactly the same as adding those 2 devices manually, (I normally use them as VM groups to backup though).
You might be able to do striping (combining 2 devices into 1) using ZFS in Proxmox, or I think LVM can but you'd be using the command line.
Thanks for the responses; it seems I can't really do it. I looked into ZFS but if I use that it halves the available disk space to 2TB. I'm using the VM for a media server and thought it would be better to have 1 4TB space instead of 2 2TB disks. At the end of the day it isn't a big deal, I just thought I'd be able to present both disks as 1.
looked into ZFS but if I use that it halves the available disk space to 2TB.
Look harder :-)
ZFS can do it either way.
Indeed ZFS has support for stripe (RAID0 like) ~~vdev~~ zpool since very early days.
Be aware in RAID0 if one of the HDD fails, the content on both will be lost lost.
Would it be better to make single-disk vdevs and add them into a pool so you could add a mirror disk to each vdev later?
Oh right my fault. Stripe is done at the pool level. So the two disks will be their own vdevs. And then the two vdevs are added into one zpool.
I would suggest adding both disks to the VM, and then using mergerFS installed inside to pool the disks together for easier media storage.
Only if you never want to use those disks for anything else on that server
In this case 'adding disks' could mean either direct pass-through, or just adding a virtual disk on each physical disk in Proxmox so they can be used for other things as well.
ZFS can absolutely combine both into a 4TB single volume. Well like 3.78TB but you get the picture.
Note that, just like any other method which combines disks in a “RAID0” way, if one drive fails you lose everything on both drives.
But yes as others have said, “Pools” in Proxmox (or, more accurately, “Resource Pools”) are not related to storage but to permissions. A pool of VMs, of network bridges, yeah even storage but they’re not used for creating storage, only controlling access to it in an environment with lots of users (like in an enterprise).
ZFS and Ceph also use the term “Pool” but in a different context. They’re talking about a pool of combined storage, which is what you are looking for.
Put each USB disk into a ZFS vdev and then combine the two vdevs into a pool. You can add more drives into the vdev later to create mirrors within the vdev and get a RAID10-like setup once you have the means.
As per the documentation, pools are basically just resource groups to make permission management easier, so they aren't really supposed to handle anything like that. Maybe look into a RAID setup of some sort or mergerfs if you just need file level pooling.
I think the question is if you want to add the external USB hard drives to Proxmox so that not just the mentioned Ubuntu VM but other VMs and LXCs can benefit from them or if you want them to be added exclusively to the Ubuntu VM and Ubuntu VM only.
If it is the latter, you can leverage USB device passthrough and passthrough the two drives to the VM in whole. Then you can do whatever you want with them inside the VM. You can use ZFS or BTRFS or mdadm to create a stripe aka RAID 0 config.
Sounds like you're passing the physical HDDs to the VM instead of creating a new virtual HDD file in your proxmox pool.
If you don't mind me asking, what are you trying to do with your VM?
Bump