I’ve added 2 external USBs of 2TB each to my Proxmox server and created a Resource Pool called USB_HDD containing both.
I created an Ubuntu VM, but I can’t allocate all 4TB to it in one go - it only allows me to add each one as a separate SCSI device. When I start to install the OS it only allows the install onto one of the 2TB devices.
I though the point of pools was to make the actual disks transparent, and present the pool to the VM so it sees it as one lot of space.
Am I doing something wrong, or do I have to have it as 2x2TB disks?
Thanks for the responses; it seems I can’t really do it. I looked into ZFS but if I use that it halves the available disk space to 2TB.
I’m using the VM for a media server and thought it would be better to have 1 4TB space instead of 2 2TB disks.
At the end of the day it isn’t a big deal, I just thought I’d be able to present both disks as 1.
ZFS can absolutely combine both into a 4TB single volume. Well like 3.78TB but you get the picture.
Note that, just like any other method which combines disks in a “RAID0” way, if one drive fails you lose everything on both drives.
But yes as others have said, “Pools” in Proxmox (or, more accurately, “Resource Pools”) are not related to storage but to permissions. A pool of VMs, of network bridges, yeah even storage but they’re not used for creating storage, only controlling access to it in an environment with lots of users (like in an enterprise).
ZFS and Ceph also use the term “Pool” but in a different context. They’re talking about a pool of combined storage, which is what you are looking for.
Put each USB disk into a ZFS vdev and then combine the two vdevs into a pool. You can add more drives into the vdev later to create mirrors within the vdev and get a RAID10-like setup once you have the means.
In this case ‘adding disks’ could mean either direct pass-through, or just adding a virtual disk on each physical disk in Proxmox so they can be used for other things as well.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.
Rules:
Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam posting.
Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
Thanks for the responses; it seems I can’t really do it. I looked into ZFS but if I use that it halves the available disk space to 2TB. I’m using the VM for a media server and thought it would be better to have 1 4TB space instead of 2 2TB disks. At the end of the day it isn’t a big deal, I just thought I’d be able to present both disks as 1.
ZFS can absolutely combine both into a 4TB single volume. Well like 3.78TB but you get the picture.
Note that, just like any other method which combines disks in a “RAID0” way, if one drive fails you lose everything on both drives.
But yes as others have said, “Pools” in Proxmox (or, more accurately, “Resource Pools”) are not related to storage but to permissions. A pool of VMs, of network bridges, yeah even storage but they’re not used for creating storage, only controlling access to it in an environment with lots of users (like in an enterprise).
ZFS and Ceph also use the term “Pool” but in a different context. They’re talking about a pool of combined storage, which is what you are looking for.
Put each USB disk into a ZFS vdev and then combine the two vdevs into a pool. You can add more drives into the vdev later to create mirrors within the vdev and get a RAID10-like setup once you have the means.
I would suggest adding both disks to the VM, and then using mergerFS installed inside to pool the disks together for easier media storage.
Only if you never want to use those disks for anything else on that server
In this case ‘adding disks’ could mean either direct pass-through, or just adding a virtual disk on each physical disk in Proxmox so they can be used for other things as well.
Look harder :-)
ZFS can do it either way.
Indeed ZFS has support for stripe (RAID0 like)
vdevzpool since very early days.Would it be better to make single-disk vdevs and add them into a pool so you could add a mirror disk to each vdev later?
Oh right my fault. Stripe is done at the pool level. So the two disks will be their own vdevs. And then the two vdevs are added into one zpool.
Be aware in RAID0 if one of the HDD fails, the content on both will be lost lost.