Re: Volume Creation - Best Practices

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I use single disks as a physical volume. Each gluster host is identical. As more space is needed for a mount point, a set of disks is added to the logical volume of each host. As my primary need is HA, all of my host nodes are simply replicates.

Prior to this config I had a physical raid6 array of 100TB on each host. Lost 3 drives on the same array out of just bad luck. 2 drives died and while replacing them, the third failed. The subsequent rebuild took months

By splitting each mount point into separate physical drives, my plan is to lessen rebuild time. Rebuilding a failed 24TB chunk that had 3 drives fail should take less time than another 100+TB rebuild that slows everyone down. I also added a third host node to retain quorum in the event of a failure.

As these are mounts are for independent research groups, they can acquire additional storage by simply buying a triplet of drives. To mitigate drive batch failures, we buy from different vendors and 2 different brands of drives.

On August 24, 2018 5:45:15 PM EDT, Brian Andrus <toomuchit@xxxxxxxxx> wrote:
You can do that, but you could run into issues with the 'shared' remaining space. Any one of the volumes could eat up the space you planned on using in another volume. Not a huge issue, but could bite you.

I prefer to use ZFS for the flexibility. I create a RAIDZ pool and then separate zfs filesystems within that for each brick. I can reserve a specific amount of space in the pool for each brick and that can be modified as well.

It is easy to grow it too. Plus, configured right, zfs does parallel across all the disks, so you get speedup in performance.

Brian Andrus

On 8/24/2018 11:45 AM, Mark Connor wrote:
Wondering if there is a best practice for volume creation. I don't see this information in the documentation. For example.
I have a 10 node distribute-replicate setup with one large xfs filesystem mounted on each node.

Is it OK for me to have just one xfs filesystem mounted and use subdirectories for my bricks for multiple volume creation?
So I could have, lets say 10 different volumes but each using a brick as subdir on my single xfs filesystem on each node?
In other words multiple bricks on one xfs filesystem per node?
I create volumes on the fly and creating new filesystems for each node would be too much work.

Your thoughts?



_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users


--
Sent from my Android device with K-9 Mail. All tyopes are thumb related and reflect authenticity.
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users

[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux