Re: clustered MD - beyond RAID1

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



What if the application is doing the locking and making sure that only 1 node writes to a md device at a time? Will this work? How are rebuilds handled? This would be helpful with distributed filesystems like GPFS/lustre etc.

Tejas.

On 12/20/2015 18:25, NeilBrown wrote:
On Sat, Dec 19 2015, Scott Sinno wrote:

Neil(or anyone well informed in mdadm development roadmaps),
	
	Aaron and myself are engineers at NASA Goddard with strong interest in
MDADM.  We currently host 6PB(raw) of live JBOD storage leveraging MDADM
exclusively for RAID functionality.

	We're very interested in Clustered MDADM to improve data-availability
in the environment, but note that only RAID1 is currently supported.
Are there plans in the nearish-term(say over the next year) to expound
clustered bitmap functionality to RAID5/6, or anything else you can
divulge on that front?  Thanks in advance for any guidance.
We don't talk about plans that are not backed by code - you can't trust
them.

However I cannot imagine how you could make RAID5 work efficiently in a
cluster.
RAID1 works because we assume that the file system will have its own
locking to ensure that only one node writes to a given block at a given
time.  So while node-A is writing to a block, RAID1 knows that no other
node is writing there so it can update all copies and be sure no race
will result in the copies being inconsistent.

For this to work with RAID5 we would need to assume the filesystem will
ensure only one node is writing to a given stripe at a time, and that is
not realistic.

So to make it work we would need the md layer to lock each stripe during
an update.  I have trouble imagining that running with much speed.  Hard
to know without testing of course.
I know of no-one with plans to do that testing.

NeilBrown

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux