Short description:
I've discovered a problem during re-assembly of a clean RAID. mdadm
throws one disk out because this disk apparently shows another disk as
failed. After assembly, RAID starts to recover on existing spare disk.
In detail:
1. RAID-6 (Superblock V0.90.00) created with mdadm V2.6.4 and with 7
active disks and 1 spare disk (disk size: 1 TB), fully synced and
clean.
2. RAID-6 stopped and re-assembled with mdadm V3.2.5, but during that
one disk is thrown out.
Manual assembly command for /dev/md0, relevant partitions are /dev/sd[b-i]1:
# mdadm --assemble --scan -vvv
mdadm: looking for devices for /dev/md0
mdadm: no RAID superblock on /dev/sdi
mdadm: no RAID superblock on /dev/sdh
mdadm: no RAID superblock on /dev/sdg
mdadm: no RAID superblock on /dev/sdf
mdadm: no RAID superblock on /dev/sde
mdadm: no RAID superblock on /dev/sdd
mdadm: no RAID superblock on /dev/sdc
mdadm: no RAID superblock on /dev/sdb
mdadm: no RAID superblock on /dev/sda1
mdadm: no RAID superblock on /dev/sda
mdadm: /dev/sdi1 is identified as a member of /dev/md0, slot 7.
mdadm: /dev/sdh1 is identified as a member of /dev/md0, slot 6.
mdadm: /dev/sdg1 is identified as a member of /dev/md0, slot 5.
mdadm: /dev/sdf1 is identified as a member of /dev/md0, slot 4.
mdadm: /dev/sde1 is identified as a member of /dev/md0, slot 3.
mdadm: /dev/sdd1 is identified as a member of /dev/md0, slot 2.
mdadm: /dev/sdc1 is identified as a member of /dev/md0, slot 1.
mdadm: /dev/sdb1 is identified as a member of /dev/md0, slot 0.
mdadm: ignoring /dev/sdb1 as it reports /dev/sdi1 as failed
mdadm: no uptodate device for slot 0 of /dev/md0
mdadm: added /dev/sdd1 to /dev/md0 as 2
mdadm: added /dev/sde1 to /dev/md0 as 3
mdadm: added /dev/sdf1 to /dev/md0 as 4
mdadm: added /dev/sdg1 to /dev/md0 as 5
mdadm: added /dev/sdh1 to /dev/md0 as 6
mdadm: added /dev/sdi1 to /dev/md0 as 7
mdadm: added /dev/sdc1 to /dev/md0 as 1
mdadm: /dev/md0 has been started with 6 drives (out of 7) and 1 spare.
I finally made a test by modifying mdadm V3.2.5 sources to not write
any data to any superblock and to simply exit() somewhere in the
middle of assembly process to be able to reproduce this behavior
without any RAID re-creation/synchronization.
So using mdadm V2.6.4 /dev/md0 assembles without problems and if I
switch to mdadm V3.2.5 it shows the same messages as above.
The real problem:
I have more than a single machine receiving a similar software update
so I need to find a solution or workaround around this problem. By the
way, from another test without an existing spare disk, there seems to
be no 'throwing out'-problem when switching from V2.6.4 to V3.2.5.
It would also be a great help if someone could explain the reason
behind the relevant code fragment for rejecting a device, e.g. why is
only the 'most_recent' device important?
/* If this device thinks that 'most_recent' has failed, then
* we must reject this device.
*/
if (j != most_recent &&
content->array.raid_disks > 0 &&
devices[most_recent].i.disk.raid_disk >= 0 &&
devmap[j * content->array.raid_disks +
devices[most_recent].i.disk.raid_disk] == 0) {
if (verbose > -1)
fprintf(stderr, Name ": ignoring %s as it reports %s as failed\n",
devices[j].devname, devices[most_recent].devname);
best[i] = -1;
continue;
}
I also attached some files showing some details about related
superblocks before and after assembly as well as about RAID status
itself.
# mdadm --assemble --scan -vvv
mdadm: looking for devices for /dev/md0
mdadm: no RAID superblock on /dev/sdi
mdadm: no RAID superblock on /dev/sdh
mdadm: no RAID superblock on /dev/sdg
mdadm: no RAID superblock on /dev/sdf
mdadm: no RAID superblock on /dev/sde
mdadm: no RAID superblock on /dev/sdd
mdadm: no RAID superblock on /dev/sdc
mdadm: no RAID superblock on /dev/sdb
mdadm: no RAID superblock on /dev/sda1
mdadm: no RAID superblock on /dev/sda
mdadm: /dev/sdi1 is identified as a member of /dev/md0, slot 7.
mdadm: /dev/sdh1 is identified as a member of /dev/md0, slot 6.
mdadm: /dev/sdg1 is identified as a member of /dev/md0, slot 5.
mdadm: /dev/sdf1 is identified as a member of /dev/md0, slot 4.
mdadm: /dev/sde1 is identified as a member of /dev/md0, slot 3.
mdadm: /dev/sdd1 is identified as a member of /dev/md0, slot 2.
mdadm: /dev/sdc1 is identified as a member of /dev/md0, slot 1.
mdadm: /dev/sdb1 is identified as a member of /dev/md0, slot 0.
mdadm: ignoring /dev/sdb1 as it reports /dev/sdi1 as failed
mdadm: no uptodate device for slot 0 of /dev/md0
mdadm: added /dev/sdd1 to /dev/md0 as 2
mdadm: added /dev/sde1 to /dev/md0 as 3
mdadm: added /dev/sdf1 to /dev/md0 as 4
mdadm: added /dev/sdg1 to /dev/md0 as 5
mdadm: added /dev/sdh1 to /dev/md0 as 6
mdadm: added /dev/sdi1 to /dev/md0 as 7
mdadm: added /dev/sdc1 to /dev/md0 as 1
mdadm: /dev/md0 has been started with 6 drives (out of 7) and 1 spare.
# mdadm -D /dev/md0
/dev/md0:
Version : 0.90
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Raid Devices : 7
Total Devices : 7
Preferred Minor : 0
Persistence : Superblock is persistent
Update Time : Tue Jul XX 12:04:22 20XX
State : clean, degraded, recovering
Active Devices : 6
Working Devices : 7
Failed Devices : 0
Spare Devices : 1
Layout : left-symmetric
Chunk Size : 32K
Rebuild Status : 0% complete
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Events : 0.40
Number Major Minor RaidDevice State
7 8 129 0 spare rebuilding /dev/sdi1
1 8 33 1 active sync /dev/sdc1
2 8 49 2 active sync /dev/sdd1
3 8 65 3 active sync /dev/sde1
4 8 81 4 active sync /dev/sdf1
5 8 97 5 active sync /dev/sdg1
6 8 113 6 active sync /dev/sdh1
/dev/sdb1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 8
Preferred Minor : 0
Update Time : Tue Jul XX 12:04:22 20XX
State : clean
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Checksum : ce8f938f - correct
Events : 40
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 0 8 17 0 active sync /dev/sdb1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdc1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 8
Preferred Minor : 0
Update Time : Tue Jul XX 12:04:22 20XX
State : clean
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Checksum : ce8f93a1 - correct
Events : 40
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 1 8 33 1 active sync /dev/sdc1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdd1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 8
Preferred Minor : 0
Update Time : Tue Jul XX 12:04:22 20XX
State : clean
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Checksum : ce8f93b3 - correct
Events : 40
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 2 8 49 2 active sync /dev/sdd1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sde1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 8
Preferred Minor : 0
Update Time : Tue Jul XX 12:04:22 20XX
State : clean
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Checksum : ce8f93c5 - correct
Events : 40
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 3 8 65 3 active sync /dev/sde1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdf1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 8
Preferred Minor : 0
Update Time : Tue Jul XX 12:04:22 20XX
State : clean
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Checksum : ce8f93d7 - correct
Events : 40
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 4 8 81 4 active sync /dev/sdf1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdg1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 8
Preferred Minor : 0
Update Time : Tue Jul XX 12:04:22 20XX
State : clean
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Checksum : ce8f93e9 - correct
Events : 40
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 5 8 97 5 active sync /dev/sdg1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdh1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 8
Preferred Minor : 0
Update Time : Tue Jul XX 12:04:22 20XX
State : clean
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Checksum : ce8f93fb - correct
Events : 40
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 6 8 113 6 active sync /dev/sdh1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdi1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 8
Preferred Minor : 0
Update Time : Tue Jul XX 01:05:31 20XX
State : clean
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Checksum : ce8ef99c - correct
Events : 40
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 7 8 129 7 spare /dev/sdi1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdb1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 8
Preferred Minor : 0
Update Time : Tue Jul XX 12:04:22 20XX
State : clean
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Checksum : ce8f938f - correct
Events : 40
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 0 8 17 0 active sync /dev/sdb1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdc1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 7
Preferred Minor : 0
Update Time : Tue Jul XX 13:32:24 20XX
State : clean
Active Devices : 6
Working Devices : 7
Failed Devices : 0
Spare Devices : 1
Checksum : ce8fa831 - correct
Events : 44
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 1 8 33 1 active sync /dev/sdc1
0 0 0 0 0 removed
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdd1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 7
Preferred Minor : 0
Update Time : Tue Jul XX 13:32:24 20XX
State : clean
Active Devices : 6
Working Devices : 7
Failed Devices : 0
Spare Devices : 1
Checksum : ce8fa843 - correct
Events : 44
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 2 8 49 2 active sync /dev/sdd1
0 0 0 0 0 removed
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sde1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 7
Preferred Minor : 0
Update Time : Tue Jul XX 13:32:24 20XX
State : clean
Active Devices : 6
Working Devices : 7
Failed Devices : 0
Spare Devices : 1
Checksum : ce8fa855 - correct
Events : 44
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 3 8 65 3 active sync /dev/sde1
0 0 0 0 0 removed
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdf1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 7
Preferred Minor : 0
Update Time : Tue Jul XX 13:32:24 20XX
State : clean
Active Devices : 6
Working Devices : 7
Failed Devices : 0
Spare Devices : 1
Checksum : ce8fa867 - correct
Events : 44
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 4 8 81 4 active sync /dev/sdf1
0 0 0 0 0 removed
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdg1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 7
Preferred Minor : 0
Update Time : Tue Jul XX 13:32:24 20XX
State : clean
Active Devices : 6
Working Devices : 7
Failed Devices : 0
Spare Devices : 1
Checksum : ce8fa879 - correct
Events : 44
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 5 8 97 5 active sync /dev/sdg1
0 0 0 0 0 removed
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdh1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 7
Preferred Minor : 0
Update Time : Tue Jul XX 13:32:24 20XX
State : clean
Active Devices : 6
Working Devices : 7
Failed Devices : 0
Spare Devices : 1
Checksum : ce8fa88b - correct
Events : 44
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 6 8 113 6 active sync /dev/sdh1
0 0 0 0 0 removed
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
/dev/sdi1:
Magic : a92b4efc
Version : 0.90.00
UUID : d5236bb6:af292dc7:90a2b5fe:324e77f8
Creation Time : Mon Jul XX 11:59:56 20XX
Raid Level : raid6
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 4883799680 (4657.55 GiB 5001.01 GB)
Raid Devices : 7
Total Devices : 7
Preferred Minor : 0
Update Time : Tue Jul XX 13:32:24 20XX
State : clean
Active Devices : 6
Working Devices : 7
Failed Devices : 0
Spare Devices : 1
Checksum : ce8fa897 - correct
Events : 44
Layout : left-symmetric
Chunk Size : 32K
Number Major Minor RaidDevice State
this 7 8 129 7 spare /dev/sdi1
0 0 0 0 0 removed
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 spare /dev/sdi1
