Hello all,
today I tried to grow a RAID 5 from 4 to 5 disks but failed to do so.
The additional disk was prepared by writing a gpt disklabel using parted on it, creating a primary partition and setting
raid to "on".
Then I added it to the array and tried to grow it using
# mdadm /dev/md0 --add /dev/sdc1
# mdadm --grow --raid-devices=5 /dev/md0 --backup-file=/root/md0.bak
/proc/mdstat showed an increasing ETA with 0kb/s progress.
Then I noticed, that I accidentially inserted the new disk into the server on-line, only rebooting the virtual machine
(which has direct access to the SATA-controller, as it is passed through) and not the host...
After that I rebooted the VM-Host (XenServer). The VM didn't boot, because it failed to mount a filesystem, which is
located on a LVM which is on top of the RAID.
After disabling the fstab entry, the system booted up again. But now the md0 gets assembles with all devices marked as
spares.
Trying to reassemble the RAID fails:
# mdadm --assemble --scan
mdadm: Failed to restore critical section for reshape, sorry.
Possibly you needed to specify the --backup-file
I tried passing the /root/md0.bak file as --backup-file, but it still doesn't work.
>From that point on, all actions were performed on a snapshot of the underlying partitions.
Maybe somebody is able to guide me how to reassemble my array without losing too much data?
Thanks in advance,
Christian
Some diagnostic output follows:
$ uname -a
Linux storage 4.9.0-6-amd64 #1 SMP Debian 4.9.88-1+deb9u1 (2018-05-07) x86_64 GNU/Linux
$ cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]
md0 : inactive sdb1[4](S) sde1[3](S) sdd1[1](S) sdc1[5](S) sda1[0](S)
29301957120 blocks super 1.2
unused devices: <none>
# mdadm --detail /dev/md0
/dev/md0:
Version : 1.2
Raid Level : raid0
Total Devices : 5
Persistence : Superblock is persistent
State : inactive
Delta Devices : 1, (-1->0)
New Level : raid5
New Layout : left-symmetric
New Chunksize : 512K
Name : storage:0 (local to host storage)
UUID : 27bb05aa:ba069dde:d81867fd:db132c9c
Events : 100541
Number Major Minor RaidDevice
- 8 65 - /dev/sde1
- 8 49 - /dev/sdd1
- 8 33 - /dev/sdc1
- 8 17 - /dev/sdb1
- 8 1 - /dev/sda1
# mdadm -E /dev/mapper/sd*
/dev/mapper/sda1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 27bb05aa:ba069dde:d81867fd:db132c9c
Name : storage:0 (local to host storage)
Creation Time : Sun Apr 1 12:59:08 2018
Raid Level : raid5
Raid Devices : 5
Avail Dev Size : 11720782848 (5588.90 GiB 6001.04 GB)
Array Size : 23441565696 (22355.62 GiB 24004.16 GB)
Data Offset : 259072 sectors
Super Offset : 8 sectors
Unused Space : before=258984 sectors, after=0 sectors
State : clean
Device UUID : e37aa3ee:b6e16a45:7d84b9fb:14cddefb
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (4->5)
Update Time : Tue Jul 17 12:47:42 2018
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : cefdae09 - correct
Events : 100541
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/mapper/sdb1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 27bb05aa:ba069dde:d81867fd:db132c9c
Name : storage:0 (local to host storage)
Creation Time : Sun Apr 1 12:59:08 2018
Raid Level : raid5
Raid Devices : 5
Avail Dev Size : 11720782848 (5588.90 GiB 6001.04 GB)
Array Size : 23441565696 (22355.62 GiB 24004.16 GB)
Data Offset : 259072 sectors
Super Offset : 8 sectors
Unused Space : before=258984 sectors, after=0 sectors
State : clean
Device UUID : ff4716e9:60abc588:233da2c6:2b879076
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (4->5)
Update Time : Tue Jul 17 12:47:42 2018
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 5265b790 - correct
Events : 100541
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 3
Array State : AAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/mapper/sdc1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 27bb05aa:ba069dde:d81867fd:db132c9c
Name : storage:0 (local to host storage)
Creation Time : Sun Apr 1 12:59:08 2018
Raid Level : raid5
Raid Devices : 5
Avail Dev Size : 11720782848 (5588.90 GiB 6001.04 GB)
Array Size : 23441565696 (22355.62 GiB 24004.16 GB)
Data Offset : 259072 sectors
Super Offset : 8 sectors
Unused Space : before=258984 sectors, after=0 sectors
State : clean
Device UUID : 33aaa54e:1bc02472:a58e6572:c5d56acf
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (4->5)
Update Time : Tue Jul 17 12:47:42 2018
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : a5f1ce9b - correct
Events : 100541
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 4
Array State : AAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/mapper/sdd1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 27bb05aa:ba069dde:d81867fd:db132c9c
Name : storage:0 (local to host storage)
Creation Time : Sun Apr 1 12:59:08 2018
Raid Level : raid5
Raid Devices : 5
Avail Dev Size : 11720782848 (5588.90 GiB 6001.04 GB)
Array Size : 23441565696 (22355.62 GiB 24004.16 GB)
Data Offset : 259072 sectors
Super Offset : 8 sectors
Unused Space : before=258984 sectors, after=0 sectors
State : clean
Device UUID : 93ce9e37:981922fe:48256400:d2631d8a
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (4->5)
Update Time : Tue Jul 17 12:47:42 2018
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 63997124 - correct
Events : 100541
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/mapper/sde1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 27bb05aa:ba069dde:d81867fd:db132c9c
Name : storage:0 (local to host storage)
Creation Time : Sun Apr 1 12:59:08 2018
Raid Level : raid5
Raid Devices : 5
Avail Dev Size : 11720782848 (5588.90 GiB 6001.04 GB)
Array Size : 23441565696 (22355.62 GiB 24004.16 GB)
Data Offset : 259072 sectors
Super Offset : 8 sectors
Unused Space : before=258984 sectors, after=0 sectors
State : clean
Device UUID : e31f6b4a:e27986a2:7e246e7b:361123cf
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (4->5)
Update Time : Tue Jul 17 12:47:42 2018
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : dad9cf5a - correct
Events : 100541
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : AAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
