Hi all,
I had a problem that caused my Ubuntu Server 14 to go down, and it now
will not boot. I added a drive to my raid1 (/dev/md0 -> /boot) + raid6
(/dev/md2 -> /) setup. I was previously running with /dev/md0 (raid1)
assembled from /dev/sd[a-f]1, and /dev/md2 (raid6) assembled
/dev/sd[a-f]3. Both partitions from the new drive were successfully
added to the two md arrays, and the raid1 (the smaller of the two)
resync'd successfully it seemed (I think that resync is the correct word
to use, meaning that mdadm is spreading out the data amongst the drives
once an array has been grown). When resyncing the larger raid6,
however, the sync speed was quite slow (kb's/sec), and got slower and
slower (7kb/sec... 5kb/sec... 3kb/sec... 1kb/sec...) until the system
entirely halted and I eventually turned the power off. It now will not
boot.
Thanks to Roger Heflin's help, I've booted into a livecd environment
(ubuntu server 18) with all the necessary raid personalities available.
When trying to --assemble md127 (raid6), i get the following error:
"Failure to restore critical section for reshape, sorry. Perhaps you
needed to specify the --backup-file". Needless to say, I didn't save a
backup file when adding the drive.
I have attached some diagnostic output here. It seems that my raid6
array is not being recognized as such. I'm not sure what the next steps
are - do I need to figure out how to get the resync up and running
again? Any help would be greatly appreciated.
Many thanks,
Allie
Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5] [raid4] [raid10]
md127 : inactive sdd3[5](S) sdf3[8](S) sdc3[2](S) sdg3[9](S) sde3[7](S) sdb3[4](S) sda3[6](S)
20441322496 blocks super 1.2
md126 : active (auto-read-only) raid1 sdf1[8] sde1[7] sdg1[9] sda1[6] sdd1[5] sdc1[2] sdb1[4]
1950656 blocks super 1.2 [7/7] [UUUUUUU]
unused devices: <none>
Disk /dev/loop0: 265.3 MiB, 278147072 bytes, 543256 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/loop1: 70.1 MiB, 73531392 bytes, 143616 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/loop2: 49.7 MiB, 52060160 bytes, 101680 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/loop3: 36 MiB, 37707776 bytes, 73648 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/loop4: 27.4 MiB, 28717056 bytes, 56088 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/loop5: 89.1 MiB, 93417472 bytes, 182456 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/loop6: 51.9 MiB, 54358016 bytes, 106168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/loop7: 51.9 MiB, 54407168 bytes, 106264 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/sda: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: gpt
Disk identifier: D607CD2D-05F4-42C6-914C-B99CE56E934F
Device Start End Sectors Size Type
/dev/sda1 2048 3905535 3903488 1.9G Linux RAID
/dev/sda2 3905536 3907583 2048 1M BIOS boot
/dev/sda3 3907584 5844547583 5840640000 2.7T Linux RAID
/dev/sda4 5844547584 5860532223 15984640 7.6G Linux filesystem
Disk /dev/sdb: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: gpt
Disk identifier: D96D7513-3D74-435B-8B2F-26C2A32B0586
Device Start End Sectors Size Type
/dev/sdb1 2048 3905535 3903488 1.9G Linux RAID
/dev/sdb2 3905536 3907583 2048 1M BIOS boot
/dev/sdb3 3907584 5844547583 5840640000 2.7T Linux RAID
/dev/sdb4 5844547584 5860532223 15984640 7.6G Linux filesystem
Disk /dev/sdc: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: gpt
Disk identifier: 4B356AFA-8F48-4227-86F0-329565146D7A
Device Start End Sectors Size Type
/dev/sdc1 2048 3905535 3903488 1.9G Linux RAID
/dev/sdc2 3905536 3907583 2048 1M BIOS boot
/dev/sdc3 3907584 5844547583 5840640000 2.7T Linux RAID
/dev/sdc4 5844547584 5860532223 15984640 7.6G Linux filesystem
Disk /dev/sdd: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: gpt
Disk identifier: D4D1E2EB-8520-4B3E-8263-AB5B5BD2D7E2
Device Start End Sectors Size Type
/dev/sdd1 2048 3905535 3903488 1.9G Linux RAID
/dev/sdd2 3905536 3907583 2048 1M BIOS boot
/dev/sdd3 3907584 5844547583 5840640000 2.7T Linux RAID
/dev/sdd4 5844547584 5860532223 15984640 7.6G Linux filesystem
Disk /dev/sde: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: gpt
Disk identifier: 52F044AB-9D50-4363-BF60-651A87159A17
Device Start End Sectors Size Type
/dev/sde1 2048 3905535 3903488 1.9G Linux RAID
/dev/sde2 3905536 3907583 2048 1M BIOS boot
/dev/sde3 3907584 5844547583 5840640000 2.7T Linux RAID
/dev/sde4 5844547584 5860532223 15984640 7.6G Linux filesystem
Disk /dev/sdg: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: gpt
Disk identifier: BE2DDABE-9106-4436-8ABC-6A919EBFB2E6
Device Start End Sectors Size Type
/dev/sdg1 2048 3905535 3903488 1.9G Linux RAID
/dev/sdg2 3905536 3907583 2048 1M BIOS boot
/dev/sdg3 3907584 5844547583 5840640000 2.7T Linux RAID
/dev/sdg4 5844547584 5860532223 15984640 7.6G Linux filesystem
Disk /dev/sdf: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: gpt
Disk identifier: 36615F7D-974F-4A0B-B79B-165D872EF418
Device Start End Sectors Size Type
/dev/sdf1 2048 3905535 3903488 1.9G Linux RAID
/dev/sdf2 3905536 3907583 2048 1M BIOS boot
/dev/sdf3 3907584 5844547583 5840640000 2.7T Linux RAID
/dev/sdf4 5844547584 5860532223 15984640 7.6G Linux filesystem
Disk /dev/md126: 1.9 GiB, 1997471744 bytes, 3901312 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk /dev/sdh: 29.2 GiB, 31376707072 bytes, 61282631 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x00f674a6
Device Boot Start End Sectors Size Id Type
/dev/sdh1 * 2048 61282630 61280583 29.2G c W95 FAT32 (LBA)
Disk /dev/sdi: 15 GiB, 16106127360 bytes, 31457280 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x00e19bdc
Device Boot Start End Sectors Size Id Type
/dev/sdi1 * 2048 31457279 31455232 15G c W95 FAT32 (LBA)
