I would appreciate any feedback on this as I am currently waiting before doing anything that can change the raid to prevent any further issues On Tue, Jun 1, 2010 at 7:28 AM, Eric Ramsey <tomoyodaidoji@xxxxxxxxx> wrote: > From my testing it seems the data is fine. it seems that the 400GB > that wasn't reshapen is in the expanded area. > would it be safe to just re-add the drives back into the array to get > it to restore? Or will I have issues when I start writing to the last > 400GB? > > On Tue, Jun 1, 2010 at 7:02 AM, Eric Ramsey <tomoyodaidoji@xxxxxxxxx> wrote: >> Linux The-Light 2.6.34sakura1 #1 SMP Sun May 30 02:27:44 MDT 2010 >> x86_64 GNU/Linux >> >> mdadm - v3.1.2 - 10th March 2010 >> >> On Tue, Jun 1, 2010 at 6:43 AM, Eric Ramsey <tomoyodaidoji@xxxxxxxxx> wrote: >>> My system locked up during the reshape to raid 6 and the system came >>> back in a rather odd state. 2 of the original drives were knocked out >>> of the array 400 GB short and all other drives indicate they are >>> completley synced I would not be concerned if it was the drives I was >>> expanding too. >>> SDD1 and SDE1 were the drives knocked out early, and the new drives >>> are SDG1 and SDH1. >>> I have tried to reassemble them correctly but I get the following error: >>> mdadm --assemble /dev/md1 /dev/sdd1 /dev/sde1 /dev/sdc1 /dev/sdf1 >>> /dev/sdg1 /dev/sdh1 /dev/sdi1 /dev/sdj1 /dev/sdk1 /dev/sdl1 >>> mdadm: superblock on /dev/sdc1 doesn't match others - assembly aborted >>> >>> I am testing with the raid readonly to see if I lost any data, is >>> there any other tips you guys can provide? >>> >>> /dev/sdc1: >>> Magic : a92b4efc >>> Version : 00.90.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 8 >>> Preferred Minor : 1 >>> >>> Update Time : Tue Jun 1 06:24:19 2010 >>> State : clean >>> Active Devices : 8 >>> Working Devices : 8 >>> Failed Devices : 2 >>> Spare Devices : 0 >>> Checksum : 8e7c4722 - correct >>> Events : 3009686 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 1 8 33 1 active sync /dev/sdc1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 0 0 5 faulty removed >>> 6 6 0 0 6 faulty removed >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> /dev/sdd1: >>> Magic : a92b4efc >>> Version : 00.91.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 10 >>> Preferred Minor : 1 >>> >>> Reshape pos'n : 6960011264 (6637.58 GiB 7127.05 GB) >>> Delta Devices : 2 (8->10) >>> >>> Update Time : Mon May 31 11:24:20 2010 >>> State : active >>> Active Devices : 9 >>> Working Devices : 9 >>> Failed Devices : 1 >>> Spare Devices : 0 >>> Checksum : cc00f986 - correct >>> Events : 3007985 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 6 8 49 6 active sync /dev/sdd1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 0 0 5 faulty removed >>> 6 6 8 49 6 active sync /dev/sdd1 >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> /dev/sde1: >>> Magic : a92b4efc >>> Version : 00.91.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 10 >>> Preferred Minor : 1 >>> >>> Reshape pos'n : 6960011264 (6637.58 GiB 7127.05 GB) >>> Delta Devices : 2 (8->10) >>> >>> Update Time : Mon May 31 11:21:41 2010 >>> State : active >>> Active Devices : 10 >>> Working Devices : 10 >>> Failed Devices : 0 >>> Spare Devices : 0 >>> Checksum : cc00f8d8 - correct >>> Events : 3007979 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 5 8 65 5 active sync /dev/sde1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 8 65 5 active sync /dev/sde1 >>> 6 6 8 49 6 active sync /dev/sdd1 >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> /dev/sdf1: >>> Magic : a92b4efc >>> Version : 00.90.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 8 >>> Preferred Minor : 1 >>> >>> Update Time : Tue Jun 1 06:24:19 2010 >>> State : clean >>> Active Devices : 8 >>> Working Devices : 8 >>> Failed Devices : 2 >>> Spare Devices : 0 >>> Checksum : 8e7c4756 - correct >>> Events : 3009686 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 3 8 81 3 active sync /dev/sdf1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 0 0 5 faulty removed >>> 6 6 0 0 6 faulty removed >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> /dev/sdg1: >>> Magic : a92b4efc >>> Version : 00.90.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 8 >>> Preferred Minor : 1 >>> >>> Update Time : Tue Jun 1 06:24:19 2010 >>> State : clean >>> Active Devices : 8 >>> Working Devices : 8 >>> Failed Devices : 2 >>> Spare Devices : 0 >>> Checksum : 8e7c4770 - correct >>> Events : 3009686 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 8 8 97 8 active sync /dev/sdg1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 0 0 5 faulty removed >>> 6 6 0 0 6 faulty removed >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> /dev/sdh1: >>> Magic : a92b4efc >>> Version : 00.90.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 8 >>> Preferred Minor : 1 >>> >>> Update Time : Tue Jun 1 06:24:19 2010 >>> State : clean >>> Active Devices : 8 >>> Working Devices : 8 >>> Failed Devices : 2 >>> Spare Devices : 0 >>> Checksum : 8e7c4782 - correct >>> Events : 3009686 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 9 8 113 9 active sync /dev/sdh1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 0 0 5 faulty removed >>> 6 6 0 0 6 faulty removed >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> /dev/sdi1: >>> Magic : a92b4efc >>> Version : 00.90.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 8 >>> Preferred Minor : 1 >>> >>> Update Time : Tue Jun 1 06:24:19 2010 >>> State : clean >>> Active Devices : 8 >>> Working Devices : 8 >>> Failed Devices : 2 >>> Spare Devices : 0 >>> Checksum : 8e7c478e - correct >>> Events : 3009686 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 7 8 129 7 active sync /dev/sdi1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 0 0 5 faulty removed >>> 6 6 0 0 6 faulty removed >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> /dev/sdj1: >>> Magic : a92b4efc >>> Version : 00.90.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 8 >>> Preferred Minor : 1 >>> >>> Update Time : Tue Jun 1 06:24:19 2010 >>> State : clean >>> Active Devices : 8 >>> Working Devices : 8 >>> Failed Devices : 2 >>> Spare Devices : 0 >>> Checksum : 8e7c4798 - correct >>> Events : 3009686 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 4 8 145 4 active sync /dev/sdj1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 0 0 5 faulty removed >>> 6 6 0 0 6 faulty removed >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> /dev/sdk1: >>> Magic : a92b4efc >>> Version : 00.90.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 8 >>> Preferred Minor : 1 >>> >>> Update Time : Tue Jun 1 06:24:19 2010 >>> State : clean >>> Active Devices : 8 >>> Working Devices : 8 >>> Failed Devices : 2 >>> Spare Devices : 0 >>> Checksum : 8e7c47a0 - correct >>> Events : 3009686 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 0 8 161 0 active sync /dev/sdk1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 0 0 5 faulty removed >>> 6 6 0 0 6 faulty removed >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> /dev/sdl1: >>> Magic : a92b4efc >>> Version : 00.90.00 >>> UUID : 78e59241:4bbafd48:2109fad5:2e345672 >>> Creation Time : Fri Oct 16 00:19:20 2009 >>> Raid Level : raid6 >>> Used Dev Size : 976759936 (931.51 GiB 1000.20 GB) >>> Array Size : 7814079488 (7452.09 GiB 8001.62 GB) >>> Raid Devices : 10 >>> Total Devices : 8 >>> Preferred Minor : 1 >>> >>> Update Time : Tue Jun 1 06:24:19 2010 >>> State : clean >>> Active Devices : 8 >>> Working Devices : 8 >>> Failed Devices : 2 >>> Spare Devices : 0 >>> Checksum : 8e7c47b4 - correct >>> Events : 3009686 >>> >>> Chunk Size : 64K >>> >>> Number Major Minor RaidDevice State >>> this 2 8 177 2 active sync /dev/sdl1 >>> >>> 0 0 8 161 0 active sync /dev/sdk1 >>> 1 1 8 33 1 active sync /dev/sdc1 >>> 2 2 8 177 2 active sync /dev/sdl1 >>> 3 3 8 81 3 active sync /dev/sdf1 >>> 4 4 8 145 4 active sync /dev/sdj1 >>> 5 5 0 0 5 faulty removed >>> 6 6 0 0 6 faulty removed >>> 7 7 8 129 7 active sync /dev/sdi1 >>> 8 8 8 97 8 active sync /dev/sdg1 >>> 9 9 8 113 9 active sync /dev/sdh1 >>> >> > -- To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
