>> Maybe assemble command should include sdj3 device too?
>> Like
>> # mdadm -v --assemble --update=revert-reshape /dev/md3 /dev/sd[a-j]3
>> not
>> # mdadm -v --assemble --update=revert-reshape /dev/md3 /dev/sd[a-i]3
>
> Yes, my mistake. :-( Try again, including 'sdj3'.
>
> Phil
# mdadm -v --assemble --update=revert-reshape /dev/md3 /dev/sd[a-j]3
mdadm: looking for devices for /dev/md3
mdadm: superblock on /dev/sdj3 doesn't match others - assembly aborted
# mdadm -v --assemble --update=revert-reshape --force /dev/md3 /dev/sd[a-j]3
mdadm: looking for devices for /dev/md3
mdadm: superblock on /dev/sdj3 doesn't match others - assembly aborted
Note, that --examine in previous message shows delta devices value "-1" for
all members of array, excepting sdj3, which has value "1", without minus
symbol.
According to mdadm wiki 1.2v superblock placed on device after first 4K and
has size 256 Bytes, plus 2 Bytes per device in the array, in current case
this is 276 Bytes. Dumping superblock:
# for i in /dev/sd?3; do dd ibs=1c skip=4000 count=276 if=$i of=`echo $i | tr -d /`-superblock.raw; done
# for i in devsd*.raw; do echo -e "\n$i" && hd -v $i; done > superblock-dump-000.txt
devsda3-superblock.raw
00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |.............(..|
000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 0e 00 00 00 00 00 00 00 c0 15 52 14 a9 c8 e3 78 |..........R....x|
00000110 d3 68 b6 f6 |.h..|
00000114
devsdb3-superblock.raw
00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |.............(..|
000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 06 00 00 00 00 00 00 00 37 5d 85 e2 90 77 dd 68 |........7]...w.h|
00000110 bc 13 27 af |..'.|
00000114
devsdc3-superblock.raw
00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |.............(..|
000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 0b 00 00 00 00 00 00 00 67 cd 2b fa af fa 57 8c |........g.+...W.|
00000110 e0 c1 28 6a |..(j|
00000114
devsdd3-superblock.raw
00000000 4e fc 4f 03 50 51 50 4e fe 4f 02 50 4e 4e fe 4f |N.O.PQPN.O.PNN.O|
00000010 ff 4b ff 49 1b 4a 4e 4d 4a 4d 4b 4c 49 4a 46 47 |.K.I.JNMJMKLIJFG|
00000020 47 49 48 49 48 47 46 45 45 46 46 45 47 48 46 48 |GIHIHGFEEFFEGHFH|
00000030 46 fe 45 fe 46 00 42 fe 46 08 44 45 44 47 46 46 |F.E.F.B.F.DEDGFF|
00000040 45 45 46 fd 45 05 46 45 46 46 45 45 fc 46 03 45 |EEF.E.FEFFEE.F.E|
00000050 46 46 45 fc 46 13 45 44 46 45 44 46 45 45 46 45 |FFE.F.EDFEDFEEFE|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |.............(..|
000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 04 00 00 00 00 00 00 00 44 90 84 3e d2 c5 c2 e7 |........D..>....|
00000110 d2 22 fa 0a |."..|
00000114
devsde3-superblock.raw
00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |.............(..|
000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 05 00 00 00 00 00 00 00 1d 41 05 6f 88 14 9b 1a |.........A.o....|
00000110 48 e9 39 e5 |H.9.|
00000114
devsdf3-superblock.raw
00000000 3c 39 37 39 3a 3a 39 38 36 39 38 37 34 35 35 36 |<979::9869874556|
00000010 36 31 37 35 35 31 31 35 36 31 34 35 37 35 35 37 |6175511561457557|
00000020 37 35 31 36 36 35 37 38 36 35 34 38 37 37 35 39 |7516657865487759|
00000030 3a 37 3a 3b ff 38 09 3b 3a 3a 3b 3a 3d 3b 3c 3c |:7:;.8.;::;:=;<<|
00000040 40 fe 3d fc 41 03 45 43 43 41 fe 43 ff 46 02 45 |@.=.A.ECCA.C.F.E|
00000050 48 48 fa 4a 14 4b 4a 4e 4a 4d 4d 4f 4f 4e 4e 51 |HH.J.KJNJMMOONNQ|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |.............(..|
000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 00 00 00 00 00 00 00 00 fa 7c 54 1d a2 5b ab d8 |.........|T..[..|
00000110 14 ff e1 c0 |....|
00000114
devsdg3-superblock.raw
00000000 5e 75 7c 7f 74 7b 81 8a 97 a0 a8 af b0 be c6 da |^u|.t{..........|
00000010 e5 e9 f2 f3 f6 f7 f2 ef ee ed e9 e7 e8 e8 e3 de |................|
00000020 df e1 df e0 da de e2 e0 df d9 dc d5 d3 ce d3 d3 |................|
00000030 d1 ce cb 07 d2 d5 d7 d7 da d7 d7 db fe da 4a d9 |..............J.|
00000040 d6 d6 d5 d5 d6 d2 ce cc d2 d1 cf d0 d2 d4 d9 db |................|
00000050 db dc da db da da d8 da da d7 cf d3 cf ce ce d2 |................|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |.............(..|
000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 03 00 00 00 00 00 00 00 a4 b8 b4 25 b0 30 7f e5 |...........%.0..|
00000110 9e b8 e3 ac |....|
00000114
devsdh3-superblock.raw
00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |.............(..|
000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 02 00 00 00 00 00 00 00 34 5b 02 12 6c 3a 0a e8 |........4[..l:..|
00000110 d8 ed 92 73 |...s|
00000114
devsdi3-superblock.raw
00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |.............(..|
000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 0c 00 00 00 00 00 00 00 70 af da ad b0 97 9f b1 |........p.......|
00000110 1b 99 ef 18 |....|
00000114
devsdj3-superblock.raw
00000000 8b f5 bf f2 9f 03 b5 cb fd 29 28 17 15 d9 c5 6a |.........)(....j|
00000010 37 52 cb f3 72 47 43 45 3c 44 23 33 2e d2 de fa |7R..rGCE<D#3....|
00000020 e1 d6 e4 da fb f1 7e c9 ec 0c ea e1 c9 f0 f2 f2 |......~.........|
00000030 db cd c9 2f 3a 70 d1 2a ed a0 d0 d1 f9 da 4c cd |.../:p.*......L.|
00000040 b7 05 f1 cb 2d ad 6b b9 db 39 54 8a 92 cb 90 72 |....-.k..9T....r|
00000050 3c 67 65 43 90 fa ba ba b0 b7 dd b4 af a4 a1 b1 |<geC............|
00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.......|
00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|..*..N|
00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3........|
00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S............|
000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0b 00 00 00 |................|
000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |................|
000000d0 01 00 00 00 02 00 00 00 00 04 00 00 00 d8 ff ff |................|
000000e0 00 00 04 00 00 00 00 00 8f be dc d0 01 00 00 00 |................|
000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
00000100 0a 00 00 00 00 00 00 00 a5 f2 ce a8 a8 9c 88 a0 |................|
00000110 0d d3 90 0c |....|
00000114
END OF MESSAGE
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
