> Date: Tue, 21 Jun 2011 16:18:18 -0400 > From: philip@xxxxxxxxxx > To: wil_c_will@xxxxxxxxxxx > CC: linux-raid@xxxxxxxxxxxxxxx > Subject: Re: reaid problem at reboot > > Hi William, > > On 06/21/2011 09:14 AM, william L'Heureux wrote: > > Hi, > > > > before we start, please note that im not a pro at mdadm or lvm, and dont now the full terminology neither the full how it works. > > That's OK. We'll help as we can. > > > 1 week ago, 1 of my raid6 went wrong. it didnt have any superblock anymore. I know all the drives that belongs to that raid but > > i > > dont know the right order of the drives. I tried a python script with > > assemble and permutation all combination possible. it then checks > > the > > header and do a e2fsck -n to check errors. Everytime i run the script i > > get several and different results on each run. Some say that > > the > > order of the drives doesnt matter, i agree but withotuh superblock its > > another story. I got another raid6 which is fine and on top of those > > 2 > > raid6, there is a lvm. if you have any question or output you want to > > see, please tell me and i will provide further informations as soon as i > > can > > if you dont understand me, i apologize, im trying to be better at english everyday. > > First, an overview of what working: Please show the output of "lsdrv". > > http://github.com/pturmel/lsdrv > > Then, some more detail: Please show "mdadm --detail /dev/md0 /dev/md1" and "mdadm --examine /dev/sd[abcdefghijkm]1" > > Finally, please show "cat /etc/lvm/backup/*" > > Phil > -- > To unsubscribe from this list: send the line "unsubscribe linux-raid" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html sorry about lsdvr but im getting an error: ./lsdrv File "./lsdrv", line 26 def __init__(self, **entries): ^ IndentationError: expected an indented block mdadm --detail /dev/md0 /dev/md1 /dev/md0: Version : 1.2 Creation Time : Tue Jun 21 11:23:46 2011 Raid Level : raid6 Array Size : 7809854976 (7448.06 GiB 7997.29 GB) Used Dev Size : 1952463744 (1862.01 GiB 1999.32 GB) Raid Devices : 6 Total Devices : 6 Persistence : Superblock is persistent Update Time : Tue Jun 21 11:23:46 2011 State : clean Active Devices : 6 Working Devices : 6 Failed Devices : 0 Spare Devices : 0 Layout : left-symmetric Chunk Size : 128K Name : BILLSSHACK:0 (local to host BILLSSHACK) UUID : 3bcf45ef:da3ede81:09a8d663:5b58832d Events : 0 Number Major Minor RaidDevice State 0 8 1 0 active sync /dev/sda1 1 8 33 1 active sync /dev/sdc1 2 8 49 2 active sync /dev/sdd1 3 8 113 3 active sync /dev/sdh1 4 8 129 4 active sync /dev/sdi1 5 8 145 5 active sync /dev/sdj1 /dev/md1: Version : 1.2 Creation Time : Tue Jun 15 09:59:08 2010 Raid Level : raid6 Array Size : 7809855488 (7448.06 GiB 7997.29 GB) Used Dev Size : 1952463872 (1862.01 GiB 1999.32 GB) Raid Devices : 6 Total Devices : 6 Persistence : Superblock is persistent Intent Bitmap : Internal Update Time : Tue Jun 14 20:58:11 2011 State : active Active Devices : 6 Working Devices : 6 Failed Devices : 0 Spare Devices : 0 Layout : left-symmetric Chunk Size : 128K Name : billsshack:3 UUID : 751fd632:4baf7d64:ec26eec1:046592bc Events : 235082 Number Major Minor RaidDevice State 0 8 161 0 active sync /dev/sdk1 1 8 17 1 active sync /dev/sdb1 8 8 193 2 active sync /dev/sdm1 5 8 81 3 active sync /dev/sdf1 6 8 65 4 active sync /dev/sde1 7 8 97 5 active sync /dev/sdg1 mdadm --examine /dev/sd[abcdefghijkm]1 /dev/sda1: Magic : a92b4efc Version : 1.2 Feature Map : 0x0 Array UUID : 3bcf45ef:da3ede81:09a8d663:5b58832d Name : BILLSSHACK:0 (local to host BILLSSHACK) Creation Time : Tue Jun 21 11:23:46 2011 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619709952 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927488 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : b6569293:759c2fbe:d52f346f:2ea85306 Update Time : Tue Jun 21 16:35:23 2011 Checksum : 9d90c200 - correct Events : 2 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 0 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdb1: Magic : a92b4efc Version : 1.2 Feature Map : 0x1 Array UUID : 751fd632:4baf7d64:ec26eec1:046592bc Name : billsshack:3 Creation Time : Tue Jun 15 09:59:08 2010 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619710976 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927744 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 0b6a5d24:bff1c401:259c054b:ca7ccc7f Internal Bitmap : 2 sectors from superblock Update Time : Tue Jun 21 16:35:23 2011 Checksum : bed09424 - correct Events : 235082 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 1 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdc1: Magic : a92b4efc Version : 1.2 Feature Map : 0x0 Array UUID : 3bcf45ef:da3ede81:09a8d663:5b58832d Name : BILLSSHACK:0 (local to host BILLSSHACK) Creation Time : Tue Jun 21 11:23:46 2011 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619709952 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927488 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 298ee23a:4968978c:0557d189:1c45ff55 Update Time : Tue Jun 21 16:35:23 2011 Checksum : 7d918966 - correct Events : 2 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 1 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdd1: Magic : a92b4efc Version : 1.2 Feature Map : 0x0 Array UUID : 3bcf45ef:da3ede81:09a8d663:5b58832d Name : BILLSSHACK:0 (local to host BILLSSHACK) Creation Time : Tue Jun 21 11:23:46 2011 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619709952 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927488 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 2b8ef61c:d3d59200:659d4367:573a992d Update Time : Tue Jun 21 16:35:23 2011 Checksum : 88ad328d - correct Events : 2 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 2 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sde1: Magic : a92b4efc Version : 1.2 Feature Map : 0x1 Array UUID : 751fd632:4baf7d64:ec26eec1:046592bc Name : billsshack:3 Creation Time : Tue Jun 15 09:59:08 2010 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619710976 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927744 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 1de7b73d:73ff1f80:c0903159:87fc8287 Internal Bitmap : 2 sectors from superblock Update Time : Tue Jun 21 16:35:23 2011 Checksum : 6c689348 - correct Events : 235082 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 4 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdf1: Magic : a92b4efc Version : 1.2 Feature Map : 0x1 Array UUID : 751fd632:4baf7d64:ec26eec1:046592bc Name : billsshack:3 Creation Time : Tue Jun 15 09:59:08 2010 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619710976 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927744 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 3247b37b:aa741693:0d58ccb6:b814a5d1 Internal Bitmap : 2 sectors from superblock Update Time : Tue Jun 21 16:35:23 2011 Checksum : 65174812 - correct Events : 235082 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 3 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdg1: Magic : a92b4efc Version : 1.2 Feature Map : 0x1 Array UUID : 751fd632:4baf7d64:ec26eec1:046592bc Name : billsshack:3 Creation Time : Tue Jun 15 09:59:08 2010 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619710976 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927744 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 8483b8f7:8c3302c6:9403a3e9:3c3a094c Internal Bitmap : 2 sectors from superblock Update Time : Tue Jun 21 16:35:23 2011 Checksum : c1431453 - correct Events : 235082 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 5 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdh1: Magic : a92b4efc Version : 1.2 Feature Map : 0x0 Array UUID : 3bcf45ef:da3ede81:09a8d663:5b58832d Name : BILLSSHACK:0 (local to host BILLSSHACK) Creation Time : Tue Jun 21 11:23:46 2011 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619709952 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927488 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 1abe5069:570c484e:2199572d:cd0d641f Update Time : Tue Jun 21 16:35:23 2011 Checksum : da9b6833 - correct Events : 2 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 3 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdi1: Magic : a92b4efc Version : 1.2 Feature Map : 0x0 Array UUID : 3bcf45ef:da3ede81:09a8d663:5b58832d Name : BILLSSHACK:0 (local to host BILLSSHACK) Creation Time : Tue Jun 21 11:23:46 2011 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619709952 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927488 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 083fa0cc:798c09bb:febe5adf:f99eb7b8 Update Time : Tue Jun 21 16:35:23 2011 Checksum : f603204f - correct Events : 2 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 4 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdj1: Magic : a92b4efc Version : 1.2 Feature Map : 0x0 Array UUID : 3bcf45ef:da3ede81:09a8d663:5b58832d Name : BILLSSHACK:0 (local to host BILLSSHACK) Creation Time : Tue Jun 21 11:23:46 2011 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619709952 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927488 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : b91a18a4:8aba8cf8:bf046c8f:f683cf16 Update Time : Tue Jun 21 16:35:23 2011 Checksum : 192754d0 - correct Events : 2 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 5 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdk1: Magic : a92b4efc Version : 1.2 Feature Map : 0x1 Array UUID : 751fd632:4baf7d64:ec26eec1:046592bc Name : billsshack:3 Creation Time : Tue Jun 15 09:59:08 2010 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619710976 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927744 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 77b91aac:68eed1cc:e2404d60:f5962abc Internal Bitmap : 2 sectors from superblock Update Time : Tue Jun 21 16:35:23 2011 Checksum : 63409f22 - correct Events : 235082 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 0 Array State : AAAAAA ('A' == active, '.' == missing) /dev/sdm1: Magic : a92b4efc Version : 1.2 Feature Map : 0x1 Array UUID : 751fd632:4baf7d64:ec26eec1:046592bc Name : billsshack:3 Creation Time : Tue Jun 15 09:59:08 2010 Raid Level : raid6 Raid Devices : 6 Avail Dev Size : 3904927887 (1862.01 GiB 1999.32 GB) Array Size : 15619710976 (7448.06 GiB 7997.29 GB) Used Dev Size : 3904927744 (1862.01 GiB 1999.32 GB) Data Offset : 2048 sectors Super Offset : 8 sectors State : clean Device UUID : 9b5a6d24:38202032:c40fc666:1f2570d7 Internal Bitmap : 2 sectors from superblock Update Time : Tue Jun 21 16:35:23 2011 Checksum : 629fcf29 - correct Events : 235082 Layout : left-symmetric Chunk Size : 128K Device Role : Active device 2 Array State : AAAAAA ('A' == active, '.' == missing) cat /etc/lvm/backup/* # Generated by LVM2 version 2.02.66(2) (2010-05-20): Sat May 21 09:40:02 2011 contents = "Text Format Volume Group" version = 1 description = "Created *after* executing 'vgcfgbackup'" creation_host = "BILLSSHACK" # Linux BILLSSHACK 2.6.35-28-generic-pae #49-Ubuntu SMP Tue Mar 1 14:58:06 UTC 2011 i686 creation_time = 1305985202 # Sat May 21 09:40:02 2011 vgDeb { id = "a6nM6t-LPKY-gMdi-9YP4-t2tv-Hqjv-aMgmEa" seqno = 10 status = ["RESIZEABLE", "READ", "WRITE"] flags = [] extent_size = 8192 # 4 Megabytes max_lv = 0 max_pv = 0 physical_volumes { pv0 { id = "0ecAby-vT4R-IHpt-5kEK-v1W0-u6AL-bUcFDG" device = "/dev/sdl2" # Hint only status = ["ALLOCATABLE"] flags = [] dev_size = 77883120 # 37.1376 Gigabytes pe_start = 384 pe_count = 9507 # 37.1367 Gigabytes } } logical_volumes { swap { id = "ywPLVh-84xx-UvPV-fUaI-PPgU-ZiTw-j6rs07" status = ["READ", "WRITE", "VISIBLE"] flags = [] segment_count = 1 segment1 { start_extent = 0 extent_count = 512 # 2 Gigabytes type = "striped" stripe_count = 1 # linear stripes = [ "pv0", 0 ] } } root { id = "x0wMox-eWu2-EmDh-V0Ix-47Zl-iqVc-fTYjVB" status = ["READ", "WRITE", "VISIBLE"] flags = [] segment_count = 1 segment1 { start_extent = 0 extent_count = 2560 # 10 Gigabytes type = "striped" stripe_count = 1 # linear stripes = [ "pv0", 512 ] } } rootu { id = "IFNTXp-4DBN-jjtc-PrCE-Mxs5-68FH-vY5QWK" status = ["READ", "WRITE", "VISIBLE"] flags = [] segment_count = 1 segment1 { start_extent = 0 extent_count = 2560 # 10 Gigabytes type = "striped" stripe_count = 1 # linear stripes = [ "pv0", 5632 ] } } } } # Generated by LVM2 version 2.02.66(2) (2010-05-20): Sat May 21 09:40:02 2011 contents = "Text Format Volume Group" version = 1 description = "Created *after* executing 'vgcfgbackup'" creation_host = "BILLSSHACK" # Linux BILLSSHACK 2.6.35-28-generic-pae #49-Ubuntu SMP Tue Mar 1 14:58:06 UTC 2011 i686 creation_time = 1305985202 # Sat May 21 09:40:02 2011 vgRAID60 { id = "RUodpI-jXin-DEjs-fS3R-4hjA-hQ4l-41dAaJ" seqno = 58 status = ["RESIZEABLE", "READ", "WRITE"] flags = [] extent_size = 8192 # 4 Megabytes max_lv = 0 max_pv = 0 physical_volumes { pv0 { id = "V5c1yI-XD3D-FXlB-VDYd-tUfo-eIUC-hXQfVW" device = "/dev/md0" # Hint only status = ["ALLOCATABLE"] flags = [] dev_size = 15619710464 # 7.27349 Terabytes pe_start = 512 pe_count = 1906702 # 7.27349 Terabytes } pv1 { id = "XRg0sr-C21F-4v2f-9FzZ-JSQr-JZe2-Tbexqf" device = "/dev/md1" # Hint only status = ["ALLOCATABLE"] flags = [] dev_size = 15619710464 # 7.27349 Terabytes pe_start = 512 pe_count = 1906702 # 7.27349 Terabytes } } logical_volumes { data0 { id = "Odw7bi-10cB-8SSX-Y4BL-wqs6-4qWT-3AHaYL" status = ["READ", "WRITE", "VISIBLE"] flags = [] segment_count = 1 segment1 { start_extent = 0 extent_count = 3670016 # 14 Terabytes type = "striped" stripe_count = 2 stripe_size = 128 # 64 Kilobytes stripes = [ "pv0", 0, "pv1", 0 ] } } } } Again, i am not a raid pro. those commands i can understand, if anywhere i make a mistake about a mdadm concept, please tell me. Nevertheless, thanks for you help William -- To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html