AW: AW: AW: QNAP 8 port RAID5 md0 recovery of missing MBR and md superblocks

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 02/17/2014 02:10 PM, Samer, Michael (I/ET-83, extern) wrote:
>> Good morning Michael,
> 
> Hello Phil
>> On 02/17/2014 08:33 AM, Samer, Michael (I/ET-83, extern) wrote:
>>> Greetings to all
>>>
>>> As my thread from the 6.2.2014 didn't bring any hint or any reply or way out, I need >advise if my way is approved:
>>
>> I travel a lot, and didn't see your posts.  Help from someone usually
>> pops up.  Sorry it didn't work that way for you.
> 
> I'd have asked more frequently and surely the case is not FAQ.
> 
> That's the last --examine I did four weeks ago (before I recovered the part/volume table again:
> 
> /dev/sda3:
>            Magic : a92b4efc
>          Version : 0.90.00
>             UUID : 52d7d080:5c40de46:bc741f30:65cb5a0d
>    Creation Time : Sun Jan 27 23:10:25 2013
>       Raid Level : raid5
>    Used Dev Size : 1951945600 (1861.52 GiB 1998.79 GB)
>       Array Size : 13663619200 (13030.64 GiB 13991.55 GB)
>     Raid Devices : 8
>    Total Devices : 7
> Preferred Minor : 0
> 
>      Update Time : Sun Apr 21 14:14:49 2013
>            State : active
>   Active Devices : 7
> Working Devices : 7
>   Failed Devices : 1
>    Spare Devices : 0
>         Checksum : 91564c42 - correct
>           Events : 136
> 
>           Layout : left-symmetric
>       Chunk Size : 64K
> 
>        Number   Major   Minor   RaidDevice State
> this     3       8       51        3      active sync   /dev/sdd3
>
>Ok. Stop here.  This report shows /dev/sda3 where the metadata thought
>it was /dev/sdd3.  So your device names have been changing.
>
>Please redo the --examine operation on all of the /dev/sdX3 partitions
>and report again.

Here's the actual examine of the target machine (I'm using a different one so disk designation is different as the target machine has only V2.6.3 available):

/dev/sda3:
          Magic : a92b4efc
        Version : 00.90.00
           UUID : 52d7d080:5c40de46:bc741f30:65cb5a0d
  Creation Time : Sun Jan 27 23:10:25 2013
     Raid Level : raid5
  Used Dev Size : 1951945600 (1861.52 GiB 1998.79 GB)
     Array Size : 13663619200 (13030.64 GiB 13991.55 GB)
   Raid Devices : 8
  Total Devices : 7
Preferred Minor : 0

    Update Time : Sun Apr 21 14:14:49 2013
          State : active
 Active Devices : 7
Working Devices : 7
 Failed Devices : 1
  Spare Devices : 0
       Checksum : 91564c0c - correct
         Events : 0.136

         Layout : left-symmetric
     Chunk Size : 64K

      Number   Major   Minor   RaidDevice State
this     0       8        3        0      active sync   /dev/sda3

   0     0       8        3        0      active sync   /dev/sda3
   1     1       0        0        1      faulty removed
   2     2       8       35        2      active sync   /dev/sdc3
   3     3       8       51        3      active sync   /dev/sdd3
   4     4       8       67        4      active sync   /dev/sde3
   5     5       8       83        5      active sync   /dev/sdf3
   6     6       8       99        6      active sync   /dev/sdg3
   7     7       8      115        7      active sync   /dev/sdh3
/dev/sdb3:
          Magic : a92b4efc
        Version : 00.90.00
           UUID : 52d7d080:5c40de46:bc741f30:65cb5a0d
  Creation Time : Sun Jan 27 23:10:25 2013
     Raid Level : raid5
  Used Dev Size : 1951945600 (1861.52 GiB 1998.79 GB)
     Array Size : 13663619200 (13030.64 GiB 13991.55 GB)
   Raid Devices : 8
  Total Devices : 8
Preferred Minor : 0

    Update Time : Sun Apr 21 14:06:49 2013
          State : active
 Active Devices : 8
Working Devices : 8
 Failed Devices : 0
  Spare Devices : 0
       Checksum : 91564a57 - correct
         Events : 0.135

         Layout : left-symmetric
     Chunk Size : 64K

      Number   Major   Minor   RaidDevice State
this     1       8       19        1      active sync   /dev/sdb3

   0     0       8        3        0      active sync   /dev/sda3
   1     1       8       19        1      active sync   /dev/sdb3
   2     2       8       35        2      active sync   /dev/sdc3
   3     3       8       51        3      active sync   /dev/sdd3
   4     4       8       67        4      active sync   /dev/sde3
   5     5       8       83        5      active sync   /dev/sdf3
   6     6       8       99        6      active sync   /dev/sdg3
   7     7       8      115        7      active sync   /dev/sdh3
/dev/sdd3:
          Magic : a92b4efc
        Version : 00.90.00
           UUID : 52d7d080:5c40de46:bc741f30:65cb5a0d
  Creation Time : Sun Jan 27 23:10:25 2013
     Raid Level : raid5
  Used Dev Size : 1951945600 (1861.52 GiB 1998.79 GB)
     Array Size : 13663619200 (13030.64 GiB 13991.55 GB)
   Raid Devices : 8
  Total Devices : 7
Preferred Minor : 0

    Update Time : Sun Apr 21 14:14:49 2013
          State : active
 Active Devices : 7
Working Devices : 7
 Failed Devices : 1
  Spare Devices : 0
       Checksum : 91564c42 - correct
         Events : 0.136

         Layout : left-symmetric
     Chunk Size : 64K

      Number   Major   Minor   RaidDevice State
this     3       8       51        3      active sync   /dev/sdd3

   0     0       8        3        0      active sync   /dev/sda3
   1     1       0        0        1      faulty removed
   2     2       8       35        2      active sync   /dev/sdc3
   3     3       8       51        3      active sync   /dev/sdd3
   4     4       8       67        4      active sync   /dev/sde3
   5     5       8       83        5      active sync   /dev/sdf3
   6     6       8       99        6      active sync   /dev/sdg3
   7     7       8      115        7      active sync   /dev/sdh3
/dev/sde3:
          Magic : a92b4efc
        Version : 00.90.00
           UUID : 52d7d080:5c40de46:bc741f30:65cb5a0d
  Creation Time : Sun Jan 27 23:10:25 2013
     Raid Level : raid5
  Used Dev Size : 1951945600 (1861.52 GiB 1998.79 GB)
     Array Size : 13663619200 (13030.64 GiB 13991.55 GB)
   Raid Devices : 8
  Total Devices : 7
Preferred Minor : 0

    Update Time : Sun Apr 21 14:14:49 2013
          State : active
 Active Devices : 7
Working Devices : 7
 Failed Devices : 1
  Spare Devices : 0
       Checksum : 91564c54 - correct
         Events : 0.136

         Layout : left-symmetric
     Chunk Size : 64K

      Number   Major   Minor   RaidDevice State
this     4       8       67        4      active sync   /dev/sde3

   0     0       8        3        0      active sync   /dev/sda3
   1     1       0        0        1      faulty removed
   2     2       8       35        2      active sync   /dev/sdc3
   3     3       8       51        3      active sync   /dev/sdd3
   4     4       8       67        4      active sync   /dev/sde3
   5     5       8       83        5      active sync   /dev/sdf3
   6     6       8       99        6      active sync   /dev/sdg3
   7     7       8      115        7      active sync   /dev/sdh3
/dev/sdh3:
          Magic : a92b4efc
        Version : 00.90.00
           UUID : 52d7d080:5c40de46:bc741f30:65cb5a0d
  Creation Time : Sun Jan 27 23:10:25 2013
     Raid Level : raid5
  Used Dev Size : 1951945600 (1861.52 GiB 1998.79 GB)
     Array Size : 13663619200 (13030.64 GiB 13991.55 GB)
   Raid Devices : 8
  Total Devices : 7
Preferred Minor : 0

    Update Time : Sun Apr 21 14:14:49 2013
          State : active
 Active Devices : 7
Working Devices : 7
 Failed Devices : 1
  Spare Devices : 0
       Checksum : 91564c8a - correct
         Events : 0.136

         Layout : left-symmetric
     Chunk Size : 64K

      Number   Major   Minor   RaidDevice State
this     7       8      115        7      active sync   /dev/sdh3

   0     0       8        3        0      active sync   /dev/sda3
   1     1       0        0        1      faulty removed
   2     2       8       35        2      active sync   /dev/sdc3
   3     3       8       51        3      active sync   /dev/sdd3
   4     4       8       67        4      active sync   /dev/sde3
   5     5       8       83        5      active sync   /dev/sdf3
   6     6       8       99        6      active sync   /dev/sdg3
   7     7       8      115        7      active sync   /dev/sdh3

@Phil: do you think there's a chance with my crude way or is there a better one?

>Also report an excerpt of "ls -l /dev/disk/by-id/" that shows the device
>name vs. serial number for all of the drives involved.
>
>Also report kernel and mdadm versions.  The report format is an older style.
>
>Phil

Here's the additional Info (from the start):
a) Machine is a defective QNAP TS 859TS Pro 8 Port with a 2.6.x Kernel and an old 2.6.3 mdadm.
b) from a 8 disks md five failed during a few hours due to BadBlocks on five disks (beginning and end of the disk)
c) I transferred the datas via ddrescue and one (HD6 to be precise) via Kroll recovery to 24/7 RAID HDs (Seagate Constellation)
d) I saved the disks after recovery to our SAN for backup reasons (that took most time as our leased line is quite slow for such amounts
e) I recovered the partition table & volume table via testdisk on the disks where the starting area was defective
f) the Disk7 (=dev/sdg) failed after a few weeks; with the SAN Backup it was replaced by an available spare drive (WD) until I get a new one.

And here I am: three disks with no md superblock (I guess the HDs with the BB at the end of the partition).

My two platforms are always the same hardware (QNAP) just with different OS (the onboard DOM) and the newer PartedMagic2014 with Kernel 3.12.

gdisk:
GPT fdisk (gdisk) version 0.8.8

Partition table scan:
  MBR: MBR only
  BSD: not present
  APM: not present
  GPT: not present


***************************************************************
Found invalid GPT and valid MBR; converting MBR to GPT format
in memory. 
***************************************************************

Disk /dev/sda: 3907029168 sectors, 1.8 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 400394BF-E669-46BF-81F5-3DE32EBCA91E
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 3907029134
Partitions will be aligned on 8-sector boundaries
Total free space is 21157 sectors (10.3 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              40         1060289   517.7 MiB   8300  Linux filesystem
   2         1060296         2120579   517.7 MiB   8300  Linux filesystem
   3         2120584      3906011969   1.8 TiB     8300  Linux filesystem
   4      3906011976      3907007999   486.3 MiB   8300  Linux filesystem

GPT fdisk (gdisk) version 0.8.8

Partition table scan:
  MBR: MBR only
  BSD: not present
  APM: not present
  GPT: not present


***************************************************************
Found invalid GPT and valid MBR; converting MBR to GPT format
in memory. 
***************************************************************

Disk /dev/sdb: 3907029168 sectors, 1.8 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): BE3F01F4-AE41-40A2-A6D3-F84A5F2E09BF
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 3907029134
Partitions will be aligned on 8-sector boundaries
Total free space is 21157 sectors (10.3 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              40         1060289   517.7 MiB   8300  Linux filesystem
   2         1060296         2120579   517.7 MiB   8300  Linux filesystem
   3         2120584      3906011969   1.8 TiB     8300  Linux filesystem
   4      3906011976      3907007999   486.3 MiB   8300  Linux filesystem

GPT fdisk (gdisk) version 0.8.8

Partition table scan:
  MBR: MBR only
  BSD: not present
  APM: not present
  GPT: not present


***************************************************************
Found invalid GPT and valid MBR; converting MBR to GPT format
in memory. 
***************************************************************

Disk /dev/sdc: 3907029168 sectors, 1.8 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 744F0FFE-DB6E-442D-ADF1-6A9EC9B2E9DC
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 3907029134
Partitions will be aligned on 8-sector boundaries
Total free space is 21157 sectors (10.3 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              40         1060289   517.7 MiB   8300  Linux filesystem
   2         1060296         2120579   517.7 MiB   8300  Linux filesystem
   3         2120584      3906011969   1.8 TiB     8300  Linux filesystem
   4      3906011976      3907007999   486.3 MiB   8300  Linux filesystem

GPT fdisk (gdisk) version 0.8.8

Partition table scan:
  MBR: MBR only
  BSD: not present
  APM: not present
  GPT: not present


***************************************************************
Found invalid GPT and valid MBR; converting MBR to GPT format
in memory. 
***************************************************************

Disk /dev/sdd: 3907029168 sectors, 1.8 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 5150886A-F1EB-4F4D-95DE-B7125EE7AC96
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 3907029134
Partitions will be aligned on 8-sector boundaries
Total free space is 21157 sectors (10.3 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              40         1060289   517.7 MiB   8300  Linux filesystem
   2         1060296         2120579   517.7 MiB   8300  Linux filesystem
   3         2120584      3906011969   1.8 TiB     8300  Linux filesystem
   4      3906011976      3907007999   486.3 MiB   8300  Linux filesystem

GPT fdisk (gdisk) version 0.8.8

Partition table scan:
  MBR: MBR only
  BSD: not present
  APM: not present
  GPT: not present


***************************************************************
Found invalid GPT and valid MBR; converting MBR to GPT format
in memory. 
***************************************************************

Disk /dev/sde: 3907029168 sectors, 1.8 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): FB62FE34-8A10-423D-83DD-E798F84A8049
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 3907029134
Partitions will be aligned on 8-sector boundaries
Total free space is 21157 sectors (10.3 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              40         1060289   517.7 MiB   8300  Linux filesystem
   2         1060296         2120579   517.7 MiB   8300  Linux filesystem
   3         2120584      3906011969   1.8 TiB     8300  Linux filesystem
   4      3906011976      3907007999   486.3 MiB   8300  Linux filesystem

GPT fdisk (gdisk) version 0.8.8

Partition table scan:
  MBR: MBR only
  BSD: not present
  APM: not present
  GPT: not present


***************************************************************
Found invalid GPT and valid MBR; converting MBR to GPT format
in memory. 
***************************************************************

Disk /dev/sdf: 3907029168 sectors, 1.8 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 04C1A715-AED5-45BA-BE92-7F735C41D26A
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 3907029134
Partitions will be aligned on 8-sector boundaries
Total free space is 21157 sectors (10.3 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              40         1060289   517.7 MiB   8300  Linux filesystem
   2         1060296         2120579   517.7 MiB   8300  Linux filesystem
   3         2120584      3906011969   1.8 TiB     8300  Linux filesystem
   4      3906011976      3907007999   486.3 MiB   8300  Linux filesystem

GPT fdisk (gdisk) version 0.8.8

Partition table scan:
  MBR: MBR only
  BSD: not present
  APM: not present
  GPT: not present


***************************************************************
Found invalid GPT and valid MBR; converting MBR to GPT format
in memory. 
***************************************************************

Disk /dev/sdg: 3907029168 sectors, 1.8 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 951B738D-0FE6-4108-9FC9-AC564174635C
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 3907029134
Partitions will be aligned on 8-sector boundaries
Total free space is 21157 sectors (10.3 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              40         1060289   517.7 MiB   8300  Linux filesystem
   2         1060296         2120579   517.7 MiB   8300  Linux filesystem
   3         2120584      3906011969   1.8 TiB     8300  Linux filesystem
   4      3906011976      3907007999   486.3 MiB   8300  Linux filesystem

GPT fdisk (gdisk) version 0.8.8

Partition table scan:
  MBR: MBR only
  BSD: not present
  APM: not present
  GPT: not present


***************************************************************
Found invalid GPT and valid MBR; converting MBR to GPT format
in memory. 
***************************************************************

Disk /dev/sdh: 3907029168 sectors, 1.8 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 35A5BBDC-F7BB-4999-9483-9709A227201C
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 3907029134
Partitions will be aligned on 8-sector boundaries
Total free space is 21157 sectors (10.3 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              40         1060289   517.7 MiB   8300  Linux filesystem
   2         1060296         2120579   517.7 MiB   8300  Linux filesystem
   3         2120584      3906011969   1.8 TiB     8300  Linux filesystem
   4      3906011976      3907007999   486.3 MiB   8300  Linux filesystem


/EDIT: I did limit the output to one as all are the same and healthy

/dev/sda

smartctl 5.43 2012-06-30 r3573 [x86_64-linux-3.12.6-pmagic64] (local build)
Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net
=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES (SATA 6Gb/s)
Device Model:     ST2000NM0011
Serial Number:    Z1P66ZB6
LU WWN Device Id: 5 000c50 064cddf8d
Firmware Version: SN03
User Capacity:    2.000.398.934.016 bytes [2,00 TB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   8
ATA Standard is:  ATA-8-ACS revision 4
Local Time is:    Thu Feb 20 12:36:14 2014 CET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, NOT FROZEN [SEC1]

/dev/sdb
=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES (SATA 6Gb/s)
Device Model:     ST2000NM0011
Serial Number:    Z1P67P3E
LU WWN Device Id: 5 000c50 064ec8698

/dev/sdc
=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES (SATA 6Gb/s)
Device Model:     ST2000NM0011
Serial Number:    Z1P0TS13
LU WWN Device Id: 5 000c50 064e72215

/dev/sdd
=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES (SATA 6Gb/s)
Device Model:     ST2000NM0011
Serial Number:    Z1P67ZXT
LU WWN Device Id: 5 000c50 064ece0df

/dev/sde
=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES (SATA 6Gb/s)
Device Model:     ST2000NM0011
Serial Number:    Z1P0TGJN
LU WWN Device Id: 5 000c50 064e933b4

/dev/sdf
=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES (SATA 6Gb/s)
Device Model:     ST2000NM0011
Serial Number:    Z1P67PSN
LU WWN Device Id: 5 000c50 064ed507f

/dev/sdg
smartctl 5.43 2012-06-30 r3573 [x86_64-linux-3.12.6-pmagic64] (local build)
Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net
=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Caviar Black
Device Model:     WDC WD2002FAEX-007BA0
Serial Number:    WD-WCAY00228747
LU WWN Device Id: 5 0014ee 2b1bcc93d
Firmware Version: 05.01D05
User Capacity:    2.000.398.934.016 bytes [2,00 TB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   8
ATA Standard is:  Exact ATA specification draft version not indicated
Local Time is:    Thu Feb 20 12:37:54 2014 CET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, NOT FROZEN [SEC1]

/dev/sdh
=== START OF INFORMATION SECTION ===
Model Family:     Seagate Constellation ES (SATA 6Gb/s)
Device Model:     ST2000NM0011
Serial Number:    Z1P681NH
LU WWN Device Id: 5 000c50 064ec89fc


Lsdrv: 
Is not possible to run on my platforms (no direct INet connection) nor do I have a build environment for git. A binary for slackware (PartedMagic) would help :-(


Cheers
Michael
��.n��������+%������w��{.n�����{����w��ܨ}���Ơz�j:+v�����w����ޙ��&�)ߡ�a����z�ޗ���ݢj��w�f





[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux