raid5 messed up

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I messed up my raid5 array . I know a two of HDs are "failure prediction" and one is out.. seagate is shipping me replacements.

This is my backup server so there's the actual copy of data but I'd prefer to recover the array because other data scripts/tools have crept into it ... mostly junk but would like to verify.

Here's out put as recommended at https://raid.wiki.kernel.org/index.php/Linux_Raid

Thanks in advance for any assistance,

TOm


 **************************************
cat-mdstat.txt
Personalities : [raid6] [raid5] [raid4]
md127 : inactive sdd1[1] sdh1[5] sdc1[8] sdg1[9](S) sdb1[0] sdf1[3]
      23442105036 blocks super 1.0

unused devices: <none>
 **************************************
lsdrv.log
PCI [mpt3sas]
├scsi 0:0:0:0 SEAGATE  ST4000NM0023
│└sdb 3.64t [8:16] Empty/Unknown
│ └sdb1 3.64t [8:17] Empty/Unknown
│ └md127 0.00k [9:127] MD v1.0 raid5 (7) inactive, 128k Chunk, None (None) None {None}
│                       Empty/Unknown
├scsi 0:0:1:0 SEAGATE  ST4000NM0023
│└sdc 3.64t [8:32] Empty/Unknown
│ └sdc1 3.64t [8:33] Empty/Unknown
│ └md127 0.00k [9:127] MD v1.0 raid5 (7) inactive, 128k Chunk, None (None) None {None}
│                       Empty/Unknown
├scsi 0:0:2:0 SEAGATE  ST4000NM0023
│└sdd 3.64t [8:48] Empty/Unknown
│ └sdd1 3.64t [8:49] Empty/Unknown
│ └md127 0.00k [9:127] MD v1.0 raid5 (7) inactive, 128k Chunk, None (None) None {None}
│                       Empty/Unknown
├scsi 0:0:3:0 SEAGATE  ST4000NM0023
│└sde 0.00k [8:64] Empty/Unknown
├scsi 0:0:4:0 SEAGATE  ST4000NM0023
│└sdf 3.64t [8:80] Empty/Unknown
│ └sdf1 3.64t [8:81] Empty/Unknown
│ └md127 0.00k [9:127] MD v1.0 raid5 (7) inactive, 128k Chunk, None (None) None {None}
│                       Empty/Unknown
├scsi 0:0:5:0 SEAGATE  ST4000NM0023
│└sdg 3.64t [8:96] Empty/Unknown
│ └sdg1 3.64t [8:97] Empty/Unknown
│ └md127 0.00k [9:127] MD v1.0 raid5 (7) inactive, 128k Chunk, None (None) None {None}
│                       Empty/Unknown
├scsi 0:0:6:0 SEAGATE  ST4000NM0023
│└sdh 3.64t [8:112] Empty/Unknown
│ └sdh1 3.64t [8:113] Empty/Unknown
│ └md127 0.00k [9:127] MD v1.0 raid5 (7) inactive, 128k Chunk, None (None) None {None}
│                       Empty/Unknown
├scsi 0:0:7:0 SEAGATE  ST4000NM0023
│└sdi 3.64t [8:128] Empty/Unknown
│ └sdi1 3.64t [8:129] Empty/Unknown
└scsi 0:x:x:x [Empty]
PCI [pata_atiixp]
├scsi 1:x:x:x [Empty]
└scsi 2:x:x:x [Empty]
PCI [ahci]
├scsi 3:0:0:0 PIONEER  DVD-RW  DVR-219L {KEQC279436WL}
│└sr0 1.00g [11:0] Empty/Unknown
├scsi 4:x:x:x [Empty]
├scsi 5:0:0:0 ATA      INTEL SSDSC2CW12
│└sda 111.79g [8:0] Empty/Unknown
│ ├sda1 20.00g [8:1] Empty/Unknown
│ │└Mounted as /dev/sda1 @ /
│ └sda2 91.79g [8:2] Empty/Unknown
│  └Mounted as /dev/sda2 @ /ssd
└scsi 6:x:x:x [Empty]
 **************************************
mdadm-detail.txt
/dev/md127:
           Version : 1.0
     Creation Time : Fri Aug 28 10:59:49 2015
        Raid Level : raid5
     Used Dev Size : 18446744073709551615
      Raid Devices : 7
     Total Devices : 6
       Persistence : Superblock is persistent

       Update Time : Thu Aug 31 00:59:15 2017
             State : active, FAILED, Not Started
    Active Devices : 5
   Working Devices : 6
    Failed Devices : 0
     Spare Devices : 1

            Layout : left-symmetric
        Chunk Size : 128K

Consistency Policy : unknown

              Name : any:raid5
              UUID : 2a235c2d:1ac674d3:7fd8bd23:1ff7e37b
            Events : 20211

    Number   Major   Minor   RaidDevice State
       0       8       17        0      active sync   /dev/sdb1
       1       8       49        1      active sync   /dev/sdd1
       -       0        0        2      removed
       3       8       81        3      active sync   /dev/sdf1
       8       8       33        4      active sync   /dev/sdc1
       5       8      113        5      active sync   /dev/sdh1
       -       0        0        6      removed

       9       8       97        -      spare   /dev/sdg1
 **************************************
mdadm-examine.txt
/dev/sdb1:
          Magic : a92b4efc
        Version : 1.0
    Feature Map : 0x1
     Array UUID : 2a235c2d:1ac674d3:7fd8bd23:1ff7e37b
           Name : any:raid5
  Creation Time : Fri Aug 28 10:59:49 2015
     Raid Level : raid5
   Raid Devices : 7

 Avail Dev Size : 7814033128 (3726.02 GiB 4000.78 GB)
     Array Size : 23442098688 (22356.13 GiB 24004.71 GB)
  Used Dev Size : 7814032896 (3726.02 GiB 4000.78 GB)
   Super Offset : 7814033392 sectors
   Unused Space : before=0 sectors, after=472 sectors
          State : clean
    Device UUID : fdd6f8fc:316b273c:78ae65ed:9b779577

Internal Bitmap : -24 sectors from superblock
    Update Time : Thu Aug 31 00:59:15 2017
  Bad Block Log : 512 entries available at offset -8 sectors
       Checksum : ab3cc85c - correct
         Events : 20211

         Layout : left-symmetric
     Chunk Size : 128K

   Device Role : Active device 0
   Array State : AA.AAA. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc1:
          Magic : a92b4efc
        Version : 1.0
    Feature Map : 0x1
     Array UUID : 2a235c2d:1ac674d3:7fd8bd23:1ff7e37b
           Name : any:raid5
  Creation Time : Fri Aug 28 10:59:49 2015
     Raid Level : raid5
   Raid Devices : 7

 Avail Dev Size : 7814036816 (3726.02 GiB 4000.79 GB)
     Array Size : 23442098688 (22356.13 GiB 24004.71 GB)
  Used Dev Size : 7814032896 (3726.02 GiB 4000.78 GB)
   Super Offset : 7814037080 sectors
   Unused Space : before=0 sectors, after=4160 sectors
          State : clean
    Device UUID : 584fb131:a049ae6c:0ac2150d:d3a66665

Internal Bitmap : -24 sectors from superblock
    Update Time : Thu Aug 31 00:59:15 2017
  Bad Block Log : 512 entries available at offset -8 sectors
       Checksum : 1dfd7ec7 - correct
         Events : 20211

         Layout : left-symmetric
     Chunk Size : 128K

   Device Role : Active device 4
   Array State : AA.AAA. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdd1:
          Magic : a92b4efc
        Version : 1.0
    Feature Map : 0x1
     Array UUID : 2a235c2d:1ac674d3:7fd8bd23:1ff7e37b
           Name : any:raid5
  Creation Time : Fri Aug 28 10:59:49 2015
     Raid Level : raid5
   Raid Devices : 7

 Avail Dev Size : 7814036816 (3726.02 GiB 4000.79 GB)
     Array Size : 23442098688 (22356.13 GiB 24004.71 GB)
  Used Dev Size : 7814032896 (3726.02 GiB 4000.78 GB)
   Super Offset : 7814037080 sectors
   Unused Space : before=0 sectors, after=4160 sectors
          State : clean
    Device UUID : e5105c14:b165df48:a1c06442:dfb7b075

Internal Bitmap : -24 sectors from superblock
    Update Time : Thu Aug 31 00:59:15 2017
  Bad Block Log : 512 entries available at offset -8 sectors
       Checksum : 22726c01 - correct
         Events : 20211

         Layout : left-symmetric
     Chunk Size : 128K

   Device Role : Active device 1
   Array State : AA.AAA. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdf1:
          Magic : a92b4efc
        Version : 1.0
    Feature Map : 0x1
     Array UUID : 2a235c2d:1ac674d3:7fd8bd23:1ff7e37b
           Name : any:raid5
  Creation Time : Fri Aug 28 10:59:49 2015
     Raid Level : raid5
   Raid Devices : 7

 Avail Dev Size : 7814033128 (3726.02 GiB 4000.78 GB)
     Array Size : 23442098688 (22356.13 GiB 24004.71 GB)
  Used Dev Size : 7814032896 (3726.02 GiB 4000.78 GB)
   Super Offset : 7814033392 sectors
   Unused Space : before=0 sectors, after=472 sectors
          State : clean
    Device UUID : c0cbff05:4b24998c:4f1d290b:26cc9c6a

Internal Bitmap : -24 sectors from superblock
    Update Time : Thu Aug 31 00:59:15 2017
  Bad Block Log : 512 entries available at offset -8 sectors
       Checksum : 1580399d - correct
         Events : 20211

         Layout : left-symmetric
     Chunk Size : 128K

   Device Role : Active device 3
   Array State : AA.AAA. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdg1:
          Magic : a92b4efc
        Version : 1.0
    Feature Map : 0x9
     Array UUID : 2a235c2d:1ac674d3:7fd8bd23:1ff7e37b
           Name : any:raid5
  Creation Time : Fri Aug 28 10:59:49 2015
     Raid Level : raid5
   Raid Devices : 7

 Avail Dev Size : 7814033368 (3726.02 GiB 4000.79 GB)
     Array Size : 23442098688 (22356.13 GiB 24004.71 GB)
  Used Dev Size : 7814032896 (3726.02 GiB 4000.78 GB)
   Super Offset : 7814033392 sectors
   Unused Space : before=0 sectors, after=472 sectors
          State : clean
    Device UUID : 7896d45b:b7037e5d:e30ea8fc:d3f0503c

Internal Bitmap : -24 sectors from superblock
    Update Time : Thu Aug 31 00:59:15 2017
Bad Block Log : 512 entries available at offset -8 sectors - bad blocks present.
       Checksum : ff6cfb00 - correct
         Events : 20211

         Layout : left-symmetric
     Chunk Size : 128K

   Device Role : spare
   Array State : AA.AAA. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdh1:
          Magic : a92b4efc
        Version : 1.0
    Feature Map : 0x1
     Array UUID : 2a235c2d:1ac674d3:7fd8bd23:1ff7e37b
           Name : any:raid5
  Creation Time : Fri Aug 28 10:59:49 2015
     Raid Level : raid5
   Raid Devices : 7

 Avail Dev Size : 7814036816 (3726.02 GiB 4000.79 GB)
     Array Size : 23442098688 (22356.13 GiB 24004.71 GB)
  Used Dev Size : 7814032896 (3726.02 GiB 4000.78 GB)
   Super Offset : 7814037080 sectors
   Unused Space : before=0 sectors, after=4160 sectors
          State : clean
    Device UUID : 11314133:cb254486:61591214:7e382352

Internal Bitmap : -24 sectors from superblock
    Update Time : Thu Aug 31 00:59:15 2017
  Bad Block Log : 512 entries available at offset -8 sectors
       Checksum : 2cdc65aa - correct
         Events : 20211

         Layout : left-symmetric
     Chunk Size : 128K

   Device Role : Active device 5
   Array State : AA.AAA. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdi1:
          Magic : a92b4efc
        Version : 1.0
    Feature Map : 0x9
     Array UUID : 2a235c2d:1ac674d3:7fd8bd23:1ff7e37b
           Name : any:raid5
  Creation Time : Fri Aug 28 10:59:49 2015
     Raid Level : raid5
   Raid Devices : 7

 Avail Dev Size : 7814036816 (3726.02 GiB 4000.79 GB)
     Array Size : 23442098688 (22356.13 GiB 24004.71 GB)
  Used Dev Size : 7814032896 (3726.02 GiB 4000.78 GB)
   Super Offset : 7814037080 sectors
   Unused Space : before=0 sectors, after=4160 sectors
          State : clean
    Device UUID : b89e3aad:88e3459e:6a1131a0:2136e318

Internal Bitmap : -24 sectors from superblock
    Update Time : Thu Aug 31 00:56:04 2017
Bad Block Log : 512 entries available at offset -8 sectors - bad blocks present.
       Checksum : 11c2a904 - correct
         Events : 20187

         Layout : left-symmetric
     Chunk Size : 128K

   Device Role : Active device 6
   Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
 **************************************
smartctl.log
  **** /dev/sdb ***
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.4.79-19-default] (SUSE RPM)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               SEAGATE
Product:              ST4000NM0023
Revision:             0004
Compliance:           SPC-4
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000c5007408192f
Serial number:        Z1Z4NYQ40000C45018BF
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Fri Sep  1 14:00:46 2017 CDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

  **** /dev/sdc ***
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.4.79-19-default] (SUSE RPM)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               SEAGATE
Product:              ST4000NM0023
Revision:             0004
Compliance:           SPC-4
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000c50074219767
Serial number:        Z1Z2JCK6000094175KML
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Fri Sep  1 14:00:46 2017 CDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

  **** /dev/sdd ***
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.4.79-19-default] (SUSE RPM)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               SEAGATE
Product:              ST4000NM0023
Revision:             0004
Compliance:           SPC-4
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000c500560462f3
Serial number:        Z1Z0APPP0000931601QK
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Fri Sep  1 14:00:46 2017 CDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

  **** /dev/sde ***
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.4.79-19-default] (SUSE RPM)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               SEAGATE
Product:              ST4000NM0023
Revision:             0004
Compliance:           SPC-4
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000c50056055c0b
Serial number:        Z1Z0AXBZ0000931612Q8
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Fri Sep  1 14:00:46 2017 CDT
device is NOT READY (e.g. spun down, busy)
A mandatory SMART command failed: exiting. To continue, add one or more '-T permissive' options.
  **** /dev/sdf ***
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.4.79-19-default] (SUSE RPM)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               SEAGATE
Product:              ST4000NM0023
Revision:             0004
Compliance:           SPC-4
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000c5005d7d83bf
Serial number:        Z1Z3754K0000C42685HC
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Fri Sep  1 14:00:46 2017 CDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

  **** /dev/sdg ***
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.4.79-19-default] (SUSE RPM)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               SEAGATE
Product:              ST4000NM0023
Revision:             0006
Compliance:           SPC-4
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000c5008d70f983
Serial number:        Z1Z8L3760000C5407BQU
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Fri Sep  1 14:00:47 2017 CDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

  **** /dev/sdh ***
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.4.79-19-default] (SUSE RPM)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               SEAGATE
Product:              ST4000NM0023
Revision:             0004
Compliance:           SPC-4
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000c500560559bb
Serial number:        Z1Z0AXFK0000931612EY
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Fri Sep  1 14:00:47 2017 CDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: FAILURE PREDICTION THRESHOLD EXCEEDED: ascq=0x5 [asc=5d, ascq=5]

  **** /dev/sdi ***
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.4.79-19-default] (SUSE RPM)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               SEAGATE
Product:              ST4000NM0023
Revision:             0004
Compliance:           SPC-4
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000c50056055ddb
Serial number:        Z1Z0AXA20000931723JE
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Fri Sep  1 14:00:47 2017 CDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: FAILURE PREDICTION THRESHOLD EXCEEDED: ascq=0x5 [asc=5d, ascq=5]

gua admin3/RAID5#

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux