Failed to grow

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello every one,

I have a huge problem. I started to grow a array with ( the added device is /dev/sde )
# mdadm --grow --raid-devices=13 /dev/md0 --backup-file=md0.bak

after that there way 0 disk activity so i checked it with
# cat /proc/mdstat

everything looked fine but speed was 0K/sec for about 1-2 hours. I decided to reboot the system as grow should continue after that. After that the array wasn't assembled at all. So i wanted to do it myself:

# mdadm --assemble /dev/md0 /dev/sd[b-n] --backup-file=md0.bak --verbose
mdadm: looking for devices for /dev/md0
mdadm: /dev/sdb is identified as a member of /dev/md0, slot 0.
mdadm: /dev/sdc is identified as a member of /dev/md0, slot 1.
mdadm: /dev/sdd is identified as a member of /dev/md0, slot 10.
mdadm: /dev/sde is identified as a member of /dev/md0, slot 12.
mdadm: /dev/sdf is identified as a member of /dev/md0, slot 11.
mdadm: /dev/sdg is identified as a member of /dev/md0, slot 2.
mdadm: /dev/sdh is identified as a member of /dev/md0, slot 3.
mdadm: /dev/sdi is identified as a member of /dev/md0, slot 4.
mdadm: /dev/sdj is identified as a member of /dev/md0, slot 5.
mdadm: /dev/sdk is identified as a member of /dev/md0, slot 6.
mdadm: /dev/sdl is identified as a member of /dev/md0, slot 7.
mdadm: /dev/sdm is identified as a member of /dev/md0, slot 8.
mdadm: /dev/sdn is identified as a member of /dev/md0, slot 9.
mdadm: :/dev/md0 has an active reshape - checking if critical section needs to be restored
mdadm: No backup metadata on md0.bak
mdadm: No backup metadata on device-12
mdadm: Failed to find backup of critical section
mdadm: Failed to restore critical section for reshape, sorry.

Backup looks broken. What can i do ?

# mdadm --version
mdadm - v3.3.2 - 21st August 2014

# uname -a
Linux claw-storage 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt11-1+deb8u3 (2015-08-04) x86_64 GNU/Linux

# du -sch md0.bak
56M     md0.bak

# mdadm --examine /dev/sd[b-n]
/dev/sdb:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 3906767024 (1862.89 GiB 2000.26 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=976752816 sectors
          State : clean
    Device UUID : f3d9392c:a9290f8e:4ded7efc:284b4ecf

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : 11cb12c0 - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 0
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 3906767024 (1862.89 GiB 2000.26 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=976752816 sectors
          State : clean
    Device UUID : a5b4533d:d5a4cdc5:e6dcd3aa:4a845044

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : 7dfa9159 - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 1
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdd:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 3906767024 (1862.89 GiB 2000.26 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=976752816 sectors
          State : clean
    Device UUID : d39aede2:af92f321:8b6fbd9f:45c73ddf

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : f913b0b - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 10
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sde:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 3906767024 (1862.89 GiB 2000.26 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=976752816 sectors
          State : clean
    Device UUID : 13fcdab1:69ce4358:5f1ee2b2:c809b990

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : d976c9a6 - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 12
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdf:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 3906767024 (1862.89 GiB 2000.26 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=976752816 sectors
          State : clean
    Device UUID : 487f70bd:b63c29d6:185aa418:208dc16d

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : a5b479ef - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 11
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdg:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 2930015024 (1397.14 GiB 1500.17 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=816 sectors
          State : clean
    Device UUID : b798e990:6b50f1a0:3cde1ced:3a20dfaf

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : 2053b0c9 - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 2
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdh:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 2930015024 (1397.14 GiB 1500.17 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=816 sectors
          State : clean
    Device UUID : bfe03a04:fda138cc:ef11727c:ff1b58d2

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : 70ba79db - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 3
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdi:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 3906767024 (1862.89 GiB 2000.26 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=976752816 sectors
          State : clean
    Device UUID : 4fdb8a05:3157bd26:f93ee8d7:fdd42f9f

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : 2f151d28 - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 4
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdj:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 2930015024 (1397.14 GiB 1500.17 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=816 sectors
          State : clean
    Device UUID : 6010b774:e02b08ed:29484f97:b03e8a48

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : 93158c4c - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 5
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdk:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 2930015024 (1397.14 GiB 1500.17 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=816 sectors
          State : clean
    Device UUID : afab65ff:a79ed9e7:30ccd918:e2e1c21a

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : 6c58c19c - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 6
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdl:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 3906767024 (1862.89 GiB 2000.26 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=976752816 sectors
          State : clean
    Device UUID : 8a9031cf:f9b5a888:70363d53:b269047d

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : b3d8bda7 - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 7
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdm:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 2930015024 (1397.14 GiB 1500.17 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=816 sectors
          State : clean
    Device UUID : 1eefdd8c:75b58c0c:f0c555bd:e704e89e

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : 472538a0 - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 8
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdn:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x4
     Array UUID : 633c1520:61c07f69:26a83b45:b9756587
           Name : claw-storage:0  (local to host claw-storage)
  Creation Time : Tue Jan 14 12:48:49 2014
     Raid Level : raid6
   Raid Devices : 13

 Avail Dev Size : 2930015024 (1397.14 GiB 1500.17 GB)
     Array Size : 16115078144 (15368.54 GiB 16501.84 GB)
  Used Dev Size : 2930014208 (1397.14 GiB 1500.17 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=816 sectors
          State : clean
    Device UUID : b8f9a259:c4522982:88538283:497eed43

  Reshape pos'n : 0
  Delta Devices : 1 (12->13)

    Update Time : Thu Aug 13 17:11:05 2015
       Checksum : f4b8e783 - correct
         Events : 72402

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 9
Array State : AAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)


--
Viele Grüße,

Daniel Koch
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux