Hello,
I’m not sure if this is the right way to go about it, so let me give you my story. I had a 7 x 3TB RAID array (12TB in total), 6 drives in the array and 1 spare that was also part of the array but simply a spare waiting at the ready in case of a drive failure, is what I had running before my array broke. I added two new arrays to my system last night, in order to back up my current RAID 6. The first array was a 3 x 3TB RAID 0, for a total of 9TB. Then a 2 x 1TB RAID 0 array, for a total of 2TB. 9+2 = 11 and although I’m 1TB shy, I knew I had a bunch of crap and redundancy to get rid of, I just really needed a solid backup after I was going to clean up.
After creating the new arrays, I started transferring from my 12TB array, 2TB worth of data to the 2TB RAID 0 array. At some point during the transfer, rsync complained of an I/O error. It seemed to have transferred 500GB worth of data before this mishap. The following morning, I noticed that error, and saw that I couldn’t mount my 12TB array anymore. Mind you, I didn’t touch this original array, but I think what happened was that the I/O error blew 2 of my drives.
What I’m thinking of doing is the following, but I’m just looking for some advice in case I’m missing anything:
sudo mdadm create --assume-clean --level=6 --raid-devices=7 --size=2930135040 /dev/md127 /dev/sde /dev/sdf /dev/sdg /dev/sdh missing missing /dev/sdd
Here is the output of mdadm examination:
=======================================================================
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sdb
/dev/sdb:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 4259892e:2291b1be:a1cac81d:81d59c9d
Name : Rex:en1
Creation Time : Mon Apr 20 19:11:03 2015
Raid Level : raid6
Raid Devices : 6
Avail Dev Size : 5860271024 (2794.40 GiB 3000.46 GB)
Array Size : 11720540160 (11177.58 GiB 12001.83 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=944 sectors
State : active
Device UUID : b4f8af9e:5d486bf7:d86fba0d:0af9e3a5
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Nov 4 03:14:41 2015
Checksum : 3c08c930 - correct
Events : 58344
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 3
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sdc
/dev/sdc:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 4259892e:2291b1be:a1cac81d:81d59c9d
Name : Rex:en1
Creation Time : Mon Apr 20 19:11:03 2015
Raid Level : raid6
Raid Devices : 6
Avail Dev Size : 5860271024 (2794.40 GiB 3000.46 GB)
Array Size : 11720540160 (11177.58 GiB 12001.83 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=944 sectors
State : active
Device UUID : 822e5181:1c731970:3ae49e25:06a93621
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Nov 4 03:14:41 2015
Checksum : 2a8f4e1b - correct
Events : 58344
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 4
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sdd
/dev/sdd:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 4259892e:2291b1be:a1cac81d:81d59c9d
Name : Rex:en1
Creation Time : Mon Apr 20 19:11:03 2015
Raid Level : raid6
Raid Devices : 6
Avail Dev Size : 5860271024 (2794.40 GiB 3000.46 GB)
Array Size : 11720540160 (11177.58 GiB 12001.83 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=944 sectors
State : active
Device UUID : d8c57aac:91fb811c:eab9e82d:a60ca6bf
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Nov 4 03:14:41 2015
Checksum : a8daa737 - correct
Events : 58344
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 5
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sde
/dev/sde:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 4259892e:2291b1be:a1cac81d:81d59c9d
Name : Rex:en1
Creation Time : Mon Apr 20 19:11:03 2015
Raid Level : raid6
Raid Devices : 6
Avail Dev Size : 5860271024 (2794.40 GiB 3000.46 GB)
Array Size : 11720540160 (11177.58 GiB 12001.83 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=944 sectors
State : active
Device UUID : 46ae26e3:8fc7b451:548951c6:44426755
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Nov 4 03:14:41 2015
Checksum : 42e360a7 - correct
Events : 58344
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sdf
/dev/sdf:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 4259892e:2291b1be:a1cac81d:81d59c9d
Name : Rex:en1
Creation Time : Mon Apr 20 19:11:03 2015
Raid Level : raid6
Raid Devices : 6
Avail Dev Size : 5860271024 (2794.40 GiB 3000.46 GB)
Array Size : 11720540160 (11177.58 GiB 12001.83 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=944 sectors
State : clean
Device UUID : 9dc9106f:3a491437:d01b1b49:c7637240
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Nov 4 04:11:15 2015
Checksum : 21f7bef6 - correct
Events : 58362
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : .AA... ('A' == active, '.' == missing, 'R' == replacing)
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sdg
/dev/sdg:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 4259892e:2291b1be:a1cac81d:81d59c9d
Name : Rex:en1
Creation Time : Mon Apr 20 19:11:03 2015
Raid Level : raid6
Raid Devices : 6
Avail Dev Size : 5860271024 (2794.40 GiB 3000.46 GB)
Array Size : 11720540160 (11177.58 GiB 12001.83 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=944 sectors
State : clean
Device UUID : cd8e1df7:b6a8a95e:a744b6f0:27c6fa00
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Nov 4 04:11:15 2015
Checksum : 39bd6edb - correct
Events : 58362
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : .AA... ('A' == active, '.' == missing, 'R' == replacing)
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sdh
/dev/sdh:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 4259892e:2291b1be:a1cac81d:81d59c9d
Name : Rex:en1
Creation Time : Mon Apr 20 19:11:03 2015
Raid Level : raid6
Raid Devices : 6
Avail Dev Size : 5860271024 (2794.40 GiB 3000.46 GB)
Array Size : 11720540160 (11177.58 GiB 12001.83 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=944 sectors
State : clean
Device UUID : a130d2b7:77f8fe81:48203bc8:d2413cae
Update Time : Sun Nov 1 01:00:56 2015
Checksum : a2939695 - expected a2939694
Events : 58339
Layout : left-symmetric
Chunk Size : 512K
Device Role : spare
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sd[b-h] |grep "Array State"
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
Array State : .AA... ('A' == active, '.' == missing, 'R' == replacing)
Array State : .AA... ('A' == active, '.' == missing, 'R' == replacing)
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sd[b-h] |grep "Events"
Events : 58344
Events : 58344
Events : 58344
Events : 58344
Events : 58362
Events : 58362
Events : 58339
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sd[b-h] |grep "raid.status"
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sd[b-h] |grep "Role"
Device Role : Active device 3
Device Role : Active device 4
Device Role : Active device 5
Device Role : Active device 0
Device Role : Active device 1
Device Role : Active device 2
Device Role : spare
cisco@DoctorBanner:~$ sudo mdadm --examine /dev/sd[b-h] |grep "Used"
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
Used Dev Size : 5860270080 (2794.39 GiB 3000.46 GB)
=======================================================================
Thanks for your help in advance, I’m hoping to be able to find something, but so far this is all I’ve got.
Much appreciated!
Cisco--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
