Hello all,
I unfortunaly destroyed my raid5 setup. I removed the wrong disk
/dev/sdb while another disk /dev/sde was rebuilding. I will never do
this again. Current state is:
[root@tsa ~]# mdadm --examine /dev/sdb1
/dev/sdb1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x9
Array UUID : 32da23b1:b44b51d0:d038f0e6:c38e7b29
Name : tsa.myhome.lan:0 (local to host tsa.myhome.lan)
Creation Time : Sat May 21 10:14:33 2016
Raid Level : raid5
Raid Devices : 4
Avail Dev Size : 1953260976 (931.39 GiB 1000.07 GB)
Array Size : 2929891200 (2794.16 GiB 3000.21 GB)
Used Dev Size : 1953260800 (931.39 GiB 1000.07 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=176 sectors
State : clean
Device UUID : 94b8e530:7c96d75f:7315e972:4549100e
Internal Bitmap : 8 sectors from superblock
Update Time : Mon Jul 30 20:24:25 2018
Bad Block Log : 512 entries available at offset 16 sectors - bad
blocks present.
Checksum : 22417c8d - correct
Events : 300203
Layout : left-symmetric
Chunk Size : 128K
Device Role : spare
Array State : .AA. ('A' == active, '.' == missing, 'R' == replacing)
[root@tsa ~]# mdadm --examine /dev/sdc1
/dev/sdc1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x9
Array UUID : 32da23b1:b44b51d0:d038f0e6:c38e7b29
Name : tsa.myhome.lan:0 (local to host tsa.myhome.lan)
Creation Time : Sat May 21 10:14:33 2016
Raid Level : raid5
Raid Devices : 4
Avail Dev Size : 1953260976 (931.39 GiB 1000.07 GB)
Array Size : 2929891200 (2794.16 GiB 3000.21 GB)
Used Dev Size : 1953260800 (931.39 GiB 1000.07 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=176 sectors
State : clean
Device UUID : 64fab119:22d2e977:a586218b:c268acde
Internal Bitmap : 8 sectors from superblock
Update Time : Mon Jul 30 20:24:25 2018
Bad Block Log : 512 entries available at offset 16 sectors - bad
blocks present.
Checksum : bf48ab4 - correct
Events : 300203
Layout : left-symmetric
Chunk Size : 128K
Device Role : spare
Array State : .AA. ('A' == active, '.' == missing, 'R' == replacing)
[root@tsa ~]# mdadm --examine /dev/sdd1
/dev/sdd1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 32da23b1:b44b51d0:d038f0e6:c38e7b29
Name : tsa.myhome.lan:0 (local to host tsa.myhome.lan)
Creation Time : Sat May 21 10:14:33 2016
Raid Level : raid5
Raid Devices : 4
Avail Dev Size : 1953260976 (931.39 GiB 1000.07 GB)
Array Size : 2929891200 (2794.16 GiB 3000.21 GB)
Used Dev Size : 1953260800 (931.39 GiB 1000.07 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=176 sectors
State : clean
Device UUID : 02e58082:73e21677:5e3922ef:f6e6e257
Internal Bitmap : 8 sectors from superblock
Update Time : Mon Jul 30 20:24:25 2018
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 5127b6bc - correct
Events : 300203
Layout : left-symmetric
Chunk Size : 128K
Device Role : Active device 1
Array State : .AA. ('A' == active, '.' == missing, 'R' == replacing)
[root@tsa ~]# mdadm --examine /dev/sde1
/dev/sde1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 32da23b1:b44b51d0:d038f0e6:c38e7b29
Name : tsa.myhome.lan:0 (local to host tsa.myhome.lan)
Creation Time : Sat May 21 10:14:33 2016
Raid Level : raid5
Raid Devices : 4
Avail Dev Size : 1953260976 (931.39 GiB 1000.07 GB)
Array Size : 2929891200 (2794.16 GiB 3000.21 GB)
Used Dev Size : 1953260800 (931.39 GiB 1000.07 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=176 sectors
State : clean
Device UUID : 890f1dbf:198e5f72:a9c6bc68:78eaaa46
Internal Bitmap : 8 sectors from superblock
Update Time : Mon Jul 30 20:24:25 2018
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : f16f1db6 - correct
Events : 300203
Layout : left-symmetric
Chunk Size : 128K
Device Role : Active device 2
Array State : .AA. ('A' == active, '.' == missing, 'R' == replacing)
[root@tsa ~]# mdadm --examine /dev/sdb
/dev/sdb:
MBR Magic : aa55
Partition[0] : 1953523120 sectors at 2048 (type fd)
[root@tsa ~]# mdadm --examine /dev/sdc
/dev/sdc:
MBR Magic : aa55
Partition[0] : 1953523120 sectors at 2048 (type fd)
[root@tsa ~]# mdadm --examine /dev/sdd
/dev/sdd:
MBR Magic : aa55
Partition[0] : 1953523120 sectors at 2048 (type fd)
[root@tsa ~]# mdadm --examine /dev/sde
/dev/sde:
MBR Magic : aa55
Partition[0] : 1953523120 sectors at 2048 (type fd)
[root@tsa ~]# smartctl -H -i -l scterc /dev/sdb
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-3.10.0-862.9.1.el7.x86_64]
(local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Red
Device Model: WDC WD10EFRX-68JCSN0
Serial Number: WD-WMC1U9061988
LU WWN Device Id: 5 0014ee 207f642c4
Firmware Version: 01.01A01
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Tue Jul 31 19:45:03 2018 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
SCT Error Recovery Control:
Read: 70 (7.0 seconds)
Write: 70 (7.0 seconds)
[root@tsa ~]# smartctl -H -i -l scterc /dev/sdc
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-3.10.0-862.9.1.el7.x86_64]
(local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Red
Device Model: WDC WD10EFRX-68FYTN0
Serial Number: WD-WCC4J0ENJPNJ
LU WWN Device Id: 5 0014ee 264125816
Firmware Version: 82.00A82
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-2 (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Tue Jul 31 19:45:08 2018 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
SCT Error Recovery Control:
Read: 70 (7.0 seconds)
Write: 70 (7.0 seconds)
[root@tsa ~]# smartctl -H -i -l scterc /dev/sdd
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-3.10.0-862.9.1.el7.x86_64]
(local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Red
Device Model: WDC WD10EFRX-68FYTN0
Serial Number: WD-WCC4J4APX71E
LU WWN Device Id: 5 0014ee 261185d89
Firmware Version: 82.00A82
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-2 (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Tue Jul 31 19:45:11 2018 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
SCT Error Recovery Control:
Read: 70 (7.0 seconds)
Write: 70 (7.0 seconds)
[root@tsa ~]# smartctl -H -i -l scterc /dev/sde
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-3.10.0-862.9.1.el7.x86_64]
(local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Red
Device Model: WDC WD10EFRX-68PJCN0
Serial Number: WD-WCC4J8RH9SF0
LU WWN Device Id: 5 0014ee 25fbac307
Firmware Version: 01.01A01
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-2 (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Tue Jul 31 19:45:14 2018 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
SCT Error Recovery Control:
Read: 70 (7.0 seconds)
Write: 70 (7.0 seconds)
[root@tsa lsdrv]# ./lsdrv
PCI [ahci] 00:1f.2 SATA controller: Intel Corporation 82801JI (ICH10
Family) SATA AHCI Controller
âscsi 0:0:0:0 ATA MKNSSDCR60GB-7 {MK1604061001BF2B5}
ââsda 55.90g [8:0] Partitioned (dos)
â âsda1 500.00m [8:1] xfs {e74c6f48-b9d5-4d52-94f5-12ef333cfe89}
â ââMounted as /dev/sda1 @ /boot
â âsda2 55.41g [8:2] PV LVM2_member 55.34g used, 64.00m free
{K3VIee-RMMh-jqT5-6lJJ-Mu1i-7SBh-PDcj85}
â âVG centos <55.41g 64.00m free {f7op90-OJUs-akHP-H7wP-UyPu-MQ7L-wwGbrL}
â âdm-2 16.32g [253:2] LV home xfs {21acc49d-871c-46bc-8109-f9d0adb1595d}
â ââMounted as /dev/mapper/centos-home @ /home
â âdm-0 33.43g [253:0] LV root xfs {a8426998-7dba-4908-9dde-7815fecd6718}
â ââMounted as /dev/mapper/centos-root @ /
â âdm-1 5.59g [253:1] LV swap swap {35bdac07-8cae-4c02-bd28-9cc689325423}
âscsi 1:0:0:0 ATA WDC WD10EFRX-68J {WD-WMC1U9061988}
ââsdb 931.51g [8:16] Partitioned (dos)
â âsdb1 931.51g [8:17] MD (none/) (w/ sdc1,sdd1,sde1) spare
'tsa.myhome.lan:0' {32da23b1-b44b-51d0-d038-f0e6c38e7b29}
â âmd0 0.00k [9:0] MD v1.2 () inactive, None (None) None
{32da23b1:b44b51d0:d038f0e6:c38e7b29}
â Empty/Unknown
âscsi 2:0:0:0 ATA WDC WD10EFRX-68F {WD-WCC4J0ENJPNJ}
ââsdc 931.51g [8:32] Partitioned (dos)
â âsdc1 931.51g [8:33] MD (none/) (w/ sdb1,sdd1,sde1) spare
'tsa.myhome.lan:0' {32da23b1-b44b-51d0-d038-f0e6c38e7b29}
â âmd0 0.00k [9:0] MD v1.2 () inactive, None (None) None
{32da23b1:b44b51d0:d038f0e6:c38e7b29}
â Empty/Unknown
âscsi 3:0:0:0 ATA WDC WD10EFRX-68F {WD-WCC4J4APX71E}
ââsdd 931.51g [8:48] Partitioned (dos)
â âsdd1 931.51g [8:49] MD (none/) (w/ sdb1,sdc1,sde1) spare
'tsa.myhome.lan:0' {32da23b1-b44b-51d0-d038-f0e6c38e7b29}
â âmd0 0.00k [9:0] MD v1.2 () inactive, None (None) None
{32da23b1:b44b51d0:d038f0e6:c38e7b29}
â Empty/Unknown
âscsi 4:0:0:0 ATA WDC WD10EFRX-68P {WD-WCC4J8RH9SF0}
âsde 931.51g [8:64] Partitioned (dos)
âsde1 931.51g [8:65] MD (none/) (w/ sdb1,sdc1,sdd1) spare
'tsa.myhome.lan:0' {32da23b1-b44b-51d0-d038-f0e6c38e7b29}
âmd0 0.00k [9:0] MD v1.2 () inactive, None (None) None
{32da23b1:b44b51d0:d038f0e6:c38e7b29}
Empty/Unknown
[root@tsa lsdrv]# cat /proc/mdstat
Personalities :
md0 : inactive sdb1[4](S) sdd1[1](S) sdc1[5](S) sde1[2](S)
3906521952 blocks super 1.2
unused devices: <none>
The disk /dev/sde1 was rebuilding at nearly 40%. I think, this disk is
not useful for recovery. Is it possible to get these three disk working
again? And how? I removed disk /dev/sdb for maybe 60 seconds. So it
should be nearly synced to the both other clean devices. Can someone
help me, please?
Cheers,
Martin
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
