Hi,
we have the following information:
mdadm --examine /dev/sda /dev/sd[d-z] >> raid.status
<15:14> root@archive03:~ # cat raid.status
/dev/sda:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdd:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sde:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdf:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdg:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdh:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdi:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdj:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdk:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdl:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdm:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdn:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdo:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdp:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdq:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdr:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sds:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdt:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdu:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdv:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdw:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdx:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdy:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 44cbe821:c4e585d1:90652f85:aaaa5ec3
Name : archive03:1 (local to host archive03)
Creation Time : Fri Mar 31 13:06:57 2017
Raid Level : raid6
Raid Devices : 24
Avail Dev Size : 11720783024 (5588.90 GiB 6001.04 GB)
Array Size : 128928611328 (122955.91 GiB 132022.90 GB)
Used Dev Size : 11720782848 (5588.90 GiB 6001.04 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=176 sectors
State : clean
Device UUID : 006aa4ee:7f78a5c2:30d930e9:1c48d102
Internal Bitmap : 8 sectors from superblock
Update Time : Mon Apr 22 18:52:31 2019
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 46b2f9d1 - correct
Events : 437007
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 22
Array State : AAAAAAAAAAAAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdz:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 44cbe821:c4e585d1:90652f85:aaaa5ec3
Name : archive03:1 (local to host archive03)
Creation Time : Fri Mar 31 13:06:57 2017
Raid Level : raid6
Raid Devices : 24
Avail Dev Size : 11720783024 (5588.90 GiB 6001.04 GB)
Array Size : 128928611328 (122955.91 GiB 132022.90 GB)
Used Dev Size : 11720782848 (5588.90 GiB 6001.04 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=176 sectors
State : clean
Device UUID : 9044d88c:bce3d9ab:0360b279:07c60455
Internal Bitmap : 8 sectors from superblock
Update Time : Mon Apr 22 18:52:31 2019
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : b0d0445c - correct
Events : 437007
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 23
Array State : AAAAAAAAAAAAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
This information we didnt ercieve anymore at the moment
Output from:
mdadm --examine /dev/sd* while sdb and sdc are an own raid 1, defined as /dev/md0
sda and sdd-dsz are raid6 with 24 drives
/dev/sda:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sda1.
mdadm: No md superblock detected on /dev/sda9.
/dev/sdb:
MBR Magic : aa55
Partition[0] : 1951744 sectors at 2048 (type 83)
Partition[1] : 3748792322 sectors at 1955838 (type 05)
mdadm: No md superblock detected on /dev/sdb1.
/dev/sdb2:
MBR Magic : aa55
Partition[0] : 3748792320 sectors at 2 (type fd)
/dev/sdb5:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 694adba6:d96199c0:f3f250c2:b5a1dc3b
Name : archive03:0 (local to host archive03)
Creation Time : Thu Mar 30 14:23:43 2017
Raid Level : raid1
Raid Devices : 2
Avail Dev Size : 3748530176 (1787.44 GiB 1919.25 GB)
Array Size : 1874265088 (1787.44 GiB 1919.25 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=0 sectors
State : clean
Device UUID : a531774e:97f8aa53:0cc29245:c3d4504e
Internal Bitmap : 8 sectors from superblock
Update Time : Tue Apr 23 15:15:08 2019
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 5213c87e - correct
Events : 80704
Device Role : Active device 0
Array State : AA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc:
MBR Magic : aa55
Partition[0] : 3750746112 sectors at 2048 (type fd)
/dev/sdc1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 694adba6:d96199c0:f3f250c2:b5a1dc3b
Name : archive03:0 (local to host archive03)
Creation Time : Thu Mar 30 14:23:43 2017
Raid Level : raid1
Raid Devices : 2
Avail Dev Size : 3750483968 (1788.37 GiB 1920.25 GB)
Array Size : 1874265088 (1787.44 GiB 1919.25 GB)
Used Dev Size : 3748530176 (1787.44 GiB 1919.25 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=1953792 sectors
State : clean
Device UUID : a22dc94e:82b3685f:14cedae0:690ab2a4
Internal Bitmap : 8 sectors from superblock
Update Time : Tue Apr 23 15:15:08 2019
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 4fea9116 - correct
Events : 80704
Device Role : Active device 1
Array State : AA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdd:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdd1.
mdadm: No md superblock detected on /dev/sdd9.
/dev/sde:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sde1.
mdadm: No md superblock detected on /dev/sde9.
/dev/sdf:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdf1.
mdadm: No md superblock detected on /dev/sdf9.
/dev/sdg:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdg1.
mdadm: No md superblock detected on /dev/sdg9.
/dev/sdh:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdh1.
mdadm: No md superblock detected on /dev/sdh9.
/dev/sdi:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdi1.
mdadm: No md superblock detected on /dev/sdi9.
/dev/sdj:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdj1.
mdadm: No md superblock detected on /dev/sdj9.
/dev/sdk:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdk1.
mdadm: No md superblock detected on /dev/sdk9.
/dev/sdl:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdl1.
mdadm: No md superblock detected on /dev/sdl9.
/dev/sdm:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdm1.
mdadm: No md superblock detected on /dev/sdm9.
/dev/sdn:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdn1.
mdadm: No md superblock detected on /dev/sdn9.
/dev/sdo:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdo1.
mdadm: No md superblock detected on /dev/sdo9.
/dev/sdp:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdp1.
mdadm: No md superblock detected on /dev/sdp9.
/dev/sdq:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdq1.
mdadm: No md superblock detected on /dev/sdq9.
/dev/sdr:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdr1.
mdadm: No md superblock detected on /dev/sdr9.
/dev/sds:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sds1.
mdadm: No md superblock detected on /dev/sds9.
/dev/sdt:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdt1.
mdadm: No md superblock detected on /dev/sdt9.
/dev/sdu:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdu1.
mdadm: No md superblock detected on /dev/sdu9.
/dev/sdv:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdv1.
mdadm: No md superblock detected on /dev/sdv9.
/dev/sdw:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdw1.
mdadm: No md superblock detected on /dev/sdw9.
/dev/sdx:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdx1.
mdadm: No md superblock detected on /dev/sdx9.
/dev/sdy:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdy1.
mdadm: No md superblock detected on /dev/sdy9.
/dev/sdz:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
mdadm: No md superblock detected on /dev/sdz1.
mdadm: No md superblock detected on /dev/sdz9.
Initial build command:
mdadm --create /dev/md1 --level=6 --raid-devices=24 /dev/sda /dev/sd[d-z]
Message if i try to re create raid with:
mdadm --create --assume-clean /dev/md1 --level=6 --raid-devices=24 /dev/sda /dev/sd[d-z]
mdadm: /dev/sda appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sda but will be lost or
meaningless after creating array
mdadm: /dev/sdd appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdd but will be lost or
meaningless after creating array
mdadm: /dev/sde appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sde but will be lost or
meaningless after creating array
mdadm: /dev/sdf appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdf but will be lost or
meaningless after creating array
mdadm: /dev/sdg appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdg but will be lost or
meaningless after creating array
mdadm: /dev/sdh appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdh but will be lost or
meaningless after creating array
mdadm: /dev/sdi appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdi but will be lost or
meaningless after creating array
mdadm: /dev/sdj appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdj but will be lost or
meaningless after creating array
mdadm: /dev/sdk appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdk but will be lost or
meaningless after creating array
mdadm: /dev/sdl appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdl but will be lost or
meaningless after creating array
mdadm: /dev/sdm appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdm but will be lost or
meaningless after creating array
mdadm: /dev/sdn appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdn but will be lost or
meaningless after creating array
mdadm: /dev/sdo appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdo but will be lost or
meaningless after creating array
mdadm: /dev/sdp appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdp but will be lost or
meaningless after creating array
mdadm: /dev/sdq appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdq but will be lost or
meaningless after creating array
mdadm: /dev/sdr appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdr but will be lost or
meaningless after creating array
mdadm: /dev/sds appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sds but will be lost or
meaningless after creating array
mdadm: /dev/sdt appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdt but will be lost or
meaningless after creating array
mdadm: /dev/sdu appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdu but will be lost or
meaningless after creating array
mdadm: /dev/sdv appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdv but will be lost or
meaningless after creating array
mdadm: /dev/sdw appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdw but will be lost or
meaningless after creating array
mdadm: /dev/sdx appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdx but will be lost or
meaningless after creating array
mdadm: /dev/sdy appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdy but will be lost or
meaningless after creating array
mdadm: /dev/sdz appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 01:00:00 1970
mdadm: partition table exists on /dev/sdz but will be lost or
meaningless after creating array
Continue creating array? n
mdadm: create aborted.
output dmesg:
[ 2.958777] scsi 0:0:0:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 2.958786] scsi 0:0:0:0: SSP: handle(0x000c), sas_addr(0x5000c50086509829), phy(0), device_name(0x5000c50086509828)
[ 2.958789] scsi 0:0:0:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(0)
[ 2.958794] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 2.962242] scsi 0:0:1:0: Direct-Access ATA SAMSUNG MZ7KM1T9 004Q PQ: 0 ANSI: 6
[ 2.962249] scsi 0:0:1:0: SATA: handle(0x0009), sas_addr(0x4433221102000000), phy(2), device_name(0x5002538c000bd145)
[ 2.962252] scsi 0:0:1:0: SATA: enclosure_logical_id(0x500605b00b3c1eb0), slot(0)
[ 2.962345] scsi 0:0:1:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[ 2.962349] scsi 0:0:1:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.051429] usb 1-9: new high-speed USB device number 2 using xhci_hcd
[ 3.179668] usb 1-9: New USB device found, idVendor=0557, idProduct=7000
[ 3.179671] usb 1-9: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 3.180134] hub 1-9:1.0: USB hub found
[ 3.180240] hub 1-9:1.0: 4 ports detected
[ 3.271629] ata5: SATA link down (SStatus 4 SControl 300)
[ 3.271661] ata2: SATA link down (SStatus 4 SControl 300)
[ 3.271724] ata4: SATA link down (SStatus 4 SControl 300)
[ 3.271778] ata3: SATA link down (SStatus 4 SControl 300)
[ 3.271837] ata1: SATA link down (SStatus 4 SControl 300)
[ 3.275475] ata6: SATA link down (SStatus 4 SControl 300)
[ 3.283727] Switched to clocksource tsc
[ 3.422566] scsi 0:0:2:0: Direct-Access ATA SAMSUNG MZ7KM1T9 004Q PQ: 0 ANSI: 6
[ 3.422575] scsi 0:0:2:0: SATA: handle(0x000a), sas_addr(0x4433221103000000), phy(3), device_name(0x0000000000000000)
[ 3.422579] scsi 0:0:2:0: SATA: enclosure_logical_id(0x500605b00b3c1eb0), slot(1)
[ 3.422631] scsi 0:0:2:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[ 3.422636] scsi 0:0:2:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.433179] scsi 0:0:3:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.433185] scsi 0:0:3:0: SSP: handle(0x000d), sas_addr(0x5000c50086512755), phy(1), device_name(0x5000c50086512754)
[ 3.433188] scsi 0:0:3:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(1)
[ 3.433192] scsi 0:0:3:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.443165] scsi 0:0:4:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.443172] scsi 0:0:4:0: SSP: handle(0x000e), sas_addr(0x5000c5008650981d), phy(2), device_name(0x5000c5008650981c)
[ 3.443175] scsi 0:0:4:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(2)
[ 3.443179] scsi 0:0:4:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.455731] scsi 0:0:5:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.455737] scsi 0:0:5:0: SSP: handle(0x000f), sas_addr(0x5000c5008654ce75), phy(3), device_name(0x5000c5008654ce74)
[ 3.455740] scsi 0:0:5:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(3)
[ 3.455744] scsi 0:0:5:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.468107] scsi 0:0:6:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.468112] scsi 0:0:6:0: SSP: handle(0x0010), sas_addr(0x5000c50086515461), phy(4), device_name(0x5000c50086515460)
[ 3.468115] scsi 0:0:6:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(4)
[ 3.468119] scsi 0:0:6:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.471511] usb 1-9.1: new low-speed USB device number 3 using xhci_hcd
[ 3.477931] scsi 0:0:7:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.477936] scsi 0:0:7:0: SSP: handle(0x0011), sas_addr(0x5000c50086458a9d), phy(5), device_name(0x5000c50086458a9c)
[ 3.477939] scsi 0:0:7:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(5)
[ 3.477943] scsi 0:0:7:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.489710] scsi 0:0:8:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.489716] scsi 0:0:8:0: SSP: handle(0x0012), sas_addr(0x5000c50086543cc9), phy(6), device_name(0x5000c50086543cc8)
[ 3.489719] scsi 0:0:8:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(6)
[ 3.489723] scsi 0:0:8:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.499154] scsi 0:0:9:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.499159] scsi 0:0:9:0: SSP: handle(0x0013), sas_addr(0x5000c50086518481), phy(7), device_name(0x5000c50086518480)
[ 3.499162] scsi 0:0:9:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(7)
[ 3.499166] scsi 0:0:9:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.508765] scsi 0:0:10:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.508772] scsi 0:0:10:0: SSP: handle(0x0014), sas_addr(0x5000c500865160b1), phy(8), device_name(0x5000c500865160b0)
[ 3.508775] scsi 0:0:10:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(8)
[ 3.508779] scsi 0:0:10:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.519422] scsi 0:0:11:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.519428] scsi 0:0:11:0: SSP: handle(0x0015), sas_addr(0x5000c5008651dc69), phy(9), device_name(0x5000c5008651dc68)
[ 3.519431] scsi 0:0:11:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(9)
[ 3.519435] scsi 0:0:11:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.529057] scsi 0:0:12:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.529062] scsi 0:0:12:0: SSP: handle(0x0016), sas_addr(0x5000c500865152cd), phy(10), device_name(0x5000c500865152cc)
[ 3.529066] scsi 0:0:12:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(10)
[ 3.529069] scsi 0:0:12:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.540113] scsi 0:0:13:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.540119] scsi 0:0:13:0: SSP: handle(0x0017), sas_addr(0x5000c50086515569), phy(11), device_name(0x5000c50086515568)
[ 3.540122] scsi 0:0:13:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(11)
[ 3.540126] scsi 0:0:13:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.551142] scsi 0:0:14:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.551147] scsi 0:0:14:0: SSP: handle(0x0018), sas_addr(0x5000c50086508c81), phy(28), device_name(0x5000c50086508c80)
[ 3.551150] scsi 0:0:14:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(12)
[ 3.551154] scsi 0:0:14:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.563898] scsi 0:0:15:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.563904] scsi 0:0:15:0: SSP: handle(0x0019), sas_addr(0x5000c5008654c21d), phy(29), device_name(0x5000c5008654c21c)
[ 3.563907] scsi 0:0:15:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(13)
[ 3.563911] scsi 0:0:15:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.567459] scsi 0:0:16:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.567464] scsi 0:0:16:0: SSP: handle(0x001a), sas_addr(0x5000c5008654cb31), phy(30), device_name(0x5000c5008654cb30)
[ 3.567468] scsi 0:0:16:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(14)
[ 3.567472] scsi 0:0:16:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 3.583872] usb 1-9.1: New USB device found, idVendor=0557, idProduct=2419
[ 3.583876] usb 1-9.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 3.584001] usb 1-9.1: ep 0x81 - rounding interval to 64 microframes, ep desc says 80 microframes
[ 3.584008] usb 1-9.1: ep 0x82 - rounding interval to 32 microframes, ep desc says 40 microframes
[ 3.587775] usbcore: registered new interface driver usbhid
[ 3.587778] usbhid: USB HID core driver
[ 3.588789] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb1/1-9/1-9.1/1-9.1:1.0/0003:0557:2419.0001/input/input0
[ 3.588881] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-9.1/input0
[ 3.589074] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb1/1-9/1-9.1/1-9.1:1.1/0003:0557:2419.0002/input/input1
[ 3.589192] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-9.1/input1
[ 3.863899] scsi 0:0:17:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 3.863909] scsi 0:0:17:0: SSP: handle(0x001b), sas_addr(0x5000c50086543b9d), phy(31), device_name(0x5000c50086543b9c)
[ 3.863913] scsi 0:0:17:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(15)
[ 3.863917] scsi 0:0:17:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 4.097820] scsi 0:0:18:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 4.097827] scsi 0:0:18:0: SSP: handle(0x001c), sas_addr(0x5000c5008650a98d), phy(32), device_name(0x5000c5008650a98c)
[ 4.097831] scsi 0:0:18:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(16)
[ 4.097835] scsi 0:0:18:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 4.338990] scsi 0:0:19:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 4.338997] scsi 0:0:19:0: SSP: handle(0x001d), sas_addr(0x5000c50086543991), phy(33), device_name(0x5000c50086543990)
[ 4.339001] scsi 0:0:19:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(17)
[ 4.339005] scsi 0:0:19:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 4.574926] scsi 0:0:20:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 4.574932] scsi 0:0:20:0: SSP: handle(0x001e), sas_addr(0x5000c500865441d5), phy(34), device_name(0x5000c500865441d4)
[ 4.574935] scsi 0:0:20:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(18)
[ 4.574939] scsi 0:0:20:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 4.804270] scsi 0:0:21:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 4.804277] scsi 0:0:21:0: SSP: handle(0x001f), sas_addr(0x5000c50086544369), phy(35), device_name(0x5000c50086544368)
[ 4.804280] scsi 0:0:21:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(19)
[ 4.804284] scsi 0:0:21:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 5.045274] scsi 0:0:22:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 5.045281] scsi 0:0:22:0: SSP: handle(0x0020), sas_addr(0x5000c5008651dc05), phy(36), device_name(0x5000c5008651dc04)
[ 5.045284] scsi 0:0:22:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(20)
[ 5.045288] scsi 0:0:22:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 5.284506] scsi 0:0:23:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 5.284512] scsi 0:0:23:0: SSP: handle(0x0021), sas_addr(0x5000c5008650a3e1), phy(37), device_name(0x5000c5008650a3e0)
[ 5.284515] scsi 0:0:23:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(21)
[ 5.284519] scsi 0:0:23:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 5.513286] scsi 0:0:24:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 5.513292] scsi 0:0:24:0: SSP: handle(0x0022), sas_addr(0x5000c500865155b5), phy(38), device_name(0x5000c500865155b4)
[ 5.513295] scsi 0:0:24:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(22)
[ 5.513299] scsi 0:0:24:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 5.758229] scsi 0:0:25:0: Direct-Access SEAGATE ST6000NM0095 E002 PQ: 0 ANSI: 6
[ 5.758235] scsi 0:0:25:0: SSP: handle(0x0023), sas_addr(0x5000c5008650aa3d), phy(39), device_name(0x5000c5008650aa3c)
[ 5.758239] scsi 0:0:25:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(23)
[ 5.758242] scsi 0:0:25:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
[ 5.996432] scsi 0:0:26:0: Enclosure LSI SAS3x40 0601 PQ: 0 ANSI: 5
[ 5.996439] scsi 0:0:26:0: SSP: handle(0x0024), sas_addr(0x5003048018b173bd), phy(40), device_name(0x5003048018b173bd)
[ 5.996442] scsi 0:0:26:0: SSP: enclosure_logical_id(0x5003048018b173bf), slot(24)
[ 5.996446] scsi 0:0:26:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[ 6.027914] sd 0:0:1:0: [sdb] 3750748848 512-byte logical blocks: (1.92 TB/1.74 TiB)
[ 6.028017] sd 0:0:2:0: [sdc] 3750748848 512-byte logical blocks: (1.92 TB/1.74 TiB)
[ 6.028755] sd 0:0:12:0: [sdm] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.028760] sd 0:0:12:0: [sdm] 4096-byte physical blocks
[ 6.030945] sd 0:0:12:0: [sdm] Write Protect is off
[ 6.030967] sd 0:0:12:0: [sdm] Mode Sense: db 00 10 08
[ 6.031472] sd 0:0:1:0: [sdb] Write Protect is off
[ 6.031492] sd 0:0:1:0: [sdb] Mode Sense: 9b 00 10 08
[ 6.031587] sd 0:0:2:0: [sdc] Write Protect is off
[ 6.031591] sd 0:0:2:0: [sdc] Mode Sense: 9b 00 10 08
[ 6.031926] sd 0:0:1:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.032026] sd 0:0:2:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.032264] sd 0:0:12:0: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.032882] sd 0:0:11:0: [sdl] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.032885] sd 0:0:11:0: [sdl] 4096-byte physical blocks
[ 6.032955] sd 0:0:7:0: [sdh] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.032958] sd 0:0:7:0: [sdh] 4096-byte physical blocks
[ 6.033030] sd 0:0:9:0: [sdj] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.033035] sd 0:0:9:0: [sdj] 4096-byte physical blocks
[ 6.033195] sd 0:0:0:0: [sda] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.033198] sd 0:0:0:0: [sda] 4096-byte physical blocks
[ 6.033731] sd 0:0:23:0: [sdx] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.033734] sd 0:0:23:0: [sdx] 4096-byte physical blocks
[ 6.033938] sd 0:0:20:0: [sdu] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.033941] sd 0:0:20:0: [sdu] 4096-byte physical blocks
[ 6.034295] sd 0:0:17:0: [sdr] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.034298] sd 0:0:17:0: [sdr] 4096-byte physical blocks
[ 6.034587] sd 0:0:13:0: [sdn] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.034590] sd 0:0:13:0: [sdn] 4096-byte physical blocks
[ 6.034928] sd 0:0:21:0: [sdv] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.034932] sd 0:0:21:0: [sdv] 4096-byte physical blocks
[ 6.035131] sd 0:0:11:0: [sdl] Write Protect is off
[ 6.035135] sd 0:0:11:0: [sdl] Mode Sense: db 00 10 08
[ 6.035180] sd 0:0:7:0: [sdh] Write Protect is off
[ 6.035184] sd 0:0:7:0: [sdh] Mode Sense: db 00 10 08
[ 6.035291] sd 0:0:6:0: [sdg] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.035295] sd 0:0:9:0: [sdj] Write Protect is off
[ 6.035297] sd 0:0:6:0: [sdg] 4096-byte physical blocks
[ 6.035305] sd 0:0:9:0: [sdj] Mode Sense: db 00 10 08
[ 6.035466] sd 0:0:0:0: [sda] Write Protect is off
[ 6.035470] sd 0:0:0:0: [sda] Mode Sense: db 00 10 08
[ 6.035796] sd 0:0:19:0: [sdt] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.035799] sd 0:0:19:0: [sdt] 4096-byte physical blocks
[ 6.036019] sd 0:0:23:0: [sdx] Write Protect is off
[ 6.036023] sd 0:0:23:0: [sdx] Mode Sense: db 00 10 08
[ 6.036061] sd 0:0:4:0: [sde] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.036064] sd 0:0:4:0: [sde] 4096-byte physical blocks
[ 6.036247] sd 0:0:20:0: [sdu] Write Protect is off
[ 6.036250] sd 0:0:20:0: [sdu] Mode Sense: db 00 10 08
[ 6.036385] sd 0:0:11:0: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.036433] sd 0:0:7:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.036448] sd 0:0:24:0: [sdy] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.036452] sd 0:0:24:0: [sdy] 4096-byte physical blocks
[ 6.036532] sd 0:0:22:0: [sdw] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.036535] sd 0:0:22:0: [sdw] 4096-byte physical blocks
[ 6.036549] sd 0:0:17:0: [sdr] Write Protect is off
[ 6.036553] sd 0:0:17:0: [sdr] Mode Sense: db 00 10 08
[ 6.036559] sd 0:0:3:0: [sdd] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.036564] sd 0:0:3:0: [sdd] 4096-byte physical blocks
[ 6.036570] sd 0:0:9:0: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.036717] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.036810] sd 0:0:13:0: [sdn] Write Protect is off
[ 6.036813] sd 0:0:13:0: [sdn] Mode Sense: db 00 10 08
[ 6.036888] sd 0:0:8:0: [sdi] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.036891] sd 0:0:8:0: [sdi] 4096-byte physical blocks
[ 6.036911] sd 0:0:5:0: [sdf] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.036915] sd 0:0:5:0: [sdf] 4096-byte physical blocks
[ 6.037195] sd 0:0:21:0: [sdv] Write Protect is off
[ 6.037199] sd 0:0:21:0: [sdv] Mode Sense: db 00 10 08
[ 6.037286] sd 0:0:23:0: [sdx] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.037782] sd 0:0:10:0: [sdk] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.037788] sd 0:0:10:0: [sdk] 4096-byte physical blocks
[ 6.037806] sd 0:0:20:0: [sdu] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.037813] sd 0:0:6:0: [sdg] Write Protect is off
[ 6.037820] sd 0:0:6:0: [sdg] Mode Sense: db 00 10 08
[ 6.037827] sd 0:0:15:0: [sdp] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.037832] sd 0:0:15:0: [sdp] 4096-byte physical blocks
[ 6.037870] sd 0:0:14:0: [sdo] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.037873] sd 0:0:14:0: [sdo] 4096-byte physical blocks
[ 6.037898] sdb: sdb1 sdb2 < sdb5 >
[ 6.037926] sdc: sdc1
[ 6.037933] sd 0:0:17:0: [sdr] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.038054] sd 0:0:19:0: [sdt] Write Protect is off
[ 6.038059] sd 0:0:19:0: [sdt] Mode Sense: db 00 10 08
[ 6.038301] sd 0:0:18:0: [sds] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.038304] sd 0:0:18:0: [sds] 4096-byte physical blocks
[ 6.038328] sd 0:0:16:0: [sdq] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.038331] sd 0:0:16:0: [sdq] 4096-byte physical blocks
[ 6.038428] sd 0:0:13:0: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.038454] sd 0:0:21:0: [sdv] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.038475] sd 0:0:4:0: [sde] Write Protect is off
[ 6.038479] sd 0:0:4:0: [sde] Mode Sense: db 00 10 08
[ 6.038844] sd 0:0:22:0: [sdw] Write Protect is off
[ 6.038848] sd 0:0:22:0: [sdw] Mode Sense: db 00 10 08
[ 6.038897] sd 0:0:24:0: [sdy] Write Protect is off
[ 6.038902] sd 0:0:24:0: [sdy] Mode Sense: db 00 10 08
[ 6.038975] sd 0:0:3:0: [sdd] Write Protect is off
[ 6.038979] sd 0:0:3:0: [sdd] Mode Sense: db 00 10 08
[ 6.039094] sd 0:0:6:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.039187] sd 0:0:5:0: [sdf] Write Protect is off
[ 6.039191] sd 0:0:5:0: [sdf] Mode Sense: db 00 10 08
[ 6.039256] sd 0:0:8:0: [sdi] Write Protect is off
[ 6.039260] sd 0:0:8:0: [sdi] Mode Sense: db 00 10 08
[ 6.039322] sd 0:0:19:0: [sdt] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.039736] sd 0:0:4:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.040009] sd 0:0:10:0: [sdk] Write Protect is off
[ 6.040015] sd 0:0:10:0: [sdk] Mode Sense: db 00 10 08
[ 6.040061] sd 0:0:15:0: [sdp] Write Protect is off
[ 6.040065] sd 0:0:15:0: [sdp] Mode Sense: db 00 10 08
[ 6.040100] sd 0:0:22:0: [sdw] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.040119] sdm: sdm1 sdm9
[ 6.040135] sd 0:0:14:0: [sdo] Write Protect is off
[ 6.040139] sd 0:0:14:0: [sdo] Mode Sense: db 00 10 08
[ 6.040151] sd 0:0:24:0: [sdy] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.040236] sd 0:0:3:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.040447] sd 0:0:5:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.040511] sd 0:0:8:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.040594] sd 0:0:18:0: [sds] Write Protect is off
[ 6.040598] sd 0:0:18:0: [sds] Mode Sense: db 00 10 08
[ 6.040633] sd 0:0:16:0: [sdq] Write Protect is off
[ 6.040637] sd 0:0:16:0: [sdq] Mode Sense: db 00 10 08
[ 6.041276] sd 0:0:10:0: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.041335] sd 0:0:15:0: [sdp] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.041406] sd 0:0:14:0: [sdo] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.041900] sd 0:0:16:0: [sdq] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.041909] sd 0:0:18:0: [sds] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.043400] sd 0:0:2:0: [sdc] Attached SCSI disk
[ 6.043489] sd 0:0:1:0: [sdb] Attached SCSI disk
[ 6.044321] sdj: sdj1 sdj9
[ 6.044367] sdl: sdl1 sdl9
[ 6.044546] sda: sda1 sda9
[ 6.044747] sd 0:0:25:0: [sdz] 11721045168 512-byte logical blocks: (6.00 TB/5.45 TiB)
[ 6.044752] sd 0:0:25:0: [sdz] 4096-byte physical blocks
[ 6.045103] sdx: sdx1 sdx9
[ 6.045351] sdu: sdu1 sdu9
[ 6.045550] sdr: sdr1 sdr9
[ 6.045586] sd 0:0:12:0: [sdm] Attached SCSI disk
[ 6.045983] sdn: sdn1 sdn9
[ 6.046010] sdv: sdv1 sdv9
[ 6.046492] sdg: sdg1 sdg9
[ 6.046824] sdt: sdt1 sdt9
[ 6.047015] sdy: unknown partition table
[ 6.047089] sd 0:0:25:0: [sdz] Write Protect is off
[ 6.047098] sd 0:0:25:0: [sdz] Mode Sense: db 00 10 08
[ 6.047108] sde: sde1 sde9
[ 6.047591] sdw: sdw1 sdw9
[ 6.047711] sdd: sdd1 sdd9
[ 6.047924] sdi: sdi1 sdi9
[ 6.047939] sdf: sdf1 sdf9
[ 6.048366] sd 0:0:25:0: [sdz] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 6.048705] sdk: sdk1 sdk9
[ 6.048766] sdp: sdp1 sdp9
[ 6.048882] sdo: sdo1 sdo9
[ 6.049311] sds: sds1 sds9
[ 6.049545] sdq: sdq1 sdq9
[ 6.049965] sd 0:0:9:0: [sdj] Attached SCSI disk
[ 6.049973] sd 0:0:11:0: [sdl] Attached SCSI disk
[ 6.050053] sd 0:0:0:0: [sda] Attached SCSI disk
[ 6.050547] sd 0:0:23:0: [sdx] Attached SCSI disk
[ 6.050888] sd 0:0:20:0: [sdu] Attached SCSI disk
[ 6.051111] sd 0:0:17:0: [sdr] Attached SCSI disk
[ 6.051495] sd 0:0:13:0: [sdn] Attached SCSI disk
[ 6.051575] sd 0:0:21:0: [sdv] Attached SCSI disk
[ 6.051966] sd 0:0:6:0: [sdg] Attached SCSI disk
[ 6.052334] sd 0:0:19:0: [sdt] Attached SCSI disk
[ 6.052371] sd 0:0:24:0: [sdy] Attached SCSI disk
[ 6.052576] sd 0:0:4:0: [sde] Attached SCSI disk
[ 6.053153] sd 0:0:22:0: [sdw] Attached SCSI disk
[ 6.053280] sd 0:0:3:0: [sdd] Attached SCSI disk
[ 6.053549] sd 0:0:5:0: [sdf] Attached SCSI disk
[ 6.053556] sd 0:0:8:0: [sdi] Attached SCSI disk
[ 6.054408] sd 0:0:10:0: [sdk] Attached SCSI disk
[ 6.054417] sd 0:0:14:0: [sdo] Attached SCSI disk
[ 6.054421] sd 0:0:15:0: [sdp] Attached SCSI disk
[ 6.054765] sd 0:0:18:0: [sds] Attached SCSI disk
[ 6.055150] sd 0:0:16:0: [sdq] Attached SCSI disk
[ 6.055385] sdz: unknown partition table
[ 6.055909] sdh: sdh1 sdh9
[ 6.060660] sd 0:0:25:0: [sdz] Attached SCSI disk
[ 6.061369] sd 0:0:7:0: [sdh] Attached SCSI disk
[ 6.062745] sd 0:0:0:0: Attached scsi generic sg0 type 0
[ 6.062807] sd 0:0:1:0: Attached scsi generic sg1 type 0
[ 6.062863] sd 0:0:2:0: Attached scsi generic sg2 type 0
[ 6.062918] sd 0:0:3:0: Attached scsi generic sg3 type 0
[ 6.062973] sd 0:0:4:0: Attached scsi generic sg4 type 0
[ 6.063029] sd 0:0:5:0: Attached scsi generic sg5 type 0
[ 6.063084] sd 0:0:6:0: Attached scsi generic sg6 type 0
[ 6.063141] sd 0:0:7:0: Attached scsi generic sg7 type 0
[ 6.063194] sd 0:0:8:0: Attached scsi generic sg8 type 0
[ 6.063250] sd 0:0:9:0: Attached scsi generic sg9 type 0
[ 6.063305] sd 0:0:10:0: Attached scsi generic sg10 type 0
[ 6.063362] sd 0:0:11:0: Attached scsi generic sg11 type 0
[ 6.063418] sd 0:0:12:0: Attached scsi generic sg12 type 0
[ 6.063472] sd 0:0:13:0: Attached scsi generic sg13 type 0
[ 6.063525] sd 0:0:14:0: Attached scsi generic sg14 type 0
[ 6.063579] sd 0:0:15:0: Attached scsi generic sg15 type 0
[ 6.063634] sd 0:0:16:0: Attached scsi generic sg16 type 0
[ 6.063688] sd 0:0:17:0: Attached scsi generic sg17 type 0
[ 6.063744] sd 0:0:18:0: Attached scsi generic sg18 type 0
[ 6.063798] sd 0:0:19:0: Attached scsi generic sg19 type 0
[ 6.063851] sd 0:0:20:0: Attached scsi generic sg20 type 0
[ 6.063905] sd 0:0:21:0: Attached scsi generic sg21 type 0
[ 6.063958] sd 0:0:22:0: Attached scsi generic sg22 type 0
[ 6.064015] sd 0:0:23:0: Attached scsi generic sg23 type 0
[ 6.064069] sd 0:0:24:0: Attached scsi generic sg24 type 0
[ 6.064133] sd 0:0:25:0: Attached scsi generic sg25 type 0
[ 6.064188] scsi 0:0:26:0: Attached scsi generic sg26 type 13
[ 6.108320] ses 0:0:26:0: Attached Enclosure device
[ 6.291301] md: bind<sdc1>
[ 6.291663] md: bind<sdb5>
[ 6.293467] md: raid1 personality registered for level 1
[ 6.293905] md/raid1:md0: active with 2 out of 2 mirrors
[ 6.294037] created bitmap (14 pages) for device md0
[ 6.294678] md0: bitmap initialized from disk: read 1 pages, set 2 of 28600 bits
[ 6.294867] md0: detected capacity change from 0 to 1919247450112
[ 6.295377] md0: unknown partition table
[ 6.318436] device-mapper: uevent: version 1.0.3
[ 6.318557] device-mapper: ioctl: 4.27.0-ioctl (2013-10-30) initialised: dm-devel@xxxxxxxxxx
[ 6.817886] PM: Starting manual resume from disk
[ 6.817894] PM: Hibernation image partition 253:1 present
[ 6.817897] PM: Looking for hibernation image.
[ 6.818049] PM: Image not found (code -22)
[ 6.818052] PM: Hibernation image not present or could not be loaded.
[ 6.866766] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
[ 6.931707] systemd[1]: systemd 215 running in system mode. (+PAM +AUDIT +SELINUX +IMA +SYSVINIT +LIBCRYPTSETUP +GCRYPT +ACL +XZ -SECCOMP -APPARMOR)
[ 6.932124] systemd[1]: Detected architecture 'x86-64'.
[ 6.940655] systemd[1]: Inserted module 'autofs4'
[ 6.940978] systemd[1]: Set hostname to <archive03>.
[ 7.001460] systemd[1]: Cannot add dependency job for unit display-manager.service, ignoring: Unit display-manager.service failed to load: No such file or directory.
[ 7.002091] systemd[1]: Starting Forward Password Requests to Wall Directory Watch.
[ 7.002209] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[ 7.002231] systemd[1]: Starting Remote File Systems (Pre).
[ 7.002272] systemd[1]: Reached target Remote File Systems (Pre).
[ 7.002297] systemd[1]: Starting Dispatch Password Requests to Console Directory Watch.
[ 7.002344] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[ 7.002376] systemd[1]: Starting Arbitrary Executable File Formats File System Automount Point.
[ 7.002651] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[ 7.002671] systemd[1]: Expecting device dev-mapper-vol01\x2dswap.device...
[ 7.002688] systemd[1]: Expecting device dev-disk-by\x2duuid-e82de650\x2d7849\x2d402b\x2db831\x2d63e42733996b.device...
[ 7.002701] systemd[1]: Expecting device dev-mapper-vol01\x2dvar.device...
[ 7.002715] systemd[1]: Starting Root Slice.
[ 7.002748] systemd[1]: Created slice Root Slice.
[ 7.002761] systemd[1]: Starting User and Session Slice.
[ 7.002820] systemd[1]: Created slice User and Session Slice.
[ 7.002834] systemd[1]: Starting Delayed Shutdown Socket.
[ 7.002873] systemd[1]: Listening on Delayed Shutdown Socket.
[ 7.002887] systemd[1]: Starting /dev/initctl Compatibility Named Pipe.
[ 7.002931] systemd[1]: Listening on /dev/initctl Compatibility Named Pipe.
[ 7.002944] systemd[1]: Starting Journal Socket (/dev/log).
[ 7.002988] systemd[1]: Listening on Journal Socket (/dev/log).
[ 7.003003] systemd[1]: Starting Device-mapper event daemon FIFOs.
[ 7.003038] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[ 7.003051] systemd[1]: Starting LVM2 metadata daemon socket.
[ 7.003086] systemd[1]: Listening on LVM2 metadata daemon socket.
[ 7.003103] systemd[1]: Starting udev Control Socket.
[ 7.003130] systemd[1]: Listening on udev Control Socket.
[ 7.003145] systemd[1]: Starting udev Kernel Socket.
[ 7.003173] systemd[1]: Listening on udev Kernel Socket.
[ 7.003190] systemd[1]: Starting Journal Socket.
[ 7.003232] systemd[1]: Listening on Journal Socket.
[ 7.003262] systemd[1]: Starting System Slice.
[ 7.003315] systemd[1]: Created slice System Slice.
[ 7.003338] systemd[1]: Started File System Check on Root Device.
[ 7.003351] systemd[1]: Starting system-systemd\x2dfsck.slice.
[ 7.003418] systemd[1]: Created slice system-systemd\x2dfsck.slice.
[ 7.003434] systemd[1]: Starting system-getty.slice.
[ 7.003491] systemd[1]: Created slice system-getty.slice.
[ 7.003524] systemd[1]: Starting Increase datagram queue length...
[ 7.004210] systemd[1]: Starting Create list of required static device nodes for the current kernel...
[ 7.005114] systemd[1]: Starting udev Coldplug all Devices...
[ 7.005794] systemd[1]: Mounting Debug File System...
[ 7.006764] systemd[1]: Started Set Up Additional Binary Formats.
[ 7.006820] systemd[1]: Mounting Huge Pages File System...
[ 7.008666] systemd[1]: Starting Load Kernel Modules...
[ 7.009338] systemd[1]: Mounting POSIX Message Queue File System...
[ 7.009975] systemd[1]: Starting Slices.
[ 7.010010] systemd[1]: Reached target Slices.
[ 7.011107] systemd[1]: Started Create list of required static device nodes for the current kernel.
[ 7.012991] systemd[1]: Mounted POSIX Message Queue File System.
[ 7.013052] systemd[1]: Mounted Huge Pages File System.
[ 7.013091] systemd[1]: Mounted Debug File System.
[ 7.013881] systemd[1]: Started Increase datagram queue length.
[ 7.015286] systemd[1]: Started Load Kernel Modules.
[ 7.031563] systemd[1]: Starting Apply Kernel Variables...
[ 7.032486] systemd[1]: Mounted Configuration File System.
[ 7.032531] systemd[1]: Mounted FUSE Control File System.
[ 7.032551] systemd[1]: Starting Syslog Socket.
[ 7.032617] systemd[1]: Listening on Syslog Socket.
[ 7.032641] systemd[1]: Starting Journal Service...
[ 7.033470] systemd[1]: Started Journal Service.
[ 7.050291] systemd-udevd[345]: starting version 215
[ 7.094886] Monitor-Mwait will be used to enter C-1 state
[ 7.095615] Monitor-Mwait will be used to enter C-2 state
[ 7.095669] Monitor-Mwait will be used to enter C-3 state
[ 7.095706] ACPI: acpi_idle registered with cpuidle
[ 7.095767] input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input2
[ 7.095778] ACPI: Sleep Button [SLPB]
[ 7.095924] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input3
[ 7.095932] ACPI: Power Button [PWRB]
[ 7.096069] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4
[ 7.096075] ACPI: Power Button [PWRF]
[ 7.111508] ipmi message handler version 39.2
[ 7.113106] IPMI System Interface driver.
[ 7.113139] ipmi_si: probing via ACPI
[ 7.113158] ipmi_si 00:07: [io 0x0ca4] regsize 1 spacing 1 irq 0
[ 7.113161] ipmi_si: Adding ACPI-specified kcs state machine
[ 7.113175] ipmi_si: probing via SMBIOS
[ 7.113177] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[ 7.113179] ipmi_si: Adding SMBIOS-specified kcs state machine
[ 7.113181] ipmi_si: probing via SPMI
[ 7.113183] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[ 7.113184] ipmi_si: Adding SPMI-specified kcs state machine duplicate interface
[ 7.113187] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca4, slave address 0x0, irq 0
[ 7.116792] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 7.149236] zavl: module license 'CDDL' taints kernel.
[ 7.149238] Disabling lock debugging due to kernel taint
[ 7.152719] SPL: Loaded module v0.6.5.9-1~bpo8+1
[ 7.170113] EXT4-fs (dm-0): re-mounted. Opts: errors=remount-ro
[ 7.178583] ZFS: Loaded module v0.6.5.9-5~bpo8+1, ZFS pool version 5000, ZFS filesystem version 5
[ 7.186322] input: PC Speaker as /devices/platform/pcspkr/input/input5
[ 7.192028] [drm] Initialized drm 1.1.0 20060810
[ 7.193744] AVX2 version of gcm_enc/dec engaged.
[ 7.196869] [drm] AST 2400 detected
[ 7.197035] [drm] dram 1632000000 1 16 01000000
[ 7.197071] [TTM] Zone kernel: Available graphics memory: 16482456 kiB
[ 7.197073] [TTM] Zone dma32: Available graphics memory: 2097152 kiB
[ 7.197073] [TTM] Initializing pool allocator
[ 7.197078] [TTM] Initializing DMA pool allocator
[ 7.207370] fbcon: astdrmfb (fb0) is primary device
[ 7.209816] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[ 7.218868] ipmi_si 00:07: Error clearing flags: cc
[ 7.224525] alg: No test for crc32 (crc32-pclmul)
[ 7.234849] kvm: disabled by bios
[ 7.253072] Adding 3903484k swap on /dev/mapper/vol01-swap. Priority:-1 extents:1 across:3903484k FS
[ 7.256215] Console: switching to colour frame buffer device 128x48
[ 7.257209] ipmi_si 00:07: Found new BMC (man_id: 0x002a7c, prod_id: 0x089a, dev_id: 0x20)
[ 7.257215] ipmi_si 00:07: IPMI kcs interface initialized
[ 7.267834] EXT4-fs (sdb1): mounted filesystem with ordered data mode. Opts: (null)
[ 7.281795] ast 0000:06:00.0: fb0: astdrmfb frame buffer device
[ 7.281796] ast 0000:06:00.0: registered panic notifier
[ 7.289010] kvm: disabled by bios
[ 7.296799] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0
[ 7.576394] EXT4-fs (dm-2): mounted filesystem with ordered data mode. Opts: (null)
[ 10.233919] SPL: using hostid 0x10acd623
[ 10.529801] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[ 10.869009] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 10.887417] FS-Cache: Loaded
[ 10.891833] RPC: Registered named UNIX socket transport module.
[ 10.891836] RPC: Registered udp transport module.
[ 10.891837] RPC: Registered tcp transport module.
[ 10.891838] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 10.896739] FS-Cache: Netfs 'nfs' registered for caching
[ 10.898410] Key type dns_resolver registered
[ 10.902585] NFS: Registering the id_resolver key type
[ 10.902594] Key type id_resolver registered
[ 10.902596] Key type id_legacy registered
[ 10.942260] Installing knfsd (copyright (C) 1996 okir@xxxxxxxxxxxx).
[ 13.451925] igb 0000:04:00.0 eth1: igb: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[ 13.452411] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
[ 13.768033] igb 0000:03:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[ 13.768520] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[ 47.949804] systemd-journald[341]: Received request to flush runtime journal from PID 1
[ 48.094709] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ 48.096059] NFSD: starting 90-second grace period (net ffffffff818ba780)
[ 48.344225] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 84.114925] SGI XFS with ACLs, security attributes, realtime, large block/inode numbers, no debug enabled
[ 151.205042] EXT4-fs (dm-3): mounted filesystem with ordered data mode. Opts: (null)
[ 606.399919] nfsd: last server has exited, flushing export cache
[ 606.436295] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ 606.436319] NFSD: starting 90-second grace period (net ffffffff818ba780)
[ 1387.923427] md: md1 stopped.
[ 1387.938843] sdy: unknown partition table
[ 1387.939469] md: bind<sdz>
[ 1387.939814] md: bind<sdy>
[ 1387.939915] md: md1 stopped.
[ 1387.939926] md: unbind<sdy>
[ 1387.953137] md: export_rdev(sdy)
[ 1387.953155] md: unbind<sdz>
[ 1387.978796] md: export_rdev(sdz)
[ 1693.122601] XFS (md1): SB validate failed with error 5.
[ 2152.411311] XFS (md1): SB validate failed with error 5.
[ 2325.591296] sdy: unknown partition table
[ 2737.867398] sdy: unknown partition table
[ 2779.003710] sdy: unknown partition table
[ 2791.411342] sdy: unknown partition table
[ 2899.855864] sdy: sdy1 sdy9
[ 2900.865984] sdy: sdy1 sdy9
[ 2917.403568] sdz: sdz1 sdz9
[ 3031.963601] sde: sde1 sde9
[34505.219608] perf interrupt took too long (2523 > 2500), lowering kernel.perf_event_max_sample_rate to 50000
[47199.849159] st: Version 20101219, fixed bufsize 32768, s/g segs 256
[47205.442401] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[47205.442402] EDD information not available.
# definitions of existing MD arrays
ARRAY /dev/md/0 metadata=1.2 UUID=694adba6:d96199c0:f3f250c2:b5a1dc3b name=archive03:0
# ARRAY /dev/md/1 metadata=1.2 UUID=44cbe821:c4e585d1:90652f85:aaaa5ec3 name=archive03:1
md0 is working, md1 not, even if i comment the line in.
Any ideas?
Best regards,
Volker
> Am 23.04.2019 um 13:41 schrieb Andreas Klauer <Andreas.Klauer@xxxxxxxxxxxxxx>:
>
> On Tue, Apr 23, 2019 at 11:54:11AM +0200, Volker Lieder wrote:
>> With mdadm i could get and preserve information about the drives and super block information:
>>
>> mdadm --examine /dev/sda /dev/sd[d-z] >> raid.status
>
> If you want any help you'd have to share this output...
> ( mdadm --examine /dev/sd* , also check smartctl -a and dmesg )
>
>> I have read some sites like this:
>
> https://unix.stackexchange.com/a/131927/30851
>
> Regards
> Andreas Klauer
