Re: DIF/DIX issue related to config CONFIG_SCSI_MQ_DEFAULT

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 04/12/2018 03:55, Martin K. Petersen wrote:

Hi John,

Hi Martin,


We have also noticed that if we just enable DIF in hisi_sas (with MQ),
and not DIX, then no issue.

Enabling DIF doesn't really do anything on the kernel side other than
setting PROTECT=1 in the READ/WRITE CDB and telling the driver which DIX
protection operation the HBA should use. Since protection information is
invisible to the kernel and only sent on the wire between initiator and
target, enabling DIF doesn't really have the ability to interfere with
anything on the kernel side. We're basically just setting flags asking
HBA and storage to enable protected transfers.

Thanks for the info. I do realise that you're the expert here :)


I did also noticed mail "[PATCH v2 01/23] zfcp: make DIX experimental,
disabled, and independent of DIF", where DIX is made experimental.

...for the zfcp driver on zSeries.

Just nitpicking on terminology here:

T10 Protection Information (formerly known as DIF) describes how to
generate and verify 8 bytes of extra information that's sent trailing
each logical block on the wire between an initiator and target. The T10
PI spec is focused on the target device implementation of this and
largely ignores the initiator side.

DIX tries to remedy this deficiency. It is a spec that describes a set
of logical operations an initiator must implement to facilitate sending
and receiving the T10 protection information to/from host memory instead
of terminating it at the HBA. The DIX spec isn't experimental, it's
about a decade old and hasn't changed in years.

The Linux kernel support for data integrity passthrough in the block
layer and SCSI isn't experimental either. It's also a decade old and
used extensively in production.

So I object to the notion of "DIX being made experimental". An
ASIC/firmware/driver implementation of DIX may be experimental. And of
course I can't rule out regressions in the kernel block integrity
implementation as a result of some of the recent MQ changes

Yes, it's unfair to quote "DIX being made experimental".

(will be
happy to work with you guys to figure those out).

OK, great. Happy to help. So far we have hisi_sas fio issue to go on plus knowledge that this issue seems to be exposed/triggered by enabling SCSI MQ.

We could try to bisect SCSI MQ support - is that folly?


But DIX isn't experimental, nor is the kernel support for passing
protection information to an HBA.

For now we may not support DIX. It seems to have issues. We wanted to
try 3008 card on our system, but it does not seem to support DIX 0-3.

For some reason Broadcom have not upstreamed their DIX support. It's
supposedly available in their outbox driver.

My colleague chenxiang also tried DIF on 3008 with our same platform, and we are seeing an issue there also; here's a snippet:

root@(none)$ fisk      fdisk -l

Disk /dev/sda: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: s[ 90.026732] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08 [ 90.026732] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[   90.046091] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current]
[   90.046091] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current]
[   90.058285] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3
[   90.058285] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3
[ 90.069087] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00 [ 90.069087] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[   90.084763] print_req_error: protection error, dev sde, sector 8
[   90.084763] print_req_error: protection error, dev sde, sector

I haven't had a chance to check the details. I have attached a log.

Thanks,
John

SmiGraphicsOutputQueryMode +
SmiGraphicsOutputQueryMode -
SmiGraphicsOutputQueryMode +
SmiGraphicsOutputQueryMode -
EFI stub: Generating empty DTB
Failed to handle fs_proto
EFI stub: ERROR: Failed initrd from command line!
EFI stub: Exiting boot services and installing virtual address map...
WriteBackInvalidateDataCacheRange start
WriteBackInvalidateDataCacheRange end
IPMI ExitBootService Event
TransferSmbiosToBMC EVENT.
Transfer Smbios Table To iBMC Success.
[    0.000000] Booting Linux on physical CPU 0x0000010000 [0x480fd010]
[    0.000000] Linux version 4.19.0-rc4-00948-gbad69f9 (chenxiang@Turing-Arch-b) (gcc version 4.9.1 20140505 (prerelease) (crosstool-NG linaro-1.13.1-4.9-2014.05 - Linaro GCC 4.9-2014.05)) #1100 SMP PREEMPT Tue Dec 4 10:50:29 CST 2018
[    0.000000] earlycon: pl11 at MMIO32 0x0000000094080000 (options '')
[    0.000000] bootconsole [pl11] enabled
[    0.000000] efi: Getting EFI parameters from FDT:
[    0.000000] efi: EFI v2.70 by EDK II
[    0.000000] efi:  SMBIOS 3.0=0x3f2a0000  ACPI 2.0=0x3a000000  MEMATTR=0x3b65c018  ESRT=0x3b66bd98 
[    0.000000] esrt: Reserving ESRT space from 0x000000003b66bd98 to 0x000000003b66bdd0.
[    0.000000] cma: Reserved 16 MiB at 0x000000003e000000
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x000000003A000000 000024 (v02 HISI  )
[    0.000000] ACPI: XSDT 0x0000000039FF0000 00009C (v01 HISI   HIP08    00000000      01000013)
[    0.000000] ACPI: FACP 0x0000000039AD0000 000114 (v06 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: DSDT 0x0000000039A50000 00618A (v02 HISI   HIP08    00000000 INTL 20170929)
[    0.000000] ACPI: BERT 0x0000000039F50000 000030 (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: HEST 0x0000000039F40000 00013C (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: ERST 0x0000000039F20000 000230 (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: EINJ 0x0000000039F10000 000170 (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: GTDT 0x0000000039AC0000 000060 (v02 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: DBG2 0x0000000039AB0000 00005A (v00 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: MCFG 0x0000000039AA0000 00003C (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SLIT 0x0000000039A90000 00003C (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SPCR 0x0000000039A80000 000050 (v02 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SRAT 0x0000000039A70000 000774 (v03 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: APIC 0x0000000039A60000 001E58 (v04 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: IORT 0x0000000039A40000 0010F4 (v00 HISI   HIP08    00000000 INTL 20170929)
[    0.000000] ACPI: PPTT 0x0000000030EC0000 002A30 (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SPMI 0x0000000030EB0000 000041 (v05 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SPCR: console: pl011,mmio32,0x94080000,115200
[    0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x2080000000-0x27ffffffff]
[    0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x2800000000-0x2fffffffff]
[    0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[    0.000000] NUMA: NODE_DATA [mem 0x27ffffe7c0-0x27ffffffff]
[    0.000000] NUMA: NODE_DATA [mem 0x2ffffeb7c0-0x2ffffecfff]
[    0.000000] NUMA: Initmem setup node 2 [<memory-less node>]
[    0.000000] NUMA: NODE_DATA [mem 0x2ffffe9f80-0x2ffffeb7bf]
[    0.000000] NUMA: NODE_DATA(2) on node 1
[    0.000000] NUMA: Initmem setup node 3 [<memory-less node>]
[    0.000000] NUMA: NODE_DATA [mem 0x2ffffe8740-0x2ffffe9f7f]
[    0.000000] NUMA: NODE_DATA(3) on node 1
[    0.000000] Zone ranges:
[    0.000000]   DMA32    [mem 0x0000000000000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x0000002fffffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x00000000305dbfff]
[    0.000000]   node   0: [mem 0x00000000305dc000-0x0000000030eaffff]
[    0.000000]   node   0: [mem 0x0000000030eb0000-0x0000000039adffff]
[    0.000000]   node   0: [mem 0x0000000039ae0000-0x0000000039aeffff]
[    0.000000]   node   0: [mem 0x0000000039af0000-0x0000000039afffff]
[    0.000000]   node   0: [mem 0x0000000039b00000-0x0000000039cdffff]
[    0.000000]   node   0: [mem 0x0000000039ce0000-0x0000000039d0ffff]
[    0.000000]   node   0: [mem 0x0000000039d10000-0x0000000039e4ffff]
[    0.000000]   node   0: [mem 0x0000000039e50000-0x0000000039f39fff]
[    0.000000]   node   0: [mem 0x0000000039f3a000-0x0000000039f3ffff]
[    0.000000]   node   0: [mem 0x0000000039f40000-0x0000000039f5ffff]
[    0.000000]   node   0: [mem 0x0000000039f60000-0x0000000039feffff]
[    0.000000]   node   0: [mem 0x0000000039ff0000-0x000000003a00ffff]
[    0.000000]   node   0: [mem 0x000000003a010000-0x000000003a2affff]
[    0.000000]   node   0: [mem 0x000000003a2b0000-0x000000003a2b1fff]
[    0.000000]   node   0: [mem 0x000000003a2b2000-0x000000003a2bbfff]
[    0.000000]   node   0: [mem 0x000000003a2bc000-0x000000003f29ffff]
[    0.000000]   node   0: [mem 0x000000003f2a0000-0x000000003f2cffff]
[    0.000000]   node   0: [mem 0x000000003f2d0000-0x000000003fbfffff]
[    0.000000]   node   0: [mem 0x0000002080000000-0x00000027ffffffff]
[    0.000000]   node   1: [mem 0x0000002800000000-0x0000002fffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000027ffffffff]
[    0.000000] Initmem setup node 1 [mem 0x0000002800000000-0x0000002fffffffff]
[    0.000000] Could not find start_pfn for node 2
[    0.000000] Initmem setup node 2 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] Could not find start_pfn for node 3
[    0.000000] Initmem setup node 3 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] psci: probing for conduit method from ACPI.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.1
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10001 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10002 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10003 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10100 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10101 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10102 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10103 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10200 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10201 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10202 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10203 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10300 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10301 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10302 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10303 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10400 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10401 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10402 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10403 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10500 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10501 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10502 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10503 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30001 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30002 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30003 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30100 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30101 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30102 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30103 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30200 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30201 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30202 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30203 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30300 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30301 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30302 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30303 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30400 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30401 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30402 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30403 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30500 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30501 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30502 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30503 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50000 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50001 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50002 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50003 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50100 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50101 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50102 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50103 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50200 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50201 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50202 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50203 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50300 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50301 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50302 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50303 -> Node 2
[    0.000000] random: get_random_bytes called from start_kernel+0xa8/0x414 with crng_init=0
[    0.000000] percpu: Embedded 24 pages/cpu @(____ptrval____) s58176 r8192 d31936 u98304
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: detected: Virtualization Host Extensions
[    0.000000] CPU features: detected: Kernel page table isolation (KPTI)
[    0.000000] CPU features: detected: Hardware dirty bit management
[    0.000000] Built 4 zonelists, mobility grouping on.  Total pages: 16256016
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: earlycon=pl011,mmio32,0x94080000 console=ttyAMA0,115200 acpi=force root=/dev/ram0 rw initrd=0x7000000,120M
[    0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 258048 bytes
[    0.000000] log_buf_len min size: 131072 bytes
[    0.000000] log_buf_len: 524288 bytes
[    0.000000] early log buf free: 118652(90%)
[    0.000000] software IO TLB: mapped [mem 0x35a40000-0x39a40000] (64MB)
[    0.000000] Memory: 64770888K/66056192K available (13116K kernel code, 1524K rwdata, 5564K rodata, 1216K init, 505K bss, 1268920K reserved, 16384K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=64, Nodes=4
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] 	Tasks RCU enabled.
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: Distributor has no Range Selector support
[    0.000000] GICv3: VLPI support, direct LPI support
[    0.000000] SRAT: PXM 0 -> ITS 0 -> Node 0
[    0.000000] ITS [mem 0x202100000-0x20211ffff]
[    0.000000] ITS@0x0000000202100000: Using ITS number 0
[    0.000000] ITS@0x0000000202100000: allocated 8192 Devices @27e0560000 (indirect, esz 8, psz 16K, shr 1)
[    0.000000] ITS@0x0000000202100000: allocated 2048 Virtual CPUs @27e0548000 (indirect, esz 16, psz 4K, shr 1)
[    0.000000] ITS@0x0000000202100000: allocated 256 Interrupt Collections @27e0546000 (flat, esz 16, psz 4K, shr 1)
[    0.000000] GIC: using LPI property table @0x00000027e0570000
[    0.000000] ITS: Using DirectLPI for VPE invalidation
[    0.000000] ITS: Enabling GICv4 support
[    0.000000] GICv3: CPU0: found redistributor 10000 region 0:0x00000000ae100000
[    0.000000] CPU0: using LPI pending table @0x00000027e0580000
[    0.000000] arch_timer: cp15 timer(s) running at 100.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x171024e7e0, max_idle_ns: 440795205315 ns
[    0.000001] sched_clock: 56 bits at 100MHz, resolution 10ns, wraps every 4398046511100ns
[    0.008223] Console: colour dummy device 80x25
[    0.012724] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.024006] ACPI: Core revision 20180810
[    0.028052] Calibrating delay loop (skipped), value calculated using timer frequency.. 200.00 BogoMIPS (lpj=400000)
[    0.038540] pid_max: default: 65536 minimum: 512
[    0.043214] Security Framework initialized
[    0.057571] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[    0.070060] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.077583] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.084826] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.120381] ASID allocator initialised with 32768 entries
[    0.125829] rcu: Hierarchical SRCU implementation.
[    0.138657] Platform MSI: ITS@0x202100000 domain created
[    0.143999] PCI/MSI: ITS@0x202100000 domain created
[    0.148942] Remapping and enabling EFI services.
[    0.165589] smp: Bringing up secondary CPUs ...
NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x4   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x4   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x4   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x4   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x5   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x5   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x5   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[157L] Modify TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x5   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x4   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x4   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x4   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x4   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x5   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x5   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x5   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[167L] Modify TB Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x5   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x0   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x1   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x2   domain_bit = 0x3  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x0  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x1  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x2  

NOTICE:  [D06_nopmu_pwr_domain_on]:[62L] 

NOTICE:  [scpi_set_css_power_state]:[177L] Modify S1 TA Boot Address to 3fc00000

NOTICE:  [scpi_set_css_power_state]:[196L] ulpos_mpidr = 0x3   domain_bit = 0x3  

[    0.217433] Detected VIPT I-cache on CPU1
[    0.217442] GICv3: CPU1: found redistributor 10001 region 1:0x00000000ae140000
[    0.217461] CPU1: using LPI pending table @0x00000027dccc0000
[    0.217475] CPU1: Booted secondary processor 0x0000010001 [0x480fd010]
[    0.264646] Detected VIPT I-cache on CPU2
[    0.264652] GICv3: CPU2: found redistributor 10002 region 2:0x00000000ae180000
[    0.264671] CPU2: using LPI pending table @0x00000027dccd0000
[    0.264681] CPU2: Booted secondary processor 0x0000010002 [0x480fd010]
[    0.311860] Detected VIPT I-cache on CPU3
[    0.311866] GICv3: CPU3: found redistributor 10003 region 3:0x00000000ae1c0000
[    0.311885] CPU3: using LPI pending table @0x00000027dcd30000
[    0.311894] CPU3: Booted secondary processor 0x0000010003 [0x480fd010]
[    0.359081] Detected VIPT I-cache on CPU4
[    0.359091] GICv3: CPU4: found redistributor 10100 region 4:0x00000000ae200000
[    0.359112] CPU4: using LPI pending table @0x00000027dcd40000
[    0.359126] CPU4: Booted secondary processor 0x0000010100 [0x480fd010]
[    0.406292] Detected VIPT I-cache on CPU5
[    0.406299] GICv3: CPU5: found redistributor 10101 region 5:0x00000000ae240000
[    0.406318] CPU5: using LPI pending table @0x00000027dcd50000
[    0.406329] CPU5: Booted secondary processor 0x0000010101 [0x480fd010]
[    0.453508] Detected VIPT I-cache on CPU6
[    0.453515] GICv3: CPU6: found redistributor 10102 region 6:0x00000000ae280000
[    0.453534] CPU6: using LPI pending table @0x00000027dcda0000
[    0.453545] CPU6: Booted secondary processor 0x0000010102 [0x480fd010]
[    0.500724] Detected VIPT I-cache on CPU7
[    0.500732] GICv3: CPU7: found redistributor 10103 region 7:0x00000000ae2c0000
[    0.500751] CPU7: using LPI pending table @0x00000027dcdc0000
[    0.500761] CPU7: Booted secondary processor 0x0000010103 [0x480fd010]
[    0.547944] Detected VIPT I-cache on CPU8
[    0.547953] GICv3: CPU8: found redistributor 10200 region 8:0x00000000ae300000
[    0.547973] CPU8: using LPI pending table @0x00000027dcdd0000
[    0.547987] CPU8: Booted secondary processor 0x0000010200 [0x480fd010]
[    0.595157] Detected VIPT I-cache on CPU9
[    0.595164] GICv3: CPU9: found redistributor 10201 region 9:0x00000000ae340000
[    0.595183] CPU9: using LPI pending table @0x00000027dce20000
[    0.595195] CPU9: Booted secondary processor 0x0000010201 [0x480fd010]
[    0.642374] Detected VIPT I-cache on CPU10
[    0.642383] GICv3: CPU10: found redistributor 10202 region 10:0x00000000ae380000
[    0.642402] CPU10: using LPI pending table @0x00000027dce30000
[    0.642412] CPU10: Booted secondary processor 0x0000010202 [0x480fd010]
[    0.689590] Detected VIPT I-cache on CPU11
[    0.689599] GICv3: CPU11: found redistributor 10203 region 11:0x00000000ae3c0000
[    0.689617] CPU11: using LPI pending table @0x00000027dce40000
[    0.689628] CPU11: Booted secondary processor 0x0000010203 [0x480fd010]
[    0.736811] Detected VIPT I-cache on CPU12
[    0.736822] GICv3: CPU12: found redistributor 10300 region 12:0x00000000ae400000
[    0.736842] CPU12: using LPI pending table @0x00000027dcea0000
[    0.736856] CPU12: Booted secondary processor 0x0000010300 [0x480fd010]
[    0.784024] Detected VIPT I-cache on CPU13
[    0.784034] GICv3: CPU13: found redistributor 10301 region 13:0x00000000ae440000
[    0.784052] CPU13: using LPI pending table @0x00000027dceb0000
[    0.784063] CPU13: Booted secondary processor 0x0000010301 [0x480fd010]
[    0.831241] Detected VIPT I-cache on CPU14
[    0.831250] GICv3: CPU14: found redistributor 10302 region 14:0x00000000ae480000
[    0.831269] CPU14: using LPI pending table @0x00000027dcec0000
[    0.831280] CPU14: Booted secondary processor 0x0000010302 [0x480fd010]
[    0.878458] Detected VIPT I-cache on CPU15
[    0.878467] GICv3: CPU15: found redistributor 10303 region 15:0x00000000ae4c0000
[    0.878487] CPU15: using LPI pending table @0x00000027dcf20000
[    0.878498] CPU15: Booted secondary processor 0x0000010303 [0x480fd010]
[    0.925682] Detected VIPT I-cache on CPU16
[    0.925693] GICv3: CPU16: found redistributor 10400 region 16:0x00000000ae500000
[    0.925713] CPU16: using LPI pending table @0x00000027dcf30000
[    0.925728] CPU16: Booted secondary processor 0x0000010400 [0x480fd010]
[    0.972894] Detected VIPT I-cache on CPU17
[    0.972903] GICv3: CPU17: found redistributor 10401 region 17:0x00000000ae540000
[    0.972922] CPU17: using LPI pending table @0x00000027dcf40000
[    0.972933] CPU17: Booted secondary processor 0x0000010401 [0x480fd010]
[    1.020111] Detected VIPT I-cache on CPU18
[    1.020120] GICv3: CPU18: found redistributor 10402 region 18:0x00000000ae580000
[    1.020139] CPU18: using LPI pending table @0x00000027dcfa0000
[    1.020150] CPU18: Booted secondary processor 0x0000010402 [0x480fd010]
[    1.067327] Detected VIPT I-cache on CPU19
[    1.067337] GICv3: CPU19: found redistributor 10403 region 19:0x00000000ae5c0000
[    1.067356] CPU19: using LPI pending table @0x00000027dcfb0000
[    1.067367] CPU19: Booted secondary processor 0x0000010403 [0x480fd010]
[    1.114549] Detected VIPT I-cache on CPU20
[    1.114561] GICv3: CPU20: found redistributor 10500 region 20:0x00000000ae600000
[    1.114581] CPU20: using LPI pending table @0x00000027dcfc0000
[    1.114596] CPU20: Booted secondary processor 0x0000010500 [0x480fd010]
[    1.161762] Detected VIPT I-cache on CPU21
[    1.161772] GICv3: CPU21: found redistributor 10501 region 21:0x00000000ae640000
[    1.161791] CPU21: using LPI pending table @0x00000027dc810000
[    1.161803] CPU21: Booted secondary processor 0x0000010501 [0x480fd010]
[    1.208980] Detected VIPT I-cache on CPU22
[    1.208991] GICv3: CPU22: found redistributor 10502 region 22:0x00000000ae680000
[    1.209010] CPU22: using LPI pending table @0x00000027dc820000
[    1.209021] CPU22: Booted secondary processor 0x0000010502 [0x480fd010]
[    1.256197] Detected VIPT I-cache on CPU23
[    1.256208] GICv3: CPU23: found redistributor 10503 region 23:0x00000000ae6c0000
[    1.256227] CPU23: using LPI pending table @0x00000027dc830000
[    1.256238] CPU23: Booted secondary processor 0x0000010503 [0x480fd010]
[    1.303470] Detected VIPT I-cache on CPU24
[    1.303489] GICv3: CPU24: found redistributor 30000 region 24:0x00000000aa100000
[    1.303511] CPU24: using LPI pending table @0x00000027dc850000
[    1.303531] CPU24: Booted secondary processor 0x0000030000 [0x480fd010]
[    1.350683] Detected VIPT I-cache on CPU25
[    1.350696] GICv3: CPU25: found redistributor 30001 region 25:0x00000000aa140000
[    1.350715] CPU25: using LPI pending table @0x00000027dc860000
[    1.350727] CPU25: Booted secondary processor 0x0000030001 [0x480fd010]
[    1.397902] Detected VIPT I-cache on CPU26
[    1.397915] GICv3: CPU26: found redistributor 30002 region 26:0x00000000aa180000
[    1.397935] CPU26: using LPI pending table @0x00000027dc870000
[    1.397947] CPU26: Booted secondary processor 0x0000030002 [0x480fd010]
[    1.445121] Detected VIPT I-cache on CPU27
[    1.445134] GICv3: CPU27: found redistributor 30003 region 27:0x00000000aa1c0000
[    1.445154] CPU27: using LPI pending table @0x00000027dc890000
[    1.445166] CPU27: Booted secondary processor 0x0000030003 [0x480fd010]
[    1.492348] Detected VIPT I-cache on CPU28
[    1.492367] GICv3: CPU28: found redistributor 30100 region 28:0x00000000aa200000
[    1.492389] CPU28: using LPI pending table @0x00000027dc8a0000
[    1.492409] CPU28: Booted secondary processor 0x0000030100 [0x480fd010]
[    1.539562] Detected VIPT I-cache on CPU29
[    1.539576] GICv3: CPU29: found redistributor 30101 region 29:0x00000000aa240000
[    1.539596] CPU29: using LPI pending table @0x00000027dc8b0000
[    1.539609] CPU29: Booted secondary processor 0x0000030101 [0x480fd010]
[    1.586783] Detected VIPT I-cache on CPU30
[    1.586798] GICv3: CPU30: found redistributor 30102 region 30:0x00000000aa280000
[    1.586818] CPU30: using LPI pending table @0x00000027dc8d0000
[    1.586830] CPU30: Booted secondary processor 0x0000030102 [0x480fd010]
[    1.634003] Detected VIPT I-cache on CPU31
[    1.634017] GICv3: CPU31: found redistributor 30103 region 31:0x00000000aa2c0000
[    1.634037] CPU31: using LPI pending table @0x00000027dc8e0000
[    1.634049] CPU31: Booted secondary processor 0x0000030103 [0x480fd010]
[    1.681233] Detected VIPT I-cache on CPU32
[    1.681251] GICv3: CPU32: found redistributor 30200 region 32:0x00000000aa300000
[    1.681272] CPU32: using LPI pending table @0x00000027dc8f0000
[    1.681289] CPU32: Booted secondary processor 0x0000030200 [0x480fd010]
[    1.728448] Detected VIPT I-cache on CPU33
[    1.728463] GICv3: CPU33: found redistributor 30201 region 33:0x00000000aa340000
[    1.728482] CPU33: using LPI pending table @0x00000027dc900000
[    1.728495] CPU33: Booted secondary processor 0x0000030201 [0x480fd010]
[    1.775669] Detected VIPT I-cache on CPU34
[    1.775684] GICv3: CPU34: found redistributor 30202 region 34:0x00000000aa380000
[    1.775704] CPU34: using LPI pending table @0x00000027dc910000
[    1.775717] CPU34: Booted secondary processor 0x0000030202 [0x480fd010]
[    1.822890] Detected VIPT I-cache on CPU35
[    1.822905] GICv3: CPU35: found redistributor 30203 region 35:0x00000000aa3c0000
[    1.822924] CPU35: using LPI pending table @0x00000027dc930000
[    1.822937] CPU35: Booted secondary processor 0x0000030203 [0x480fd010]
[    1.870118] Detected VIPT I-cache on CPU36
[    1.870137] GICv3: CPU36: found redistributor 30300 region 36:0x00000000aa400000
[    1.870158] CPU36: using LPI pending table @0x00000027dc950000
[    1.870176] CPU36: Booted secondary processor 0x0000030300 [0x480fd010]
[    1.917333] Detected VIPT I-cache on CPU37
[    1.917348] GICv3: CPU37: found redistributor 30301 region 37:0x00000000aa440000
[    1.917368] CPU37: using LPI pending table @0x00000027dc960000
[    1.917381] CPU37: Booted secondary processor 0x0000030301 [0x480fd010]
[    1.964555] Detected VIPT I-cache on CPU38
[    1.964571] GICv3: CPU38: found redistributor 30302 region 38:0x00000000aa480000
[    1.964590] CPU38: using LPI pending table @0x00000027dc970000
[    1.964603] CPU38: Booted secondary processor 0x0000030302 [0x480fd010]
[    2.011775] Detected VIPT I-cache on CPU39
[    2.011791] GICv3: CPU39: found redistributor 30303 region 39:0x00000000aa4c0000
[    2.011811] CPU39: using LPI pending table @0x00000027dc980000
[    2.011824] CPU39: Booted secondary processor 0x0000030303 [0x480fd010]
[    2.058992] Detected VIPT I-cache on CPU40
[    2.059011] GICv3: CPU40: found redistributor 30400 region 40:0x00000000aa500000
[    2.059033] CPU40: using LPI pending table @0x00000027dc990000
[    2.059050] CPU40: Booted secondary processor 0x0000030400 [0x480fd010]
[    2.106209] Detected VIPT I-cache on CPU41
[    2.106225] GICv3: CPU41: found redistributor 30401 region 41:0x00000000aa540000
[    2.106245] CPU41: using LPI pending table @0x00000027dc9b0000
[    2.106258] CPU41: Booted secondary processor 0x0000030401 [0x480fd010]
[    2.153431] Detected VIPT I-cache on CPU42
[    2.153446] GICv3: CPU42: found redistributor 30402 region 42:0x00000000aa580000
[    2.153466] CPU42: using LPI pending table @0x00000027dc9c0000
[    2.153479] CPU42: Booted secondary processor 0x0000030402 [0x480fd010]
[    2.200652] Detected VIPT I-cache on CPU43
[    2.200668] GICv3: CPU43: found redistributor 30403 region 43:0x00000000aa5c0000
[    2.200687] CPU43: using LPI pending table @0x00000027dc9d0000
[    2.200701] CPU43: Booted secondary processor 0x0000030403 [0x480fd010]
[    2.247880] Detected VIPT I-cache on CPU44
[    2.247900] GICv3: CPU44: found redistributor 30500 region 44:0x00000000aa600000
[    2.247922] CPU44: using LPI pending table @0x00000027dc9e0000
[    2.247940] CPU44: Booted secondary processor 0x0000030500 [0x480fd010]
[    2.295098] Detected VIPT I-cache on CPU45
[    2.295114] GICv3: CPU45: found redistributor 30501 region 45:0x00000000aa640000
[    2.295134] CPU45: using LPI pending table @0x00000027dca00000
[    2.295148] CPU45: Booted secondary processor 0x0000030501 [0x480fd010]
[    2.342319] Detected VIPT I-cache on CPU46
[    2.342336] GICv3: CPU46: found redistributor 30502 region 46:0x00000000aa680000
[    2.342355] CPU46: using LPI pending table @0x00000027dca10000
[    2.342369] CPU46: Booted secondary processor 0x0000030502 [0x480fd010]
[    2.389541] Detected VIPT I-cache on CPU47
[    2.389558] GICv3: CPU47: found redistributor 30503 region 47:0x00000000aa6c0000
[    2.389577] CPU47: using LPI pending table @0x00000027dca20000
[    2.389591] CPU47: Booted secondary processor 0x0000030503 [0x480fd010]
[    2.437193] Detected VIPT I-cache on CPU48
[    2.437237] GICv3: CPU48: found redistributor 50000 region 48:0x00004000ae100000
[    2.437266] CPU48: using LPI pending table @0x00000027dcaa0000
[    2.437297] CPU48: Booted secondary processor 0x0000050000 [0x480fd010]
[    2.484669] Detected VIPT I-cache on CPU49
[    2.484702] GICv3: CPU49: found redistributor 50001 region 49:0x00004000ae140000
[    2.484727] CPU49: using LPI pending table @0x00000027dcbd0000
[    2.484742] CPU49: Booted secondary processor 0x0000050001 [0x480fd010]
[    2.532155] Detected VIPT I-cache on CPU50
[    2.532189] GICv3: CPU50: found redistributor 50002 region 50:0x00004000ae180000
[    2.532213] CPU50: using LPI pending table @0x00000027dc460000
[    2.532228] CPU50: Booted secondary processor 0x0000050002 [0x480fd010]
[    2.579642] Detected VIPT I-cache on CPU51
[    2.579676] GICv3: CPU51: found redistributor 50003 region 51:0x00004000ae1c0000
[    2.579699] CPU51: using LPI pending table @0x00000027dc490000
[    2.579715] CPU51: Booted secondary processor 0x0000050003 [0x480fd010]
[    2.627133] Detected VIPT I-cache on CPU52
[    2.627170] GICv3: CPU52: found redistributor 50100 region 52:0x00004000ae200000
[    2.627194] CPU52: using LPI pending table @0x00000027dc510000
[    2.627212] CPU52: Booted secondary processor 0x0000050100 [0x480fd010]
[    2.674617] Detected VIPT I-cache on CPU53
[    2.674651] GICv3: CPU53: found redistributor 50101 region 53:0x00004000ae240000
[    2.674675] CPU53: using LPI pending table @0x00000027dc5a0000
[    2.674690] CPU53: Booted secondary processor 0x0000050101 [0x480fd010]
[    2.722106] Detected VIPT I-cache on CPU54
[    2.722140] GICv3: CPU54: found redistributor 50102 region 54:0x00004000ae280000
[    2.722164] CPU54: using LPI pending table @0x00000027dc5e0000
[    2.722179] CPU54: Booted secondary processor 0x0000050102 [0x480fd010]
[    2.769594] Detected VIPT I-cache on CPU55
[    2.769628] GICv3: CPU55: found redistributor 50103 region 55:0x00004000ae2c0000
[    2.769652] CPU55: using LPI pending table @0x00000027dc650000
[    2.769667] CPU55: Booted secondary processor 0x0000050103 [0x480fd010]
[    2.817087] Detected VIPT I-cache on CPU56
[    2.817124] GICv3: CPU56: found redistributor 50200 region 56:0x00004000ae300000
[    2.817148] CPU56: using LPI pending table @0x00000027dc690000
[    2.817165] CPU56: Booted secondary processor 0x0000050200 [0x480fd010]
[    2.864573] Detected VIPT I-cache on CPU57
[    2.864608] GICv3: CPU57: found redistributor 50201 region 57:0x00004000ae340000
[    2.864632] CPU57: using LPI pending table @0x00000027dc710000
[    2.864648] CPU57: Booted secondary processor 0x0000050201 [0x480fd010]
[    2.912060] Detected VIPT I-cache on CPU58
[    2.912096] GICv3: CPU58: found redistributor 50202 region 58:0x00004000ae380000
[    2.912119] CPU58: using LPI pending table @0x00000027dc790000
[    2.912134] CPU58: Booted secondary processor 0x0000050202 [0x480fd010]
[    2.959547] Detected VIPT I-cache on CPU59
[    2.959584] GICv3: CPU59: found redistributor 50203 region 59:0x00004000ae3c0000
[    2.959608] CPU59: using LPI pending table @0x00000027dc7e0000
[    2.959623] CPU59: Booted secondary processor 0x0000050203 [0x480fd010]
[    3.007041] Detected VIPT I-cache on CPU60
[    3.007079] GICv3: CPU60: found redistributor 50300 region 60:0x00004000ae400000
[    3.007104] CPU60: using LPI pending table @0x00000027dc050000
[    3.007121] CPU60: Booted secondary processor 0x0000050300 [0x480fd010]
[    3.054530] Detected VIPT I-cache on CPU61
[    3.054566] GICv3: CPU61: found redistributor 50301 region 61:0x00004000ae440000
[    3.054589] CPU61: using LPI pending table @0x00000027dc0d0000
[    3.054605] CPU61: Booted secondary processor 0x0000050301 [0x480fd010]
[    3.102019] Detected VIPT I-cache on CPU62
[    3.102055] GICv3: CPU62: found redistributor 50302 region 62:0x00004000ae480000
[    3.102079] CPU62: using LPI pending table @0x00000027dc110000
[    3.102094] CPU62: Booted secondary processor 0x0000050302 [0x480fd010]
[    3.149507] Detected VIPT I-cache on CPU63
[    3.149544] GICv3: CPU63: found redistributor 50303 region 63:0x00004000ae4c0000
[    3.149567] CPU63: using LPI pending table @0x00000027dc190000
[    3.149582] CPU63: Booted secondary processor 0x0000050303 [0x480fd010]
[    3.149676] smp: Brought up 4 nodes, 64 CPUs
[    4.667123] SMP: Total of 64 processors activated.
[    4.671940] CPU features: detected: GIC system register CPU interface
[    4.678422] CPU features: detected: Privileged Access Never
[    4.684019] CPU features: detected: User Access Override
[    4.689364] CPU features: detected: RAS Extension Support
[    4.704060] CPU: All CPU(s) started at EL2
[    4.708331] alternatives: patching kernel code
[    4.718159] devtmpfs: initialized
[    4.725956] DMA-API: preallocated 65536 debug entries
[    4.731033] DMA-API: debugging enabled by kernel config
[    4.736281] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    4.746181] futex hash table entries: 16384 (order: 8, 1048576 bytes)
[    4.753177] xor: measuring software checksum speed
[    4.798026]    8regs     :  8825.000 MB/sec
[    4.842255]    8regs_prefetch:  8121.000 MB/sec
[    4.886834]    32regs    :  9035.000 MB/sec
[    4.931064]    32regs_prefetch:  8398.000 MB/sec
[    4.935700] xor: using function: 32regs (9035.000 MB/sec)
[    4.941136] pinctrl core: initialized pinctrl subsystem
[    4.946833] SMBIOS 3.1.1 present.
[    4.950160] DMI: Huawei D06/D06, BIOS Hisilicon D06 UEFI RC0 - B601 (V6.01) 11/08/2018
[    4.958267] NET: Registered protocol family 16
[    4.963473] audit: initializing netlink subsys (disabled)
[    4.968943] audit: type=2000 audit(3.668:1): state=initialized audit_enabled=0 res=1
[    4.976734] cpuidle: using governor menu
[    4.980671] vdso: 2 pages (1 code @ (____ptrval____), 1 data @ (____ptrval____))
[    4.988110] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    4.995963] DMA: preallocated 256 KiB pool for atomic allocations
[    5.002201] ACPI: bus type PCI registered
[    5.006229] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    5.012781] Serial: AMBA PL011 UART driver
[    5.021577] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    5.028686] cryptd: max_cpu_qlen set to 1000
[    5.101028] raid6: int64x1  gen()  2685 MB/s
[    5.173082] raid6: int64x1  xor()  1477 MB/s
[    5.245133] raid6: int64x2  gen()  3990 MB/s
[    5.317185] raid6: int64x2  xor()  1866 MB/s
[    5.389242] raid6: int64x4  gen()  5013 MB/s
[    5.461295] raid6: int64x4  xor()  2904 MB/s
[    5.533351] raid6: int64x8  gen()  4172 MB/s
[    5.605409] raid6: int64x8  xor()  2704 MB/s
[    5.677466] raid6: neonx1   gen()  3904 MB/s
[    5.749523] raid6: neonx1   xor()  3463 MB/s
[    5.821581] raid6: neonx2   gen()  6311 MB/s
[    5.893640] raid6: neonx2   xor()  5142 MB/s
[    5.965696] raid6: neonx4   gen()  7914 MB/s
[    6.037756] raid6: neonx4   xor()  6327 MB/s
[    6.109811] raid6: neonx8   gen()  7667 MB/s
[    6.181879] raid6: neonx8   xor()  6499 MB/s
[    6.186164] raid6: using algorithm neonx4 gen() 7914 MB/s
[    6.191584] raid6: .... xor() 6327 MB/s, rmw enabled
[    6.196568] raid6: using neon recovery algorithm
[    6.201530] ACPI: Added _OSI(Module Device)
[    6.205731] ACPI: Added _OSI(Processor Device)
[    6.210194] ACPI: Added _OSI(3.0 _SCP Extensions)
[    6.214917] ACPI: Added _OSI(Processor Aggregator Device)
[    6.220341] ACPI: Added _OSI(Linux-Dell-Video)
[    6.224801] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    6.232878] ACPI: 1 ACPI AML tables successfully acquired and loaded
[    6.243814] ACPI: Interpreter enabled
[    6.247490] ACPI: Using GIC for interrupt routing
[    6.252232] ACPI: MCFG table detected, 1 entries
[    6.256871] ACPI: IORT: SMMU-v3[148000000] Mapped to Proximity domain 0
[    6.263562] ACPI: IORT: SMMU-v3[100000000] Mapped to Proximity domain 0
[    6.270236] ACPI: IORT: SMMU-v3[140000000] Mapped to Proximity domain 0
[    6.276907] ACPI: IORT: SMMU-v3[400148000000] Mapped to Proximity domain 2
[    6.283839] ACPI: IORT: SMMU-v3[400100000000] Mapped to Proximity domain 2
[    6.290771] ACPI: IORT: SMMU-v3[400140000000] Mapped to Proximity domain 2
[    6.297771] HEST: Table parsing has been initialized.
[    6.315049] ARMH0011:00: ttyAMA0 at MMIO 0x94080000 (irq = 5, base_baud = 0) is a SBSA
[    0.000000] Booting Linux on physical CPU 0x0000010000 [0x480fd010]
[    0.000000] Linux version 4.19.0-rc4-00948-gbad69f9 (chenxiang@Turing-Arch-b) (gcc version 4.9.1 20140505 (prerelease) (crosstool-NG linaro-1.13.1-4.9-2014.05 - Linaro GCC 4.9-2014.05)) #1100 SMP PREEMPT Tue Dec 4 10:50:29 CST 2018
[    0.000000] earlycon: pl11 at MMIO32 0x0000000094080000 (options '')
[    0.000000] bootconsole [pl11] enabled
[    0.000000] efi: Getting EFI parameters from FDT:
[    0.000000] efi: EFI v2.70 by EDK II
[    0.000000] efi:  SMBIOS 3.0=0x3f2a0000  ACPI 2.0=0x3a000000  MEMATTR=0x3b65c018  ESRT=0x3b66bd98 
[    0.000000] esrt: Reserving ESRT space from 0x000000003b66bd98 to 0x000000003b66bdd0.
[    0.000000] cma: Reserved 16 MiB at 0x000000003e000000
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x000000003A000000 000024 (v02 HISI  )
[    0.000000] ACPI: XSDT 0x0000000039FF0000 00009C (v01 HISI   HIP08    00000000      01000013)
[    0.000000] ACPI: FACP 0x0000000039AD0000 000114 (v06 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: DSDT 0x0000000039A50000 00618A (v02 HISI   HIP08    00000000 INTL 20170929)
[    0.000000] ACPI: BERT 0x0000000039F50000 000030 (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: HEST 0x0000000039F40000 00013C (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: ERST 0x0000000039F20000 000230 (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: EINJ 0x0000000039F10000 000170 (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: GTDT 0x0000000039AC0000 000060 (v02 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: DBG2 0x0000000039AB0000 00005A (v00 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: MCFG 0x0000000039AA0000 00003C (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SLIT 0x0000000039A90000 00003C (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SPCR 0x0000000039A80000 000050 (v02 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SRAT 0x0000000039A70000 000774 (v03 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: APIC 0x0000000039A60000 001E58 (v04 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: IORT 0x0000000039A40000 0010F4 (v00 HISI   HIP08    00000000 INTL 20170929)
[    0.000000] ACPI: PPTT 0x0000000030EC0000 002A30 (v01 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SPMI 0x0000000030EB0000 000041 (v05 HISI   HIP08    00000000 HISI 20151124)
[    0.000000] ACPI: SPCR: console: pl011,mmio32,0x94080000,115200
[    0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x2080000000-0x27ffffffff]
[    0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x2800000000-0x2fffffffff]
[    0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[    0.000000] NUMA: NODE_DATA [mem 0x27ffffe7c0-0x27ffffffff]
[    0.000000] NUMA: NODE_DATA [mem 0x2ffffeb7c0-0x2ffffecfff]
[    0.000000] NUMA: Initmem setup node 2 [<memory-less node>]
[    0.000000] NUMA: NODE_DATA [mem 0x2ffffe9f80-0x2ffffeb7bf]
[    0.000000] NUMA: NODE_DATA(2) on node 1
[    0.000000] NUMA: Initmem setup node 3 [<memory-less node>]
[    0.000000] NUMA: NODE_DATA [mem 0x2ffffe8740-0x2ffffe9f7f]
[    0.000000] NUMA: NODE_DATA(3) on node 1
[    0.000000] Zone ranges:
[    0.000000]   DMA32    [mem 0x0000000000000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x0000002fffffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x00000000305dbfff]
[    0.000000]   node   0: [mem 0x00000000305dc000-0x0000000030eaffff]
[    0.000000]   node   0: [mem 0x0000000030eb0000-0x0000000039adffff]
[    0.000000]   node   0: [mem 0x0000000039ae0000-0x0000000039aeffff]
[    0.000000]   node   0: [mem 0x0000000039af0000-0x0000000039afffff]
[    0.000000]   node   0: [mem 0x0000000039b00000-0x0000000039cdffff]
[    0.000000]   node   0: [mem 0x0000000039ce0000-0x0000000039d0ffff]
[    0.000000]   node   0: [mem 0x0000000039d10000-0x0000000039e4ffff]
[    0.000000]   node   0: [mem 0x0000000039e50000-0x0000000039f39fff]
[    0.000000]   node   0: [mem 0x0000000039f3a000-0x0000000039f3ffff]
[    0.000000]   node   0: [mem 0x0000000039f40000-0x0000000039f5ffff]
[    0.000000]   node   0: [mem 0x0000000039f60000-0x0000000039feffff]
[    0.000000]   node   0: [mem 0x0000000039ff0000-0x000000003a00ffff]
[    0.000000]   node   0: [mem 0x000000003a010000-0x000000003a2affff]
[    0.000000]   node   0: [mem 0x000000003a2b0000-0x000000003a2b1fff]
[    0.000000]   node   0: [mem 0x000000003a2b2000-0x000000003a2bbfff]
[    0.000000]   node   0: [mem 0x000000003a2bc000-0x000000003f29ffff]
[    0.000000]   node   0: [mem 0x000000003f2a0000-0x000000003f2cffff]
[    0.000000]   node   0: [mem 0x000000003f2d0000-0x000000003fbfffff]
[    0.000000]   node   0: [mem 0x0000002080000000-0x00000027ffffffff]
[    0.000000]   node   1: [mem 0x0000002800000000-0x0000002fffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000027ffffffff]
[    0.000000] Initmem setup node 1 [mem 0x0000002800000000-0x0000002fffffffff]
[    0.000000] Could not find start_pfn for node 2
[    0.000000] Initmem setup node 2 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] Could not find start_pfn for node 3
[    0.000000] Initmem setup node 3 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] psci: probing for conduit method from ACPI.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.1
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10001 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10002 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10003 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10100 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10101 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10102 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10103 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10200 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10201 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10202 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10203 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10300 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10301 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10302 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10303 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10400 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10401 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10402 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10403 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10500 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10501 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10502 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10503 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30001 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30002 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30003 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30100 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30101 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30102 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30103 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30200 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30201 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30202 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30203 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30300 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30301 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30302 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30303 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30400 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30401 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30402 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30403 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30500 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30501 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30502 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30503 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50000 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50001 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50002 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50003 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50100 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50101 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50102 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50103 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50200 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50201 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50202 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50203 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50300 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50301 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50302 -> Node 2
[    0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50303 -> Node 2
[    0.000000] random: get_random_bytes called from start_kernel+0xa8/0x414 with crng_init=0
[    0.000000] percpu: Embedded 24 pages/cpu @(____ptrval____) s58176 r8192 d31936 u98304
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: detected: Virtualization Host Extensions
[    0.000000] CPU features: detected: Kernel page table isolation (KPTI)
[    0.000000] CPU features: detected: Hardware dirty bit management
[    0.000000] Built 4 zonelists, mobility grouping on.  Total pages: 16256016
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: earlycon=pl011,mmio32,0x94080000 console=ttyAMA0,115200 acpi=force root=/dev/ram0 rw initrd=0x7000000,120M
[    0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 258048 bytes
[    0.000000] log_buf_len min size: 131072 bytes
[    0.000000] log_buf_len: 524288 bytes
[    0.000000] early log buf free: 118652(90%)
[    0.000000] software IO TLB: mapped [mem 0x35a40000-0x39a40000] (64MB)
[    0.000000] Memory: 64770888K/66056192K available (13116K kernel code, 1524K rwdata, 5564K rodata, 1216K init, 505K bss, 1268920K reserved, 16384K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=64, Nodes=4
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] 	Tasks RCU enabled.
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: Distributor has no Range Selector support
[    0.000000] GICv3: VLPI support, direct LPI support
[    0.000000] SRAT: PXM 0 -> ITS 0 -> Node 0
[    0.000000] ITS [mem 0x202100000-0x20211ffff]
[    0.000000] ITS@0x0000000202100000: Using ITS number 0
[    0.000000] ITS@0x0000000202100000: allocated 8192 Devices @27e0560000 (indirect, esz 8, psz 16K, shr 1)
[    0.000000] ITS@0x0000000202100000: allocated 2048 Virtual CPUs @27e0548000 (indirect, esz 16, psz 4K, shr 1)
[    0.000000] ITS@0x0000000202100000: allocated 256 Interrupt Collections @27e0546000 (flat, esz 16, psz 4K, shr 1)
[    0.000000] GIC: using LPI property table @0x00000027e0570000
[    0.000000] ITS: Using DirectLPI for VPE invalidation
[    0.000000] ITS: Enabling GICv4 support
[    0.000000] GICv3: CPU0: found redistributor 10000 region 0:0x00000000ae100000
[    0.000000] CPU0: using LPI pending table @0x00000027e0580000
[    0.000000] arch_timer: cp15 timer(s) running at 100.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x171024e7e0, max_idle_ns: 440795205315 ns
[    0.000001] sched_clock: 56 bits at 100MHz, resolution 10ns, wraps every 4398046511100ns
[    0.008223] Console: colour dummy device 80x25
[    0.012724] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.024006] ACPI: Core revision 20180810
[    0.028052] Calibrating delay loop (skipped), value calculated using timer frequency.. 200.00 BogoMIPS (lpj=400000)
[    0.038540] pid_max: default: 65536 minimum: 512
[    0.043214] Security Framework initialized
[    0.057571] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[    0.070060] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.077583] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.084826] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.120381] ASID allocator initialised with 32768 entries
[    0.125829] rcu: Hierarchical SRCU implementation.
[    0.138657] Platform MSI: ITS@0x202100000 domain created
[    0.143999] PCI/MSI: ITS@0x202100000 domain created
[    0.148942] Remapping and enabling EFI services.
[    0.165589] smp: Bringing up secondary CPUs ...
[    0.217433] Detected VIPT I-cache on CPU1
[    0.217442] GICv3: CPU1: found redistributor 10001 region 1:0x00000000ae140000
[    0.217461] CPU1: using LPI pending table @0x00000027dccc0000
[    0.217475] CPU1: Booted secondary processor 0x0000010001 [0x480fd010]
[    0.264646] Detected VIPT I-cache on CPU2
[    0.264652] GICv3: CPU2: found redistributor 10002 region 2:0x00000000ae180000
[    0.264671] CPU2: using LPI pending table @0x00000027dccd0000
[    0.264681] CPU2: Booted secondary processor 0x0000010002 [0x480fd010]
[    0.311860] Detected VIPT I-cache on CPU3
[    0.311866] GICv3: CPU3: found redistributor 10003 region 3:0x00000000ae1c0000
[    0.311885] CPU3: using LPI pending table @0x00000027dcd30000
[    0.311894] CPU3: Booted secondary processor 0x0000010003 [0x480fd010]
[    0.359081] Detected VIPT I-cache on CPU4
[    0.359091] GICv3: CPU4: found redistributor 10100 region 4:0x00000000ae200000
[    0.359112] CPU4: using LPI pending table @0x00000027dcd40000
[    0.359126] CPU4: Booted secondary processor 0x0000010100 [0x480fd010]
[    0.406292] Detected VIPT I-cache on CPU5
[    0.406299] GICv3: CPU5: found redistributor 10101 region 5:0x00000000ae240000
[    0.406318] CPU5: using LPI pending table @0x00000027dcd50000
[    0.406329] CPU5: Booted secondary processor 0x0000010101 [0x480fd010]
[    0.453508] Detected VIPT I-cache on CPU6
[    0.453515] GICv3: CPU6: found redistributor 10102 region 6:0x00000000ae280000
[    0.453534] CPU6: using LPI pending table @0x00000027dcda0000
[    0.453545] CPU6: Booted secondary processor 0x0000010102 [0x480fd010]
[    0.500724] Detected VIPT I-cache on CPU7
[    0.500732] GICv3: CPU7: found redistributor 10103 region 7:0x00000000ae2c0000
[    0.500751] CPU7: using LPI pending table @0x00000027dcdc0000
[    0.500761] CPU7: Booted secondary processor 0x0000010103 [0x480fd010]
[    0.547944] Detected VIPT I-cache on CPU8
[    0.547953] GICv3: CPU8: found redistributor 10200 region 8:0x00000000ae300000
[    0.547973] CPU8: using LPI pending table @0x00000027dcdd0000
[    0.547987] CPU8: Booted secondary processor 0x0000010200 [0x480fd010]
[    0.595157] Detected VIPT I-cache on CPU9
[    0.595164] GICv3: CPU9: found redistributor 10201 region 9:0x00000000ae340000
[    0.595183] CPU9: using LPI pending table @0x00000027dce20000
[    0.595195] CPU9: Booted secondary processor 0x0000010201 [0x480fd010]
[    0.642374] Detected VIPT I-cache on CPU10
[    0.642383] GICv3: CPU10: found redistributor 10202 region 10:0x00000000ae380000
[    0.642402] CPU10: using LPI pending table @0x00000027dce30000
[    0.642412] CPU10: Booted secondary processor 0x0000010202 [0x480fd010]
[    0.689590] Detected VIPT I-cache on CPU11
[    0.689599] GICv3: CPU11: found redistributor 10203 region 11:0x00000000ae3c0000
[    0.689617] CPU11: using LPI pending table @0x00000027dce40000
[    0.689628] CPU11: Booted secondary processor 0x0000010203 [0x480fd010]
[    0.736811] Detected VIPT I-cache on CPU12
[    0.736822] GICv3: CPU12: found redistributor 10300 region 12:0x00000000ae400000
[    0.736842] CPU12: using LPI pending table @0x00000027dcea0000
[    0.736856] CPU12: Booted secondary processor 0x0000010300 [0x480fd010]
[    0.784024] Detected VIPT I-cache on CPU13
[    0.784034] GICv3: CPU13: found redistributor 10301 region 13:0x00000000ae440000
[    0.784052] CPU13: using LPI pending table @0x00000027dceb0000
[    0.784063] CPU13: Booted secondary processor 0x0000010301 [0x480fd010]
[    0.831241] Detected VIPT I-cache on CPU14
[    0.831250] GICv3: CPU14: found redistributor 10302 region 14:0x00000000ae480000
[    0.831269] CPU14: using LPI pending table @0x00000027dcec0000
[    0.831280] CPU14: Booted secondary processor 0x0000010302 [0x480fd010]
[    0.878458] Detected VIPT I-cache on CPU15
[    0.878467] GICv3: CPU15: found redistributor 10303 region 15:0x00000000ae4c0000
[    0.878487] CPU15: using LPI pending table @0x00000027dcf20000
[    0.878498] CPU15: Booted secondary processor 0x0000010303 [0x480fd010]
[    0.925682] Detected VIPT I-cache on CPU16
[    0.925693] GICv3: CPU16: found redistributor 10400 region 16:0x00000000ae500000
[    0.925713] CPU16: using LPI pending table @0x00000027dcf30000
[    0.925728] CPU16: Booted secondary processor 0x0000010400 [0x480fd010]
[    0.972894] Detected VIPT I-cache on CPU17
[    0.972903] GICv3: CPU17: found redistributor 10401 region 17:0x00000000ae540000
[    0.972922] CPU17: using LPI pending table @0x00000027dcf40000
[    0.972933] CPU17: Booted secondary processor 0x0000010401 [0x480fd010]
[    1.020111] Detected VIPT I-cache on CPU18
[    1.020120] GICv3: CPU18: found redistributor 10402 region 18:0x00000000ae580000
[    1.020139] CPU18: using LPI pending table @0x00000027dcfa0000
[    1.020150] CPU18: Booted secondary processor 0x0000010402 [0x480fd010]
[    1.067327] Detected VIPT I-cache on CPU19
[    1.067337] GICv3: CPU19: found redistributor 10403 region 19:0x00000000ae5c0000
[    1.067356] CPU19: using LPI pending table @0x00000027dcfb0000
[    1.067367] CPU19: Booted secondary processor 0x0000010403 [0x480fd010]
[    1.114549] Detected VIPT I-cache on CPU20
[    1.114561] GICv3: CPU20: found redistributor 10500 region 20:0x00000000ae600000
[    1.114581] CPU20: using LPI pending table @0x00000027dcfc0000
[    1.114596] CPU20: Booted secondary processor 0x0000010500 [0x480fd010]
[    1.161762] Detected VIPT I-cache on CPU21
[    1.161772] GICv3: CPU21: found redistributor 10501 region 21:0x00000000ae640000
[    1.161791] CPU21: using LPI pending table @0x00000027dc810000
[    1.161803] CPU21: Booted secondary processor 0x0000010501 [0x480fd010]
[    1.208980] Detected VIPT I-cache on CPU22
[    1.208991] GICv3: CPU22: found redistributor 10502 region 22:0x00000000ae680000
[    1.209010] CPU22: using LPI pending table @0x00000027dc820000
[    1.209021] CPU22: Booted secondary processor 0x0000010502 [0x480fd010]
[    1.256197] Detected VIPT I-cache on CPU23
[    1.256208] GICv3: CPU23: found redistributor 10503 region 23:0x00000000ae6c0000
[    1.256227] CPU23: using LPI pending table @0x00000027dc830000
[    1.256238] CPU23: Booted secondary processor 0x0000010503 [0x480fd010]
[    1.303470] Detected VIPT I-cache on CPU24
[    1.303489] GICv3: CPU24: found redistributor 30000 region 24:0x00000000aa100000
[    1.303511] CPU24: using LPI pending table @0x00000027dc850000
[    1.303531] CPU24: Booted secondary processor 0x0000030000 [0x480fd010]
[    1.350683] Detected VIPT I-cache on CPU25
[    1.350696] GICv3: CPU25: found redistributor 30001 region 25:0x00000000aa140000
[    1.350715] CPU25: using LPI pending table @0x00000027dc860000
[    1.350727] CPU25: Booted secondary processor 0x0000030001 [0x480fd010]
[    1.397902] Detected VIPT I-cache on CPU26
[    1.397915] GICv3: CPU26: found redistributor 30002 region 26:0x00000000aa180000
[    1.397935] CPU26: using LPI pending table @0x00000027dc870000
[    1.397947] CPU26: Booted secondary processor 0x0000030002 [0x480fd010]
[    1.445121] Detected VIPT I-cache on CPU27
[    1.445134] GICv3: CPU27: found redistributor 30003 region 27:0x00000000aa1c0000
[    1.445154] CPU27: using LPI pending table @0x00000027dc890000
[    1.445166] CPU27: Booted secondary processor 0x0000030003 [0x480fd010]
[    1.492348] Detected VIPT I-cache on CPU28
[    1.492367] GICv3: CPU28: found redistributor 30100 region 28:0x00000000aa200000
[    1.492389] CPU28: using LPI pending table @0x00000027dc8a0000
[    1.492409] CPU28: Booted secondary processor 0x0000030100 [0x480fd010]
[    1.539562] Detected VIPT I-cache on CPU29
[    1.539576] GICv3: CPU29: found redistributor 30101 region 29:0x00000000aa240000
[    1.539596] CPU29: using LPI pending table @0x00000027dc8b0000
[    1.539609] CPU29: Booted secondary processor 0x0000030101 [0x480fd010]
[    1.586783] Detected VIPT I-cache on CPU30
[    1.586798] GICv3: CPU30: found redistributor 30102 region 30:0x00000000aa280000
[    1.586818] CPU30: using LPI pending table @0x00000027dc8d0000
[    1.586830] CPU30: Booted secondary processor 0x0000030102 [0x480fd010]
[    1.634003] Detected VIPT I-cache on CPU31
[    1.634017] GICv3: CPU31: found redistributor 30103 region 31:0x00000000aa2c0000
[    1.634037] CPU31: using LPI pending table @0x00000027dc8e0000
[    1.634049] CPU31: Booted secondary processor 0x0000030103 [0x480fd010]
[    1.681233] Detected VIPT I-cache on CPU32
[    1.681251] GICv3: CPU32: found redistributor 30200 region 32:0x00000000aa300000
[    1.681272] CPU32: using LPI pending table @0x00000027dc8f0000
[    1.681289] CPU32: Booted secondary processor 0x0000030200 [0x480fd010]
[    1.728448] Detected VIPT I-cache on CPU33
[    1.728463] GICv3: CPU33: found redistributor 30201 region 33:0x00000000aa340000
[    1.728482] CPU33: using LPI pending table @0x00000027dc900000
[    1.728495] CPU33: Booted secondary processor 0x0000030201 [0x480fd010]
[    1.775669] Detected VIPT I-cache on CPU34
[    1.775684] GICv3: CPU34: found redistributor 30202 region 34:0x00000000aa380000
[    1.775704] CPU34: using LPI pending table @0x00000027dc910000
[    1.775717] CPU34: Booted secondary processor 0x0000030202 [0x480fd010]
[    1.822890] Detected VIPT I-cache on CPU35
[    1.822905] GICv3: CPU35: found redistributor 30203 region 35:0x00000000aa3c0000
[    1.822924] CPU35: using LPI pending table @0x00000027dc930000
[    1.822937] CPU35: Booted secondary processor 0x0000030203 [0x480fd010]
[    1.870118] Detected VIPT I-cache on CPU36
[    1.870137] GICv3: CPU36: found redistributor 30300 region 36:0x00000000aa400000
[    1.870158] CPU36: using LPI pending table @0x00000027dc950000
[    1.870176] CPU36: Booted secondary processor 0x0000030300 [0x480fd010]
[    1.917333] Detected VIPT I-cache on CPU37
[    1.917348] GICv3: CPU37: found redistributor 30301 region 37:0x00000000aa440000
[    1.917368] CPU37: using LPI pending table @0x00000027dc960000
[    1.917381] CPU37: Booted secondary processor 0x0000030301 [0x480fd010]
[    1.964555] Detected VIPT I-cache on CPU38
[    1.964571] GICv3: CPU38: found redistributor 30302 region 38:0x00000000aa480000
[    1.964590] CPU38: using LPI pending table @0x00000027dc970000
[    1.964603] CPU38: Booted secondary processor 0x0000030302 [0x480fd010]
[    2.011775] Detected VIPT I-cache on CPU39
[    2.011791] GICv3: CPU39: found redistributor 30303 region 39:0x00000000aa4c0000
[    2.011811] CPU39: using LPI pending table @0x00000027dc980000
[    2.011824] CPU39: Booted secondary processor 0x0000030303 [0x480fd010]
[    2.058992] Detected VIPT I-cache on CPU40
[    2.059011] GICv3: CPU40: found redistributor 30400 region 40:0x00000000aa500000
[    2.059033] CPU40: using LPI pending table @0x00000027dc990000
[    2.059050] CPU40: Booted secondary processor 0x0000030400 [0x480fd010]
[    2.106209] Detected VIPT I-cache on CPU41
[    2.106225] GICv3: CPU41: found redistributor 30401 region 41:0x00000000aa540000
[    2.106245] CPU41: using LPI pending table @0x00000027dc9b0000
[    2.106258] CPU41: Booted secondary processor 0x0000030401 [0x480fd010]
[    2.153431] Detected VIPT I-cache on CPU42
[    2.153446] GICv3: CPU42: found redistributor 30402 region 42:0x00000000aa580000
[    2.153466] CPU42: using LPI pending table @0x00000027dc9c0000
[    2.153479] CPU42: Booted secondary processor 0x0000030402 [0x480fd010]
[    2.200652] Detected VIPT I-cache on CPU43
[    2.200668] GICv3: CPU43: found redistributor 30403 region 43:0x00000000aa5c0000
[    2.200687] CPU43: using LPI pending table @0x00000027dc9d0000
[    2.200701] CPU43: Booted secondary processor 0x0000030403 [0x480fd010]
[    2.247880] Detected VIPT I-cache on CPU44
[    2.247900] GICv3: CPU44: found redistributor 30500 region 44:0x00000000aa600000
[    2.247922] CPU44: using LPI pending table @0x00000027dc9e0000
[    2.247940] CPU44: Booted secondary processor 0x0000030500 [0x480fd010]
[    2.295098] Detected VIPT I-cache on CPU45
[    2.295114] GICv3: CPU45: found redistributor 30501 region 45:0x00000000aa640000
[    2.295134] CPU45: using LPI pending table @0x00000027dca00000
[    2.295148] CPU45: Booted secondary processor 0x0000030501 [0x480fd010]
[    2.342319] Detected VIPT I-cache on CPU46
[    2.342336] GICv3: CPU46: found redistributor 30502 region 46:0x00000000aa680000
[    2.342355] CPU46: using LPI pending table @0x00000027dca10000
[    2.342369] CPU46: Booted secondary processor 0x0000030502 [0x480fd010]
[    2.389541] Detected VIPT I-cache on CPU47
[    2.389558] GICv3: CPU47: found redistributor 30503 region 47:0x00000000aa6c0000
[    2.389577] CPU47: using LPI pending table @0x00000027dca20000
[    2.389591] CPU47: Booted secondary processor 0x0000030503 [0x480fd010]
[    2.437193] Detected VIPT I-cache on CPU48
[    2.437237] GICv3: CPU48: found redistributor 50000 region 48:0x00004000ae100000
[    2.437266] CPU48: using LPI pending table @0x00000027dcaa0000
[    2.437297] CPU48: Booted secondary processor 0x0000050000 [0x480fd010]
[    2.484669] Detected VIPT I-cache on CPU49
[    2.484702] GICv3: CPU49: found redistributor 50001 region 49:0x00004000ae140000
[    2.484727] CPU49: using LPI pending table @0x00000027dcbd0000
[    2.484742] CPU49: Booted secondary processor 0x0000050001 [0x480fd010]
[    2.532155] Detected VIPT I-cache on CPU50
[    2.532189] GICv3: CPU50: found redistributor 50002 region 50:0x00004000ae180000
[    2.532213] CPU50: using LPI pending table @0x00000027dc460000
[    2.532228] CPU50: Booted secondary processor 0x0000050002 [0x480fd010]
[    2.579642] Detected VIPT I-cache on CPU51
[    2.579676] GICv3: CPU51: found redistributor 50003 region 51:0x00004000ae1c0000
[    2.579699] CPU51: using LPI pending table @0x00000027dc490000
[    2.579715] CPU51: Booted secondary processor 0x0000050003 [0x480fd010]
[    2.627133] Detected VIPT I-cache on CPU52
[    2.627170] GICv3: CPU52: found redistributor 50100 region 52:0x00004000ae200000
[    2.627194] CPU52: using LPI pending table @0x00000027dc510000
[    2.627212] CPU52: Booted secondary processor 0x0000050100 [0x480fd010]
[    2.674617] Detected VIPT I-cache on CPU53
[    2.674651] GICv3: CPU53: found redistributor 50101 region 53:0x00004000ae240000
[    2.674675] CPU53: using LPI pending table @0x00000027dc5a0000
[    2.674690] CPU53: Booted secondary processor 0x0000050101 [0x480fd010]
[    2.722106] Detected VIPT I-cache on CPU54
[    2.722140] GICv3: CPU54: found redistributor 50102 region 54:0x00004000ae280000
[    2.722164] CPU54: using LPI pending table @0x00000027dc5e0000
[    2.722179] CPU54: Booted secondary processor 0x0000050102 [0x480fd010]
[    2.769594] Detected VIPT I-cache on CPU55
[    2.769628] GICv3: CPU55: found redistributor 50103 region 55:0x00004000ae2c0000
[    2.769652] CPU55: using LPI pending table @0x00000027dc650000
[    2.769667] CPU55: Booted secondary processor 0x0000050103 [0x480fd010]
[    2.817087] Detected VIPT I-cache on CPU56
[    2.817124] GICv3: CPU56: found redistributor 50200 region 56:0x00004000ae300000
[    2.817148] CPU56: using LPI pending table @0x00000027dc690000
[    2.817165] CPU56: Booted secondary processor 0x0000050200 [0x480fd010]
[    2.864573] Detected VIPT I-cache on CPU57
[    2.864608] GICv3: CPU57: found redistributor 50201 region 57:0x00004000ae340000
[    2.864632] CPU57: using LPI pending table @0x00000027dc710000
[    2.864648] CPU57: Booted secondary processor 0x0000050201 [0x480fd010]
[    2.912060] Detected VIPT I-cache on CPU58
[    2.912096] GICv3: CPU58: found redistributor 50202 region 58:0x00004000ae380000
[    2.912119] CPU58: using LPI pending table @0x00000027dc790000
[    2.912134] CPU58: Booted secondary processor 0x0000050202 [0x480fd010]
[    2.959547] Detected VIPT I-cache on CPU59
[    2.959584] GICv3: CPU59: found redistributor 50203 region 59:0x00004000ae3c0000
[    2.959608] CPU59: using LPI pending table @0x00000027dc7e0000
[    2.959623] CPU59: Booted secondary processor 0x0000050203 [0x480fd010]
[    3.007041] Detected VIPT I-cache on CPU60
[    3.007079] GICv3: CPU60: found redistributor 50300 region 60:0x00004000ae400000
[    3.007104] CPU60: using LPI pending table @0x00000027dc050000
[    3.007121] CPU60: Booted secondary processor 0x0000050300 [0x480fd010]
[    3.054530] Detected VIPT I-cache on CPU61
[    3.054566] GICv3: CPU61: found redistributor 50301 region 61:0x00004000ae440000
[    3.054589] CPU61: using LPI pending table @0x00000027dc0d0000
[    3.054605] CPU61: Booted secondary processor 0x0000050301 [0x480fd010]
[    3.102019] Detected VIPT I-cache on CPU62
[    3.102055] GICv3: CPU62: found redistributor 50302 region 62:0x00004000ae480000
[    3.102079] CPU62: using LPI pending table @0x00000027dc110000
[    3.102094] CPU62: Booted secondary processor 0x0000050302 [0x480fd010]
[    3.149507] Detected VIPT I-cache on CPU63
[    3.149544] GICv3: CPU63: found redistributor 50303 region 63:0x00004000ae4c0000
[    3.149567] CPU63: using LPI pending table @0x00000027dc190000
[    3.149582] CPU63: Booted secondary processor 0x0000050303 [0x480fd010]
[    3.149676] smp: Brought up 4 nodes, 64 CPUs
[    4.667123] SMP: Total of 64 processors activated.
[    4.671940] CPU features: detected: GIC system register CPU interface
[    4.678422] CPU features: detected: Privileged Access Never
[    4.684019] CPU features: detected: User Access Override
[    4.689364] CPU features: detected: RAS Extension Support
[    4.704060] CPU: All CPU(s) started at EL2
[    4.708331] alternatives: patching kernel code
[    4.718159] devtmpfs: initialized
[    4.725956] DMA-API: preallocated 65536 debug entries
[    4.731033] DMA-API: debugging enabled by kernel config
[    4.736281] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    4.746181] futex hash table entries: 16384 (order: 8, 1048576 bytes)
[    4.753177] xor: measuring software checksum speed
[    4.798026]    8regs     :  8825.000 MB/sec
[    4.842255]    8regs_prefetch:  8121.000 MB/sec
[    4.886834]    32regs    :  9035.000 MB/sec
[    4.931064]    32regs_prefetch:  8398.000 MB/sec
[    4.935700] xor: using function: 32regs (9035.000 MB/sec)
[    4.941136] pinctrl core: initialized pinctrl subsystem
[    4.946833] SMBIOS 3.1.1 present.
[    4.950160] DMI: Huawei D06/D06, BIOS Hisilicon D06 UEFI RC0 - B601 (V6.01) 11/08/2018
[    4.958267] NET: Registered protocol family 16
[    4.963473] audit: initializing netlink subsys (disabled)
[    4.968943] audit: type=2000 audit(3.668:1): state=initialized audit_enabled=0 res=1
[    4.976734] cpuidle: using governor menu
[    4.980671] vdso: 2 pages (1 code @ (____ptrval____), 1 data @ (____ptrval____))
[    4.988110] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    4.995963] DMA: preallocated 256 KiB pool for atomic allocations
[    5.002201] ACPI: bus type PCI registered
[    5.006229] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    5.012781] Serial: AMBA PL011 UART driver
[    5.021577] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    5.028686] cryptd: max_cpu_qlen set to 1000
[    5.101028] raid6: int64x1  gen()  2685 MB/s
[    5.173082] raid6: int64x1  xor()  1477 MB/s
[    5.245133] raid6: int64x2  gen()  3990 MB/s
[    5.317185] raid6: int64x2  xor()  1866 MB/s
[    5.389242] raid6: int64x4  gen()  5013 MB/s
[    5.461295] raid6: int64x4  xor()  2904 MB/s
[    5.533351] raid6: int64x8  gen()  4172 MB/s
[    5.605409] raid6: int64x8  xor()  2704 MB/s
[    5.677466] raid6: neonx1   gen()  3904 MB/s
[    5.749523] raid6: neonx1   xor()  3463 MB/s
[    5.821581] raid6: neonx2   gen()  6311 MB/s
[    5.893640] raid6: neonx2   xor()  5142 MB/s
[    5.965696] raid6: neonx4   gen()  7914 MB/s
[    6.037756] raid6: neonx4   xor()  6327 MB/s
[    6.109811] raid6: neonx8   gen()  7667 MB/s
[    6.181879] raid6: neonx8   xor()  6499 MB/s
[    6.186164] raid6: using algorithm neonx4 gen() 7914 MB/s
[    6.191584] raid6: .... xor() 6327 MB/s, rmw enabled
[    6.196568] raid6: using neon recovery algorithm
[    6.201530] ACPI: Added _OSI(Module Device)
[    6.205731] ACPI: Added _OSI(Processor Device)
[    6.210194] ACPI: Added _OSI(3.0 _SCP Extensions)
[    6.214917] ACPI: Added _OSI(Processor Aggregator Device)
[    6.220341] ACPI: Added _OSI(Linux-Dell-Video)
[    6.224801] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    6.232878] ACPI: 1 ACPI AML tables successfully acquired and loaded
[    6.243814] ACPI: Interpreter enabled
[    6.247490] ACPI: Using GIC for interrupt routing
[    6.252232] ACPI: MCFG table detected, 1 entries
[    6.256871] ACPI: IORT: SMMU-v3[148000000] Mapped to Proximity domain 0
[    6.263562] ACPI: IORT: SMMU-v3[100000000] Mapped to Proximity domain 0
[    6.270236] ACPI: IORT: SMMU-v3[140000000] Mapped to Proximity domain 0
[    6.276907] ACPI: IORT: SMMU-v3[400148000000] Mapped to Proximity domain 2
[    6.283839] ACPI: IORT: SMMU-v3[400100000000] Mapped to Proximity domain 2
[    6.290771] ACPI: IORT: SMMU-v3[400140000000] Mapped to Proximity domain 2
[    6.297771] HEST: Table parsing has been initialized.
[    6.315049] ARMH0011:00: ttyAMA0 at MMIO 0x94080000 (irq = 5, base_baud = 0) is a SBSA
[    9.402681] console [ttyAMA0] enabled
[    9.402681] console [ttyAMA0] enabled
[    9.412687] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3f])
[    9.412687] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3f])
[    9.425069] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    9.425069] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    9.441586] acpi PNP0A08:00: _OSC: platform does not support [LTR]
[    9.441586] acpi PNP0A08:00: _OSC: platform does not support [LTR]
[    9.454073] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    9.454073] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    9.471133] acpi PNP0A08:00: [Firmware Bug]: ECAM area [mem 0xd0000000-0xd3ffffff] not reserved in ACPI namespace
[    9.471133] acpi PNP0A08:00: [Firmware Bug]: ECAM area [mem 0xd0000000-0xd3ffffff] not reserved in ACPI namespace
[    9.491698] acpi PNP0A08:00: ECAM at [mem 0xd0000000-0xd3ffffff] for [bus 00-3f]
[    9.491698] acpi PNP0A08:00: ECAM at [mem 0xd0000000-0xd3ffffff] for [bus 00-3f]
[    9.506537] Remapped I/O 0x00000000efff0000 to [io  0x0000-0xffff window]
[    9.506537] Remapped I/O 0x00000000efff0000 to [io  0x0000-0xffff window]
[    9.520174] PCI host bridge to bus 0000:00
[    9.520174] PCI host bridge to bus 0000:00
[    9.528371] pci_bus 0000:00: root bus resource [mem 0x80000000000-0x83fffffffff pref window]
[    9.528371] pci_bus 0000:00: root bus resource [mem 0x80000000000-0x83fffffffff pref window]
[    9.545270] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xeffeffff window]
[    9.545270] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xeffeffff window]
[    9.560256] pci_bus 0000:00: root bus resource [io  0x0000-0xffff window]
[    9.560256] pci_bus 0000:00: root bus resource [io  0x0000-0xffff window]
[    9.573852] pci_bus 0000:00: root bus resource [bus 00-3f]
[    9.573852] pci_bus 0000:00: root bus resource [bus 00-3f]
[    9.585795] pci 0000:03:00.0: enabling Extended Tags
[    9.585795] pci 0000:03:00.0: enabling Extended Tags
[    9.596378] pci 0000:00:10.0: BAR 14: assigned [mem 0xe0000000-0xe2ffffff]
[    9.596378] pci 0000:00:10.0: BAR 14: assigned [mem 0xe0000000-0xe2ffffff]
[    9.610149] pci 0000:00:00.0: BAR 14: assigned [mem 0xe3000000-0xe31fffff]
[    9.610149] pci 0000:00:00.0: BAR 14: assigned [mem 0xe3000000-0xe31fffff]
[    9.623915] pci 0000:00:00.0: BAR 15: assigned [mem 0x80000000000-0x800001fffff 64bit pref]
[    9.623915] pci 0000:00:00.0: BAR 15: assigned [mem 0x80000000000-0x800001fffff 64bit pref]
[    9.640642] pci 0000:00:08.0: BAR 14: assigned [mem 0xe3200000-0xe33fffff]
[    9.640642] pci 0000:00:08.0: BAR 14: assigned [mem 0xe3200000-0xe33fffff]
[    9.654407] pci 0000:00:12.0: BAR 14: assigned [mem 0xe3400000-0xe35fffff]
[    9.654407] pci 0000:00:12.0: BAR 14: assigned [mem 0xe3400000-0xe35fffff]
[    9.668173] pci 0000:00:12.0: BAR 15: assigned [mem 0x80000200000-0x800003fffff 64bit pref]
[    9.668173] pci 0000:00:12.0: BAR 15: assigned [mem 0x80000200000-0x800003fffff 64bit pref]
[    9.684899] pci 0000:00:00.0: BAR 13: assigned [io  0x1000-0x1fff]
[    9.684899] pci 0000:00:00.0: BAR 13: assigned [io  0x1000-0x1fff]
[    9.697273] pci 0000:00:08.0: BAR 13: assigned [io  0x2000-0x2fff]
[    9.697273] pci 0000:00:08.0: BAR 13: assigned [io  0x2000-0x2fff]
[    9.709644] pci 0000:00:12.0: BAR 13: assigned [io  0x3000-0x3fff]
[    9.709644] pci 0000:00:12.0: BAR 13: assigned [io  0x3000-0x3fff]
[    9.722019] pci 0000:00:00.0: PCI bridge to [bus 01]
[    9.722019] pci 0000:00:00.0: PCI bridge to [bus 01]
[    9.731952] pci 0000:00:00.0:   bridge window [io  0x1000-0x1fff]
[    9.731952] pci 0000:00:00.0:   bridge window [io  0x1000-0x1fff]
[    9.744152] pci 0000:00:00.0:   bridge window [mem 0xe3000000-0xe31fffff]
[    9.744152] pci 0000:00:00.0:   bridge window [mem 0xe3000000-0xe31fffff]
[    9.757743] pci 0000:00:00.0:   bridge window [mem 0x80000000000-0x800001fffff 64bit pref]
[    9.757743] pci 0000:00:00.0:   bridge window [mem 0x80000000000-0x800001fffff 64bit pref]
[    9.774295] pci 0000:00:04.0: PCI bridge to [bus 02]
[    9.774295] pci 0000:00:04.0: PCI bridge to [bus 02]
[    9.784232] pci 0000:03:00.0: BAR 6: assigned [mem 0xe3200000-0xe32fffff pref]
[    9.784232] pci 0000:03:00.0: BAR 6: assigned [mem 0xe3200000-0xe32fffff pref]
[    9.798693] pci 0000:03:00.0: BAR 3: assigned [mem 0xe3300000-0xe333ffff 64bit]
[    9.798693] pci 0000:03:00.0: BAR 3: assigned [mem 0xe3300000-0xe333ffff 64bit]
[    9.813333] pci 0000:03:00.0: BAR 1: assigned [mem 0xe3340000-0xe334ffff 64bit]
[    9.813333] pci 0000:03:00.0: BAR 1: assigned [mem 0xe3340000-0xe334ffff 64bit]
[    9.827971] pci 0000:03:00.0: BAR 0: assigned [io  0x2000-0x20ff]
[    9.827971] pci 0000:03:00.0: BAR 0: assigned [io  0x2000-0x20ff]
[    9.840170] pci 0000:00:08.0: PCI bridge to [bus 03]
[    9.840170] pci 0000:00:08.0: PCI bridge to [bus 03]
[    9.850102] pci 0000:00:08.0:   bridge window [io  0x2000-0x2fff]
[    9.850102] pci 0000:00:08.0:   bridge window [io  0x2000-0x2fff]
[    9.862299] pci 0000:00:08.0:   bridge window [mem 0xe3200000-0xe33fffff]
[    9.862299] pci 0000:00:08.0:   bridge window [mem 0xe3200000-0xe33fffff]
[    9.875890] pci 0000:00:0c.0: PCI bridge to [bus 04]
[    9.875890] pci 0000:00:0c.0: PCI bridge to [bus 04]
[    9.885827] pci 0000:05:00.0: BAR 0: assigned [mem 0xe0000000-0xe1ffffff pref]
[    9.885827] pci 0000:05:00.0: BAR 0: assigned [mem 0xe0000000-0xe1ffffff pref]
[    9.900291] pci 0000:05:00.0: BAR 1: assigned [mem 0xe2000000-0xe21fffff]
[    9.900291] pci 0000:05:00.0: BAR 1: assigned [mem 0xe2000000-0xe21fffff]
[    9.913884] pci 0000:00:10.0: PCI bridge to [bus 05]
[    9.913884] pci 0000:00:10.0: PCI bridge to [bus 05]
[    9.923818] pci 0000:00:10.0:   bridge window [mem 0xe0000000-0xe2ffffff]
[    9.923818] pci 0000:00:10.0:   bridge window [mem 0xe0000000-0xe2ffffff]
[    9.937411] pci 0000:00:12.0: PCI bridge to [bus 06]
[    9.937411] pci 0000:00:12.0: PCI bridge to [bus 06]
[    9.947343] pci 0000:00:12.0:   bridge window [io  0x3000-0x3fff]
[    9.947343] pci 0000:00:12.0:   bridge window [io  0x3000-0x3fff]
[    9.959541] pci 0000:00:12.0:   bridge window [mem 0xe3400000-0xe35fffff]
[    9.959541] pci 0000:00:12.0:   bridge window [mem 0xe3400000-0xe35fffff]
[    9.973132] pci 0000:00:12.0:   bridge window [mem 0x80000200000-0x800003fffff 64bit pref]
[    9.973132] pci 0000:00:12.0:   bridge window [mem 0x80000200000-0x800003fffff 64bit pref]
[    9.989726] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 7b])
[    9.989726] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 7b])
[   10.001578] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.001578] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.017958] acpi PNP0A08:01: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.017958] acpi PNP0A08:01: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.032177] acpi PNP0A08:01: [Firmware Bug]: ECAM area [mem 0xd7b00000-0xd7bfffff] not reserved in ACPI namespace
[   10.032177] acpi PNP0A08:01: [Firmware Bug]: ECAM area [mem 0xd7b00000-0xd7bfffff] not reserved in ACPI namespace
[   10.052746] acpi PNP0A08:01: ECAM at [mem 0xd7b00000-0xd7bfffff] for [bus 7b]
[   10.052746] acpi PNP0A08:01: ECAM at [mem 0xd7b00000-0xd7bfffff] for [bus 7b]
[   10.067094] PCI host bridge to bus 0000:7b
[   10.067094] PCI host bridge to bus 0000:7b
[   10.075288] pci_bus 0000:7b: root bus resource [mem 0x148800000-0x148ffffff pref window]
[   10.075288] pci_bus 0000:7b: root bus resource [mem 0x148800000-0x148ffffff pref window]
[   10.091493] pci_bus 0000:7b: root bus resource [bus 7b]
[   10.091493] pci_bus 0000:7b: root bus resource [bus 7b]
[   10.101996] ACPI: PCI Root Bridge [PCI2] (domain 0000 [bus 7a])
[   10.101996] ACPI: PCI Root Bridge [PCI2] (domain 0000 [bus 7a])
[   10.113850] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.113850] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.130229] acpi PNP0A08:02: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.130229] acpi PNP0A08:02: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.144451] acpi PNP0A08:02: [Firmware Bug]: ECAM area [mem 0xd7a00000-0xd7afffff] not reserved in ACPI namespace
[   10.144451] acpi PNP0A08:02: [Firmware Bug]: ECAM area [mem 0xd7a00000-0xd7afffff] not reserved in ACPI namespace
[   10.165020] acpi PNP0A08:02: ECAM at [mem 0xd7a00000-0xd7afffff] for [bus 7a]
[   10.165020] acpi PNP0A08:02: ECAM at [mem 0xd7a00000-0xd7afffff] for [bus 7a]
[   10.179368] PCI host bridge to bus 0000:7a
[   10.179368] PCI host bridge to bus 0000:7a
[   10.187561] pci_bus 0000:7a: root bus resource [mem 0x20c000000-0x20c1fffff pref window]
[   10.187561] pci_bus 0000:7a: root bus resource [mem 0x20c000000-0x20c1fffff pref window]
[   10.203767] pci_bus 0000:7a: root bus resource [bus 7a]
[   10.203767] pci_bus 0000:7a: root bus resource [bus 7a]
[   10.214434] pci 0000:7a:02.0: BAR 0: assigned [mem 0x20c000000-0x20c0fffff 64bit pref]
[   10.214434] pci 0000:7a:02.0: BAR 0: assigned [mem 0x20c000000-0x20c0fffff 64bit pref]
[   10.230296] pci 0000:7a:00.0: BAR 0: assigned [mem 0x20c100000-0x20c100fff 64bit pref]
[   10.230296] pci 0000:7a:00.0: BAR 0: assigned [mem 0x20c100000-0x20c100fff 64bit pref]
[   10.246154] pci 0000:7a:01.0: BAR 0: assigned [mem 0x20c101000-0x20c101fff 64bit pref]
[   10.246154] pci 0000:7a:01.0: BAR 0: assigned [mem 0x20c101000-0x20c101fff 64bit pref]
[   10.262048] ACPI: PCI Root Bridge [PCI3] (domain 0000 [bus 78-79])
[   10.262048] ACPI: PCI Root Bridge [PCI3] (domain 0000 [bus 78-79])
[   10.274422] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.274422] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.290804] acpi PNP0A08:03: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.290804] acpi PNP0A08:03: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.305011] acpi PNP0A08:03: [Firmware Bug]: ECAM area [mem 0xd7800000-0xd79fffff] not reserved in ACPI namespace
[   10.305011] acpi PNP0A08:03: [Firmware Bug]: ECAM area [mem 0xd7800000-0xd79fffff] not reserved in ACPI namespace
[   10.325575] acpi PNP0A08:03: ECAM at [mem 0xd7800000-0xd79fffff] for [bus 78-79]
[   10.325575] acpi PNP0A08:03: ECAM at [mem 0xd7800000-0xd79fffff] for [bus 78-79]
[   10.340441] PCI host bridge to bus 0000:78
[   10.340441] PCI host bridge to bus 0000:78
[   10.348637] pci_bus 0000:78: root bus resource [mem 0x208000000-0x208ffffff pref window]
[   10.348637] pci_bus 0000:78: root bus resource [mem 0x208000000-0x208ffffff pref window]
[   10.364839] pci_bus 0000:78: root bus resource [bus 78-79]
[   10.364839] pci_bus 0000:78: root bus resource [bus 78-79]
[   10.375900] pci 0000:78:00.0: BAR 2: assigned [mem 0x208000000-0x2081fffff 64bit pref]
[   10.375900] pci 0000:78:00.0: BAR 2: assigned [mem 0x208000000-0x2081fffff 64bit pref]
[   10.391789] ACPI: PCI Root Bridge [PCI4] (domain 0000 [bus 7c-7d])
[   10.391789] ACPI: PCI Root Bridge [PCI4] (domain 0000 [bus 7c-7d])
[   10.404165] acpi PNP0A08:04: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.404165] acpi PNP0A08:04: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.420544] acpi PNP0A08:04: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.420544] acpi PNP0A08:04: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.434753] acpi PNP0A08:04: [Firmware Bug]: ECAM area [mem 0xd7c00000-0xd7dfffff] not reserved in ACPI namespace
[   10.434753] acpi PNP0A08:04: [Firmware Bug]: ECAM area [mem 0xd7c00000-0xd7dfffff] not reserved in ACPI namespace
[   10.455314] acpi PNP0A08:04: ECAM at [mem 0xd7c00000-0xd7dfffff] for [bus 7c-7d]
[   10.455314] acpi PNP0A08:04: ECAM at [mem 0xd7c00000-0xd7dfffff] for [bus 7c-7d]
[   10.470185] PCI host bridge to bus 0000:7c
[   10.470185] PCI host bridge to bus 0000:7c
[   10.478380] pci_bus 0000:7c: root bus resource [mem 0x120000000-0x13fffffff pref window]
[   10.478380] pci_bus 0000:7c: root bus resource [mem 0x120000000-0x13fffffff pref window]
[   10.494584] pci_bus 0000:7c: root bus resource [bus 7c-7d]
[   10.494584] pci_bus 0000:7c: root bus resource [bus 7c-7d]
[   10.505578] pci 0000:7c:00.0: enabling Extended Tags
[   10.505578] pci 0000:7c:00.0: enabling Extended Tags
[   10.515640] pci 0000:7d:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000dffff 64bit pref] (contains BAR0 for 14 VFs)
[   10.515640] pci 0000:7d:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000dffff 64bit pref] (contains BAR0 for 14 VFs)
[   10.536202] pci 0000:7d:00.0: VF(n) BAR2 space: [mem 0x00000000-0x00dfffff 64bit pref] (contains BAR2 for 14 VFs)
[   10.536202] pci 0000:7d:00.0: VF(n) BAR2 space: [mem 0x00000000-0x00dfffff 64bit pref] (contains BAR2 for 14 VFs)
[   10.556859] pci 0000:7d:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000dffff 64bit pref] (contains BAR0 for 14 VFs)
[   10.556859] pci 0000:7d:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000dffff 64bit pref] (contains BAR0 for 14 VFs)
[   10.577422] pci 0000:7d:00.1: VF(n) BAR2 space: [mem 0x00000000-0x00dfffff 64bit pref] (contains BAR2 for 14 VFs)
[   10.577422] pci 0000:7d:00.1: VF(n) BAR2 space: [mem 0x00000000-0x00dfffff 64bit pref] (contains BAR2 for 14 VFs)
[   10.598187] pci 0000:7c:00.0: BAR 15: assigned [mem 0x120000000-0x1221fffff 64bit pref]
[   10.598187] pci 0000:7c:00.0: BAR 15: assigned [mem 0x120000000-0x1221fffff 64bit pref]
[   10.614219] pci 0000:7d:00.0: BAR 2: assigned [mem 0x120000000-0x1200fffff 64bit pref]
[   10.614219] pci 0000:7d:00.0: BAR 2: assigned [mem 0x120000000-0x1200fffff 64bit pref]
[   10.630078] pci 0000:7d:00.0: BAR 9: assigned [mem 0x120100000-0x120efffff 64bit pref]
[   10.630078] pci 0000:7d:00.0: BAR 9: assigned [mem 0x120100000-0x120efffff 64bit pref]
[   10.645934] pci 0000:7d:00.1: BAR 2: assigned [mem 0x120f00000-0x120ffffff 64bit pref]
[   10.645934] pci 0000:7d:00.1: BAR 2: assigned [mem 0x120f00000-0x120ffffff 64bit pref]
[   10.661792] pci 0000:7d:00.1: BAR 9: assigned [mem 0x121000000-0x121dfffff 64bit pref]
[   10.661792] pci 0000:7d:00.1: BAR 9: assigned [mem 0x121000000-0x121dfffff 64bit pref]
[   10.677647] pci 0000:7d:00.2: BAR 2: assigned [mem 0x121e00000-0x121efffff 64bit pref]
[   10.677647] pci 0000:7d:00.2: BAR 2: assigned [mem 0x121e00000-0x121efffff 64bit pref]
[   10.693505] pci 0000:7d:00.3: BAR 2: assigned [mem 0x121f00000-0x121ffffff 64bit pref]
[   10.693505] pci 0000:7d:00.3: BAR 2: assigned [mem 0x121f00000-0x121ffffff 64bit pref]
[   10.709363] pci 0000:7d:00.0: BAR 0: assigned [mem 0x122000000-0x12200ffff 64bit pref]
[   10.709363] pci 0000:7d:00.0: BAR 0: assigned [mem 0x122000000-0x12200ffff 64bit pref]
[   10.725221] pci 0000:7d:00.0: BAR 7: assigned [mem 0x122010000-0x1220effff 64bit pref]
[   10.725221] pci 0000:7d:00.0: BAR 7: assigned [mem 0x122010000-0x1220effff 64bit pref]
[   10.741076] pci 0000:7d:00.1: BAR 0: assigned [mem 0x1220f0000-0x1220fffff 64bit pref]
[   10.741076] pci 0000:7d:00.1: BAR 0: assigned [mem 0x1220f0000-0x1220fffff 64bit pref]
[   10.756934] pci 0000:7d:00.1: BAR 7: assigned [mem 0x122100000-0x1221dffff 64bit pref]
[   10.756934] pci 0000:7d:00.1: BAR 7: assigned [mem 0x122100000-0x1221dffff 64bit pref]
[   10.772789] pci 0000:7d:00.2: BAR 0: assigned [mem 0x1221e0000-0x1221effff 64bit pref]
[   10.772789] pci 0000:7d:00.2: BAR 0: assigned [mem 0x1221e0000-0x1221effff 64bit pref]
[   10.788647] pci 0000:7d:00.3: BAR 0: assigned [mem 0x1221f0000-0x1221fffff 64bit pref]
[   10.788647] pci 0000:7d:00.3: BAR 0: assigned [mem 0x1221f0000-0x1221fffff 64bit pref]
[   10.804504] pci 0000:7c:00.0: PCI bridge to [bus 7d]
[   10.804504] pci 0000:7c:00.0: PCI bridge to [bus 7d]
[   10.814438] pci 0000:7c:00.0:   bridge window [mem 0x120000000-0x1221fffff 64bit pref]
[   10.814438] pci 0000:7c:00.0:   bridge window [mem 0x120000000-0x1221fffff 64bit pref]
[   10.830330] ACPI: PCI Root Bridge [PCI5] (domain 0000 [bus 74-76])
[   10.830330] ACPI: PCI Root Bridge [PCI5] (domain 0000 [bus 74-76])
[   10.842705] acpi PNP0A08:05: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.842705] acpi PNP0A08:05: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   10.859084] acpi PNP0A08:05: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.859084] acpi PNP0A08:05: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   10.873292] acpi PNP0A08:05: [Firmware Bug]: ECAM area [mem 0xd7400000-0xd76fffff] not reserved in ACPI namespace
[   10.873292] acpi PNP0A08:05: [Firmware Bug]: ECAM area [mem 0xd7400000-0xd76fffff] not reserved in ACPI namespace
[   10.893861] acpi PNP0A08:05: ECAM at [mem 0xd7400000-0xd76fffff] for [bus 74-76]
[   10.893861] acpi PNP0A08:05: ECAM at [mem 0xd7400000-0xd76fffff] for [bus 74-76]
[   10.908739] PCI host bridge to bus 0000:74
[   10.908739] PCI host bridge to bus 0000:74
[   10.916932] pci_bus 0000:74: root bus resource [mem 0x144000000-0x147ffffff pref window]
[   10.916932] pci_bus 0000:74: root bus resource [mem 0x144000000-0x147ffffff pref window]
[   10.933138] pci_bus 0000:74: root bus resource [mem 0xa2000000-0xa2ffffff window]
[   10.933138] pci_bus 0000:74: root bus resource [mem 0xa2000000-0xa2ffffff window]
[   10.948121] pci_bus 0000:74: root bus resource [bus 74-76]
[   10.948121] pci_bus 0000:74: root bus resource [bus 74-76]
[   10.959117] pci 0000:74:00.0: enabling Extended Tags
[   10.959117] pci 0000:74:00.0: enabling Extended Tags
[   10.969324] pci 0000:75:00.0: VF(n) BAR2 space: [mem 0x00000000-0x003effff 64bit pref] (contains BAR2 for 63 VFs)
[   10.969324] pci 0000:75:00.0: VF(n) BAR2 space: [mem 0x00000000-0x003effff 64bit pref] (contains BAR2 for 63 VFs)
[   10.989985] pci 0000:74:00.0: BAR 15: assigned [mem 0x144000000-0x1447fffff 64bit pref]
[   10.989985] pci 0000:74:00.0: BAR 15: assigned [mem 0x144000000-0x1447fffff 64bit pref]
[   11.006015] pci 0000:74:02.0: BAR 5: assigned [mem 0xa2000000-0xa2007fff]
[   11.006015] pci 0000:74:02.0: BAR 5: assigned [mem 0xa2000000-0xa2007fff]
[   11.019609] pci 0000:74:03.0: BAR 5: assigned [mem 0xa2008000-0xa2008fff]
[   11.019609] pci 0000:74:03.0: BAR 5: assigned [mem 0xa2008000-0xa2008fff]
[   11.033201] pci 0000:75:00.0: BAR 2: assigned [mem 0x144000000-0x1443fffff 64bit pref]
[   11.033201] pci 0000:75:00.0: BAR 2: assigned [mem 0x144000000-0x1443fffff 64bit pref]
[   11.049060] pci 0000:75:00.0: BAR 9: assigned [mem 0x144400000-0x1447effff 64bit pref]
[   11.049060] pci 0000:75:00.0: BAR 9: assigned [mem 0x144400000-0x1447effff 64bit pref]
[   11.064914] pci 0000:74:00.0: PCI bridge to [bus 75]
[   11.064914] pci 0000:74:00.0: PCI bridge to [bus 75]
[   11.074851] pci 0000:74:00.0:   bridge window [mem 0x144000000-0x1447fffff 64bit pref]
[   11.074851] pci 0000:74:00.0:   bridge window [mem 0x144000000-0x1447fffff 64bit pref]
[   11.090748] ACPI: PCI Root Bridge [PCI6] (domain 0000 [bus 80-9f])
[   11.090748] ACPI: PCI Root Bridge [PCI6] (domain 0000 [bus 80-9f])
[   11.103125] acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.103125] acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.119633] acpi PNP0A08:06: _OSC: platform does not support [LTR]
[   11.119633] acpi PNP0A08:06: _OSC: platform does not support [LTR]
[   11.132135] acpi PNP0A08:06: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[   11.132135] acpi PNP0A08:06: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[   11.149133] acpi PNP0A08:06: [Firmware Bug]: ECAM area [mem 0xd8000000-0xd9ffffff] not reserved in ACPI namespace
[   11.149133] acpi PNP0A08:06: [Firmware Bug]: ECAM area [mem 0xd8000000-0xd9ffffff] not reserved in ACPI namespace
[   11.169698] acpi PNP0A08:06: ECAM at [mem 0xd8000000-0xd9ffffff] for [bus 80-9f]
[   11.169698] acpi PNP0A08:06: ECAM at [mem 0xd8000000-0xd9ffffff] for [bus 80-9f]
[   11.184530] Remapped I/O 0x00000000ffff0000 to [io  0x10000-0x1ffff window]
[   11.184530] Remapped I/O 0x00000000ffff0000 to [io  0x10000-0x1ffff window]
[   11.198513] PCI host bridge to bus 0000:80
[   11.198513] PCI host bridge to bus 0000:80
[   11.206706] pci_bus 0000:80: root bus resource [mem 0x480000000000-0x483fffffffff pref window]
[   11.206706] pci_bus 0000:80: root bus resource [mem 0x480000000000-0x483fffffffff pref window]
[   11.223956] pci_bus 0000:80: root bus resource [mem 0xf0000000-0xfffeffff window]
[   11.223956] pci_bus 0000:80: root bus resource [mem 0xf0000000-0xfffeffff window]
[   11.238941] pci_bus 0000:80: root bus resource [io  0x10000-0x1ffff window] (bus address [0x0000-0xffff])
[   11.238941] pci_bus 0000:80: root bus resource [io  0x10000-0x1ffff window] (bus address [0x0000-0xffff])
[   11.258106] pci_bus 0000:80: root bus resource [bus 80-9f]
[   11.258106] pci_bus 0000:80: root bus resource [bus 80-9f]
[   11.270021] pci 0000:80:00.0: PCI bridge to [bus 81]
[   11.270021] pci 0000:80:00.0: PCI bridge to [bus 81]
[   11.279965] pci 0000:80:04.0: PCI bridge to [bus 82]
[   11.279965] pci 0000:80:04.0: PCI bridge to [bus 82]
[   11.289902] pci 0000:80:08.0: PCI bridge to [bus 83]
[   11.289902] pci 0000:80:08.0: PCI bridge to [bus 83]
[   11.299841] pci 0000:80:0c.0: PCI bridge to [bus 84]
[   11.299841] pci 0000:80:0c.0: PCI bridge to [bus 84]
[   11.309778] pci 0000:80:10.0: PCI bridge to [bus 85]
[   11.309778] pci 0000:80:10.0: PCI bridge to [bus 85]
[   11.319754] ACPI: PCI Root Bridge [PCI7] (domain 0000 [bus bb])
[   11.319754] ACPI: PCI Root Bridge [PCI7] (domain 0000 [bus bb])
[   11.331606] acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.331606] acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.347990] acpi PNP0A08:07: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   11.347990] acpi PNP0A08:07: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   11.362204] acpi PNP0A08:07: [Firmware Bug]: ECAM area [mem 0xdbb00000-0xdbbfffff] not reserved in ACPI namespace
[   11.362204] acpi PNP0A08:07: [Firmware Bug]: ECAM area [mem 0xdbb00000-0xdbbfffff] not reserved in ACPI namespace
[   11.382775] acpi PNP0A08:07: ECAM at [mem 0xdbb00000-0xdbbfffff] for [bus bb]
[   11.382775] acpi PNP0A08:07: ECAM at [mem 0xdbb00000-0xdbbfffff] for [bus bb]
[   11.397123] PCI host bridge to bus 0000:bb
[   11.397123] PCI host bridge to bus 0000:bb
[   11.405319] pci_bus 0000:bb: root bus resource [mem 0x400148800000-0x400148ffffff pref window]
[   11.405319] pci_bus 0000:bb: root bus resource [mem 0x400148800000-0x400148ffffff pref window]
[   11.422567] pci_bus 0000:bb: root bus resource [bus bb]
[   11.422567] pci_bus 0000:bb: root bus resource [bus bb]
[   11.433072] ACPI: PCI Root Bridge [PCI8] (domain 0000 [bus ba])
[   11.433072] ACPI: PCI Root Bridge [PCI8] (domain 0000 [bus ba])
[   11.444923] acpi PNP0A08:08: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.444923] acpi PNP0A08:08: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.461305] acpi PNP0A08:08: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   11.461305] acpi PNP0A08:08: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   11.475512] acpi PNP0A08:08: [Firmware Bug]: ECAM area [mem 0xdba00000-0xdbafffff] not reserved in ACPI namespace
[   11.475512] acpi PNP0A08:08: [Firmware Bug]: ECAM area [mem 0xdba00000-0xdbafffff] not reserved in ACPI namespace
[   11.496083] acpi PNP0A08:08: ECAM at [mem 0xdba00000-0xdbafffff] for [bus ba]
[   11.496083] acpi PNP0A08:08: ECAM at [mem 0xdba00000-0xdbafffff] for [bus ba]
[   11.510426] PCI host bridge to bus 0000:ba
[   11.510426] PCI host bridge to bus 0000:ba
[   11.518622] pci_bus 0000:ba: root bus resource [mem 0x40020c000000-0x40020c1fffff pref window]
[   11.518622] pci_bus 0000:ba: root bus resource [mem 0x40020c000000-0x40020c1fffff pref window]
[   11.535869] pci_bus 0000:ba: root bus resource [bus ba]
[   11.535869] pci_bus 0000:ba: root bus resource [bus ba]
[   11.546555] pci 0000:ba:02.0: BAR 0: assigned [mem 0x40020c000000-0x40020c0fffff 64bit pref]
[   11.546555] pci 0000:ba:02.0: BAR 0: assigned [mem 0x40020c000000-0x40020c0fffff 64bit pref]
[   11.563458] pci 0000:ba:00.0: BAR 0: assigned [mem 0x40020c100000-0x40020c100fff 64bit pref]
[   11.563458] pci 0000:ba:00.0: BAR 0: assigned [mem 0x40020c100000-0x40020c100fff 64bit pref]
[   11.580362] pci 0000:ba:01.0: BAR 0: assigned [mem 0x40020c101000-0x40020c101fff 64bit pref]
[   11.580362] pci 0000:ba:01.0: BAR 0: assigned [mem 0x40020c101000-0x40020c101fff 64bit pref]
[   11.597299] ACPI: PCI Root Bridge [PCI9] (domain 0000 [bus b8-b9])
[   11.597299] ACPI: PCI Root Bridge [PCI9] (domain 0000 [bus b8-b9])
[   11.609676] acpi PNP0A08:09: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.609676] acpi PNP0A08:09: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.626056] acpi PNP0A08:09: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   11.626056] acpi PNP0A08:09: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   11.640267] acpi PNP0A08:09: [Firmware Bug]: ECAM area [mem 0xdb800000-0xdb9fffff] not reserved in ACPI namespace
[   11.640267] acpi PNP0A08:09: [Firmware Bug]: ECAM area [mem 0xdb800000-0xdb9fffff] not reserved in ACPI namespace
[   11.660828] acpi PNP0A08:09: ECAM at [mem 0xdb800000-0xdb9fffff] for [bus b8-b9]
[   11.660828] acpi PNP0A08:09: ECAM at [mem 0xdb800000-0xdb9fffff] for [bus b8-b9]
[   11.675699] PCI host bridge to bus 0000:b8
[   11.675699] PCI host bridge to bus 0000:b8
[   11.683893] pci_bus 0000:b8: root bus resource [mem 0x400208000000-0x400208ffffff pref window]
[   11.683893] pci_bus 0000:b8: root bus resource [mem 0x400208000000-0x400208ffffff pref window]
[   11.701142] pci_bus 0000:b8: root bus resource [bus b8-b9]
[   11.701142] pci_bus 0000:b8: root bus resource [bus b8-b9]
[   11.712208] pci 0000:b8:00.0: BAR 2: assigned [mem 0x400208000000-0x4002081fffff 64bit pref]
[   11.712208] pci 0000:b8:00.0: BAR 2: assigned [mem 0x400208000000-0x4002081fffff 64bit pref]
[   11.729145] ACPI: PCI Root Bridge [PCIA] (domain 0000 [bus bc-bd])
[   11.729145] ACPI: PCI Root Bridge [PCIA] (domain 0000 [bus bc-bd])
[   11.741519] acpi PNP0A08:0a: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.741519] acpi PNP0A08:0a: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   11.757902] acpi PNP0A08:0a: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   11.757902] acpi PNP0A08:0a: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   11.772110] acpi PNP0A08:0a: [Firmware Bug]: ECAM area [mem 0xdbc00000-0xdbdfffff] not reserved in ACPI namespace
[   11.772110] acpi PNP0A08:0a: [Firmware Bug]: ECAM area [mem 0xdbc00000-0xdbdfffff] not reserved in ACPI namespace
[   11.792673] acpi PNP0A08:0a: ECAM at [mem 0xdbc00000-0xdbdfffff] for [bus bc-bd]
[   11.792673] acpi PNP0A08:0a: ECAM at [mem 0xdbc00000-0xdbdfffff] for [bus bc-bd]
[   11.807543] PCI host bridge to bus 0000:bc
[   11.807543] PCI host bridge to bus 0000:bc
[   11.815739] pci_bus 0000:bc: root bus resource [mem 0x400120000000-0x40013fffffff pref window]
[   11.815739] pci_bus 0000:bc: root bus resource [mem 0x400120000000-0x40013fffffff pref window]
[   11.832987] pci_bus 0000:bc: root bus resource [bus bc-bd]
[   11.832987] pci_bus 0000:bc: root bus resource [bus bc-bd]
[   11.843985] pci 0000:bc:00.0: enabling Extended Tags
[   11.843985] pci 0000:bc:00.0: enabling Extended Tags
[   11.854061] pci 0000:bd:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000effff 64bit pref] (contains BAR0 for 15 VFs)
[   11.854061] pci 0000:bd:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000effff 64bit pref] (contains BAR0 for 15 VFs)
[   11.874627] pci 0000:bd:00.0: VF(n) BAR2 space: [mem 0x00000000-0x00efffff 64bit pref] (contains BAR2 for 15 VFs)
[   11.874627] pci 0000:bd:00.0: VF(n) BAR2 space: [mem 0x00000000-0x00efffff 64bit pref] (contains BAR2 for 15 VFs)
[   11.895292] pci 0000:bd:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000effff 64bit pref] (contains BAR0 for 15 VFs)
[   11.895292] pci 0000:bd:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000effff 64bit pref] (contains BAR0 for 15 VFs)
[   11.915857] pci 0000:bd:00.1: VF(n) BAR2 space: [mem 0x00000000-0x00efffff 64bit pref] (contains BAR2 for 15 VFs)
[   11.915857] pci 0000:bd:00.1: VF(n) BAR2 space: [mem 0x00000000-0x00efffff 64bit pref] (contains BAR2 for 15 VFs)
[   11.936486] pci 0000:bc:00.0: BAR 15: assigned [mem 0x400120000000-0x4001221fffff 64bit pref]
[   11.936486] pci 0000:bc:00.0: BAR 15: assigned [mem 0x400120000000-0x4001221fffff 64bit pref]
[   11.953564] pci 0000:bd:00.0: BAR 2: assigned [mem 0x400120000000-0x4001200fffff 64bit pref]
[   11.953564] pci 0000:bd:00.0: BAR 2: assigned [mem 0x400120000000-0x4001200fffff 64bit pref]
[   11.970466] pci 0000:bd:00.0: BAR 9: assigned [mem 0x400120100000-0x400120ffffff 64bit pref]
[   11.970466] pci 0000:bd:00.0: BAR 9: assigned [mem 0x400120100000-0x400120ffffff 64bit pref]
[   11.987369] pci 0000:bd:00.1: BAR 2: assigned [mem 0x400121000000-0x4001210fffff 64bit pref]
[   11.987369] pci 0000:bd:00.1: BAR 2: assigned [mem 0x400121000000-0x4001210fffff 64bit pref]
[   12.004270] pci 0000:bd:00.1: BAR 9: assigned [mem 0x400121100000-0x400121ffffff 64bit pref]
[   12.004270] pci 0000:bd:00.1: BAR 9: assigned [mem 0x400121100000-0x400121ffffff 64bit pref]
[   12.021172] pci 0000:bd:00.0: BAR 0: assigned [mem 0x400122000000-0x40012200ffff 64bit pref]
[   12.021172] pci 0000:bd:00.0: BAR 0: assigned [mem 0x400122000000-0x40012200ffff 64bit pref]
[   12.038074] pci 0000:bd:00.0: BAR 7: assigned [mem 0x400122010000-0x4001220fffff 64bit pref]
[   12.038074] pci 0000:bd:00.0: BAR 7: assigned [mem 0x400122010000-0x4001220fffff 64bit pref]
[   12.054976] pci 0000:bd:00.1: BAR 0: assigned [mem 0x400122100000-0x40012210ffff 64bit pref]
[   12.054976] pci 0000:bd:00.1: BAR 0: assigned [mem 0x400122100000-0x40012210ffff 64bit pref]
[   12.071877] pci 0000:bd:00.1: BAR 7: assigned [mem 0x400122110000-0x4001221fffff 64bit pref]
[   12.071877] pci 0000:bd:00.1: BAR 7: assigned [mem 0x400122110000-0x4001221fffff 64bit pref]
[   12.088780] pci 0000:bc:00.0: PCI bridge to [bus bd]
[   12.088780] pci 0000:bc:00.0: PCI bridge to [bus bd]
[   12.098715] pci 0000:bc:00.0:   bridge window [mem 0x400120000000-0x4001221fffff 64bit pref]
[   12.098715] pci 0000:bc:00.0:   bridge window [mem 0x400120000000-0x4001221fffff 64bit pref]
[   12.115654] ACPI: PCI Root Bridge [PCIB] (domain 0000 [bus b4-b6])
[   12.115654] ACPI: PCI Root Bridge [PCIB] (domain 0000 [bus b4-b6])
[   12.128040] acpi PNP0A08:0b: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   12.128040] acpi PNP0A08:0b: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[   12.144421] acpi PNP0A08:0b: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   12.144421] acpi PNP0A08:0b: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   12.158634] acpi PNP0A08:0b: [Firmware Bug]: ECAM area [mem 0xdb400000-0xdb6fffff] not reserved in ACPI namespace
[   12.158634] acpi PNP0A08:0b: [Firmware Bug]: ECAM area [mem 0xdb400000-0xdb6fffff] not reserved in ACPI namespace
[   12.179203] acpi PNP0A08:0b: ECAM at [mem 0xdb400000-0xdb6fffff] for [bus b4-b6]
[   12.179203] acpi PNP0A08:0b: ECAM at [mem 0xdb400000-0xdb6fffff] for [bus b4-b6]
[   12.194071] PCI host bridge to bus 0000:b4
[   12.194071] PCI host bridge to bus 0000:b4
[   12.202264] pci_bus 0000:b4: root bus resource [mem 0x400144000000-0x400147ffffff pref window]
[   12.202264] pci_bus 0000:b4: root bus resource [mem 0x400144000000-0x400147ffffff pref window]
[   12.219514] pci_bus 0000:b4: root bus resource [mem 0xa3000000-0xa3ffffff window]
[   12.219514] pci_bus 0000:b4: root bus resource [mem 0xa3000000-0xa3ffffff window]
[   12.234498] pci_bus 0000:b4: root bus resource [bus b4-b6]
[   12.234498] pci_bus 0000:b4: root bus resource [bus b4-b6]
[   12.245496] pci 0000:b4:00.0: enabling Extended Tags
[   12.245496] pci 0000:b4:00.0: enabling Extended Tags
[   12.255572] pci 0000:b5:00.0: VF(n) BAR2 space: [mem 0x00000000-0x003effff 64bit pref] (contains BAR2 for 63 VFs)
[   12.255572] pci 0000:b5:00.0: VF(n) BAR2 space: [mem 0x00000000-0x003effff 64bit pref] (contains BAR2 for 63 VFs)
[   12.276246] pci 0000:b4:00.0: BAR 15: assigned [mem 0x400144000000-0x4001447fffff 64bit pref]
[   12.276246] pci 0000:b4:00.0: BAR 15: assigned [mem 0x400144000000-0x4001447fffff 64bit pref]
[   12.293321] pci 0000:b5:00.0: BAR 2: assigned [mem 0x400144000000-0x4001443fffff 64bit pref]
[   12.293321] pci 0000:b5:00.0: BAR 2: assigned [mem 0x400144000000-0x4001443fffff 64bit pref]
[   12.310225] pci 0000:b5:00.0: BAR 9: assigned [mem 0x400144400000-0x4001447effff 64bit pref]
[   12.310225] pci 0000:b5:00.0: BAR 9: assigned [mem 0x400144400000-0x4001447effff 64bit pref]
[   12.327126] pci 0000:b4:00.0: PCI bridge to [bus b5]
[   12.327126] pci 0000:b4:00.0: PCI bridge to [bus b5]
[   12.337063] pci 0000:b4:00.0:   bridge window [mem 0x400144000000-0x4001447fffff 64bit pref]
[   12.337063] pci 0000:b4:00.0:   bridge window [mem 0x400144000000-0x4001447fffff 64bit pref]
[   12.360383] pci 0000:05:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[   12.360383] pci 0000:05:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[   12.377128] pci 0000:05:00.0: vgaarb: bridge control possible
[   12.377128] pci 0000:05:00.0: vgaarb: bridge control possible
[   12.388634] pci 0000:05:00.0: vgaarb: setting as boot device (VGA legacy resources not available)
[   12.388634] pci 0000:05:00.0: vgaarb: setting as boot device (VGA legacy resources not available)
[   12.406404] vgaarb: loaded
[   12.406404] vgaarb: loaded
[   12.411935] SCSI subsystem initialized
[   12.411935] SCSI subsystem initialized
[   12.419676] ACPI: bus type USB registered
[   12.419676] ACPI: bus type USB registered
[   12.427735] usbcore: registered new interface driver usbfs
[   12.427735] usbcore: registered new interface driver usbfs
[   12.438726] usbcore: registered new interface driver hub
[   12.438726] usbcore: registered new interface driver hub
[   12.449561] usbcore: registered new device driver usb
[   12.449561] usbcore: registered new device driver usb
[   12.459980] pps_core: LinuxPPS API ver. 1 registered
[   12.459980] pps_core: LinuxPPS API ver. 1 registered
[   12.469917] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@xxxxxxxx>
[   12.469917] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@xxxxxxxx>
[   12.488216] PTP clock support registered
[   12.488216] PTP clock support registered
[   12.496382] EDAC MC: Ver: 3.0.0
[   12.496382] EDAC MC: Ver: 3.0.0
[   12.503232] Registered efivars operations
[   12.503232] Registered efivars operations
[   12.512642] Advanced Linux Sound Architecture Driver Initialized.
[   12.512642] Advanced Linux Sound Architecture Driver Initialized.
[   12.525263] clocksource: Switched to clocksource arch_sys_counter
[   12.525263] clocksource: Switched to clocksource arch_sys_counter
[   12.537665] VFS: Disk quotas dquot_6.6.0
[   12.537665] VFS: Disk quotas dquot_6.6.0
[   12.545536] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[   12.545536] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[   12.559369] pnp: PnP ACPI init
[   12.559369] pnp: PnP ACPI init
[   12.566027] pnp: PnP ACPI: found 1 devices
[   12.566027] pnp: PnP ACPI: found 1 devices
[   12.576064] NET: Registered protocol family 2
[   12.576064] NET: Registered protocol family 2
[   12.585157] tcp_listen_portaddr_hash hash table entries: 32768 (order: 8, 1310720 bytes)
[   12.585157] tcp_listen_portaddr_hash hash table entries: 32768 (order: 8, 1310720 bytes)
[   12.601815] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[   12.601815] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[   12.618032] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes)
[   12.618032] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes)
[   12.631803] TCP: Hash tables configured (established 524288 bind 65536)
[   12.631803] TCP: Hash tables configured (established 524288 bind 65536)
[   12.645371] UDP hash table entries: 32768 (order: 9, 3145728 bytes)
[   12.645371] UDP hash table entries: 32768 (order: 9, 3145728 bytes)
[   12.658651] UDP-Lite hash table entries: 32768 (order: 9, 3145728 bytes)
[   12.658651] UDP-Lite hash table entries: 32768 (order: 9, 3145728 bytes)
[   12.672697] NET: Registered protocol family 1
[   12.672697] NET: Registered protocol family 1
[   12.681841] RPC: Registered named UNIX socket transport module.
[   12.681841] RPC: Registered named UNIX socket transport module.
[   12.693696] RPC: Registered udp transport module.
[   12.693696] RPC: Registered udp transport module.
[   12.703107] RPC: Registered tcp transport module.
[   12.703107] RPC: Registered tcp transport module.
[   12.712517] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   12.712517] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   12.725446] pci 0000:7a:00.0: enabling device (0000 -> 0002)
[   12.725446] pci 0000:7a:00.0: enabling device (0000 -> 0002)
[   12.736785] pci 0000:7a:00.0: quirk_usb_early_handoff+0x0/0x754 took 11073 usecs
[   12.736785] pci 0000:7a:00.0: quirk_usb_early_handoff+0x0/0x754 took 11073 usecs
[   12.751605] pci 0000:7a:02.0: enabling device (0000 -> 0002)
[   12.751605] pci 0000:7a:02.0: enabling device (0000 -> 0002)
[   12.763025] pci 0000:7a:02.0: quirk_usb_early_handoff+0x0/0x754 took 11152 usecs
[   12.763025] pci 0000:7a:02.0: quirk_usb_early_handoff+0x0/0x754 took 11152 usecs
[   12.777873] pci 0000:ba:00.0: enabling device (0000 -> 0002)
[   12.777873] pci 0000:ba:00.0: enabling device (0000 -> 0002)
[   12.789206] pci 0000:ba:00.0: quirk_usb_early_handoff+0x0/0x754 took 11068 usecs
[   12.789206] pci 0000:ba:00.0: quirk_usb_early_handoff+0x0/0x754 took 11068 usecs
[   12.804026] pci 0000:ba:02.0: enabling device (0000 -> 0002)
[   12.804026] pci 0000:ba:02.0: enabling device (0000 -> 0002)
[   12.815410] pci 0000:ba:02.0: quirk_usb_early_handoff+0x0/0x754 took 11117 usecs
[   12.815410] pci 0000:ba:02.0: quirk_usb_early_handoff+0x0/0x754 took 11117 usecs
[   12.830299] Unpacking initramfs...
[   12.830299] Unpacking initramfs...
[   13.728960] Freeing initrd memory: 122880K
[   13.728960] Freeing initrd memory: 122880K
[   13.740149] hw perfevents: enabled with armv8_pmuv3_0 PMU driver, 13 counters available
[   13.740149] hw perfevents: enabled with armv8_pmuv3_0 PMU driver, 13 counters available
[   13.756348] kvm [1]: 16-bit VMID
[   13.756348] kvm [1]: 16-bit VMID
[   13.762827] kvm [1]: GICv4 support disabled
[   13.762827] kvm [1]: GICv4 support disabled
[   13.771194] kvm [1]: GICv3: no GICV resource entry
[   13.771194] kvm [1]: GICv3: no GICV resource entry
[   13.780779] kvm [1]: disabling GICv2 emulation
[   13.780779] kvm [1]: disabling GICv2 emulation
[   13.789682] kvm [1]: GIC system register CPU interface enabled
[   13.789682] kvm [1]: GIC system register CPU interface enabled
[   13.802078] kvm [1]: vgic interrupt IRQ1
[   13.802078] kvm [1]: vgic interrupt IRQ1
[   13.810669] kvm [1]: VHE mode initialized successfully
[   13.810669] kvm [1]: VHE mode initialized successfully
[   13.823513] Initialise system trusted keyrings
[   13.823513] Initialise system trusted keyrings
[   13.832497] workingset: timestamp_bits=44 max_order=24 bucket_order=0
[   13.832497] workingset: timestamp_bits=44 max_order=24 bucket_order=0
[   13.847276] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[   13.847276] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[   13.859263] NFS: Registering the id_resolver key type
[   13.859263] NFS: Registering the id_resolver key type
[   13.869383] Key type id_resolver registered
[   13.869383] Key type id_resolver registered
[   13.877752] Key type id_legacy registered
[   13.877752] Key type id_legacy registered
[   13.885772] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[   13.885772] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[   13.899231] 9p: Installing v9fs 9p2000 file system support
[   13.899231] 9p: Installing v9fs 9p2000 file system support
[   13.910238] pstore: using deflate compression
[   13.910238] pstore: using deflate compression
[   13.920016] async_tx: api initialized (async)
[   13.920016] async_tx: api initialized (async)
[   13.928734] Key type asymmetric registered
[   13.928734] Key type asymmetric registered
[   13.936929] Asymmetric key parser 'x509' registered
[   13.936929] Asymmetric key parser 'x509' registered
[   13.946698] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[   13.946698] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[   13.961510] io scheduler noop registered
[   13.961510] io scheduler noop registered
[   13.969353] io scheduler deadline registered
[   13.969353] io scheduler deadline registered
[   13.977948] io scheduler cfq registered (default)
[   13.977948] io scheduler cfq registered (default)
[   13.987359] io scheduler mq-deadline registered
[   13.987359] io scheduler mq-deadline registered
[   13.996423] io scheduler kyber registered
[   13.996423] io scheduler kyber registered
[   14.011573] ipmi message handler version 39.2
[   14.011573] ipmi message handler version 39.2
[   14.020298] ipmi device interface
[   14.020298] ipmi device interface
[   14.026934] IPMI System Interface driver.
[   14.026934] IPMI System Interface driver.
[   14.035049] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI
[   14.035049] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI
[   14.046932] ipmi_si IPI0001:00: [mem 0x3f00000e4-0x3f00000e7] regsize 1 spacing 1 irq 6
[   14.046932] ipmi_si IPI0001:00: [mem 0x3f00000e4-0x3f00000e7] regsize 1 spacing 1 irq 6
[   14.062965] ipmi_si: Adding ACPI-specified bt state machine
[   14.062965] ipmi_si: Adding ACPI-specified bt state machine
[   14.074177] ipmi_si: Trying ACPI-specified bt state machine at mem address 0x3f00000e4, slave address 0x0, irq 6
[   14.074177] ipmi_si: Trying ACPI-specified bt state machine at mem address 0x3f00000e4, slave address 0x0, irq 6
[   14.101214] ipmi_si IPI0001:00: bt cap response too short: 3
[   14.101214] ipmi_si IPI0001:00: bt cap response too short: 3
[   14.112543] ipmi_si IPI0001:00: using default values
[   14.112543] ipmi_si IPI0001:00: using default values
[   14.122476] ipmi_si IPI0001:00: req2rsp=5 secs retries=2
[   14.122476] ipmi_si IPI0001:00: req2rsp=5 secs retries=2
[   14.265209] ipmi_si IPI0001:00: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed.
[   14.265209] ipmi_si IPI0001:00: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed.
[   14.293257] ipmi_si IPI0001:00: Using irq 6
[   14.293257] ipmi_si IPI0001:00: Using irq 6
[   14.377261] ipmi_si IPI0001:00: Found new BMC (man_id: 0x0007db, prod_id: 0x0001, dev_id: 0x01)
[   14.377261] ipmi_si IPI0001:00: Found new BMC (man_id: 0x0007db, prod_id: 0x0001, dev_id: 0x01)
[   14.657299] ipmi_si IPI0001:00: IPMI bt interface initialized
[   14.657299] ipmi_si IPI0001:00: IPMI bt interface initialized
[   14.669162] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[   14.669162] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[   14.685906] ACPI: Power Button [PWRB]
[   14.685906] ACPI: Power Button [PWRB]
[   14.694435] [Firmware Bug]: APEI: Invalid bit width + offset in GAR [0x94110034/64/0/3/0]
[   14.694435] [Firmware Bug]: APEI: Invalid bit width + offset in GAR [0x94110034/64/0/3/0]
[   14.711062] EDAC MC0: Giving out device to module ghes_edac.c controller ghes_edac: DEV ghes (INTERRUPT)
[   14.711062] EDAC MC0: Giving out device to module ghes_edac.c controller ghes_edac: DEV ghes (INTERRUPT)
[   14.730260] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[   14.730260] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[   14.745115] EINJ: Error INJection is initialized.
[   14.745115] EINJ: Error INJection is initialized.
[   14.757911] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[   14.757911] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[   14.791074] 00:00: ttyS0 at MMIO 0x3f00003f8 (irq = 6, base_baud = 115200) is a 16550A
[   14.791074] 00:00: ttyS0 at MMIO 0x3f00003f8 (irq = 6, base_baud = 115200) is a 16550A
[   14.807683] SuperH (H)SCI(F) driver initialized
[   14.807683] SuperH (H)SCI(F) driver initialized
[   14.816884] msm_serial: driver initialized
[   14.816884] msm_serial: driver initialized
[   14.825228] arm-smmu-v3 arm-smmu-v3.0.auto: option mask 0x0
[   14.825228] arm-smmu-v3 arm-smmu-v3.0.auto: option mask 0x0
[   14.836399] arm-smmu-v3 arm-smmu-v3.0.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.836399] arm-smmu-v3 arm-smmu-v3.0.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.853066] arm-smmu-v3 arm-smmu-v3.1.auto: option mask 0x0
[   14.853066] arm-smmu-v3 arm-smmu-v3.1.auto: option mask 0x0
[   14.864235] arm-smmu-v3 arm-smmu-v3.1.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.864235] arm-smmu-v3 arm-smmu-v3.1.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.880712] arm-smmu-v3 arm-smmu-v3.2.auto: option mask 0x0
[   14.880712] arm-smmu-v3 arm-smmu-v3.2.auto: option mask 0x0
[   14.891876] arm-smmu-v3 arm-smmu-v3.2.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.891876] arm-smmu-v3 arm-smmu-v3.2.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.908322] arm-smmu-v3 arm-smmu-v3.3.auto: option mask 0x0
[   14.908322] arm-smmu-v3 arm-smmu-v3.3.auto: option mask 0x0
[   14.919488] arm-smmu-v3 arm-smmu-v3.3.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.919488] arm-smmu-v3 arm-smmu-v3.3.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.935936] arm-smmu-v3 arm-smmu-v3.4.auto: option mask 0x0
[   14.935936] arm-smmu-v3 arm-smmu-v3.4.auto: option mask 0x0
[   14.947099] arm-smmu-v3 arm-smmu-v3.4.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.947099] arm-smmu-v3 arm-smmu-v3.4.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.963551] arm-smmu-v3 arm-smmu-v3.5.auto: option mask 0x0
[   14.963551] arm-smmu-v3 arm-smmu-v3.5.auto: option mask 0x0
[   14.974714] arm-smmu-v3 arm-smmu-v3.5.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   14.974714] arm-smmu-v3 arm-smmu-v3.5.auto: ias 48-bit, oas 48-bit (features 0x00000fef)
[   15.004088] loop: module loaded
[   15.004088] loop: module loaded
[   15.010732] megasas: 07.706.03.00-rc1
[   15.010732] megasas: 07.706.03.00-rc1
[   15.018101] mpt3sas version 26.100.00.00 loaded
[   15.018101] mpt3sas version 26.100.00.00 loaded
[   15.027349] iommu: Adding device 0000:03:00.0 to group 0
[   15.027349] iommu: Adding device 0000:03:00.0 to group 0
[   15.038590] mpt3sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (64910152 kB)
[   15.038590] mpt3sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (64910152 kB)
[   15.112637] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[   15.112637] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[   15.128683] mpt3sas_cm0: MSI-X vectors supported: 96, no of cores: 64, max_msix_vectors: -1
[   15.128683] mpt3sas_cm0: MSI-X vectors supported: 96, no of cores: 64, max_msix_vectors: -1
[   15.146925] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 23
[   15.146925] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 23
[   15.157037] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 24
[   15.157037] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 24
[   15.167145] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 25
[   15.167145] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 25
[   15.177253] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 26
[   15.177253] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 26
[   15.187358] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 27
[   15.187358] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 27
[   15.197464] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 28
[   15.197464] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 28
[   15.207572] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 29
[   15.207572] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 29
[   15.217678] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 30
[   15.217678] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 30
[   15.227783] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 31
[   15.227783] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 31
[   15.237890] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 32
[   15.237890] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 32
[   15.247997] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 33
[   15.247997] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 33
[   15.258277] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 34
[   15.258277] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 34
[   15.268557] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 35
[   15.268557] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 35
[   15.278839] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 36
[   15.278839] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 36
[   15.289118] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 37
[   15.289118] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 37
[   15.299398] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 38
[   15.299398] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 38
[   15.309678] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 39
[   15.309678] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 39
[   15.319960] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 40
[   15.319960] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 40
[   15.330239] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 41
[   15.330239] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 41
[   15.340519] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 42
[   15.340519] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 42
[   15.350802] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 43
[   15.350802] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 43
[   15.361082] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 44
[   15.361082] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 44
[   15.371361] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 45
[   15.371361] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 45
[   15.381641] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 46
[   15.381641] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 46
[   15.391922] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 47
[   15.391922] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 47
[   15.402202] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 48
[   15.402202] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 48
[   15.412482] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 49
[   15.412482] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 49
[   15.422764] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 50
[   15.422764] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 50
[   15.433043] mpt3sas0-msix28: PCI-MSI-X enabled: IRQ 51
[   15.433043] mpt3sas0-msix28: PCI-MSI-X enabled: IRQ 51
[   15.443323] mpt3sas0-msix29: PCI-MSI-X enabled: IRQ 52
[   15.443323] mpt3sas0-msix29: PCI-MSI-X enabled: IRQ 52
[   15.453603] mpt3sas0-msix30: PCI-MSI-X enabled: IRQ 53
[   15.453603] mpt3sas0-msix30: PCI-MSI-X enabled: IRQ 53
[   15.463885] mpt3sas0-msix31: PCI-MSI-X enabled: IRQ 54
[   15.463885] mpt3sas0-msix31: PCI-MSI-X enabled: IRQ 54
[   15.474164] mpt3sas0-msix32: PCI-MSI-X enabled: IRQ 55
[   15.474164] mpt3sas0-msix32: PCI-MSI-X enabled: IRQ 55
[   15.484444] mpt3sas0-msix33: PCI-MSI-X enabled: IRQ 56
[   15.484444] mpt3sas0-msix33: PCI-MSI-X enabled: IRQ 56
[   15.494727] mpt3sas0-msix34: PCI-MSI-X enabled: IRQ 57
[   15.494727] mpt3sas0-msix34: PCI-MSI-X enabled: IRQ 57
[   15.505006] mpt3sas0-msix35: PCI-MSI-X enabled: IRQ 58
[   15.505006] mpt3sas0-msix35: PCI-MSI-X enabled: IRQ 58
[   15.515286] mpt3sas0-msix36: PCI-MSI-X enabled: IRQ 59
[   15.515286] mpt3sas0-msix36: PCI-MSI-X enabled: IRQ 59
[   15.525566] mpt3sas0-msix37: PCI-MSI-X enabled: IRQ 60
[   15.525566] mpt3sas0-msix37: PCI-MSI-X enabled: IRQ 60
[   15.535847] mpt3sas0-msix38: PCI-MSI-X enabled: IRQ 61
[   15.535847] mpt3sas0-msix38: PCI-MSI-X enabled: IRQ 61
[   15.546127] mpt3sas0-msix39: PCI-MSI-X enabled: IRQ 62
[   15.546127] mpt3sas0-msix39: PCI-MSI-X enabled: IRQ 62
[   15.556407] mpt3sas0-msix40: PCI-MSI-X enabled: IRQ 63
[   15.556407] mpt3sas0-msix40: PCI-MSI-X enabled: IRQ 63
[   15.566689] mpt3sas0-msix41: PCI-MSI-X enabled: IRQ 64
[   15.566689] mpt3sas0-msix41: PCI-MSI-X enabled: IRQ 64
[   15.576969] mpt3sas0-msix42: PCI-MSI-X enabled: IRQ 65
[   15.576969] mpt3sas0-msix42: PCI-MSI-X enabled: IRQ 65
[   15.587249] mpt3sas0-msix43: PCI-MSI-X enabled: IRQ 66
[   15.587249] mpt3sas0-msix43: PCI-MSI-X enabled: IRQ 66
[   15.597529] mpt3sas0-msix44: PCI-MSI-X enabled: IRQ 67
[   15.597529] mpt3sas0-msix44: PCI-MSI-X enabled: IRQ 67
[   15.607810] mpt3sas0-msix45: PCI-MSI-X enabled: IRQ 68
[   15.607810] mpt3sas0-msix45: PCI-MSI-X enabled: IRQ 68
[   15.618090] mpt3sas0-msix46: PCI-MSI-X enabled: IRQ 69
[   15.618090] mpt3sas0-msix46: PCI-MSI-X enabled: IRQ 69
[   15.628370] mpt3sas0-msix47: PCI-MSI-X enabled: IRQ 70
[   15.628370] mpt3sas0-msix47: PCI-MSI-X enabled: IRQ 70
[   15.638652] mpt3sas0-msix48: PCI-MSI-X enabled: IRQ 71
[   15.638652] mpt3sas0-msix48: PCI-MSI-X enabled: IRQ 71
[   15.648932] mpt3sas0-msix49: PCI-MSI-X enabled: IRQ 72
[   15.648932] mpt3sas0-msix49: PCI-MSI-X enabled: IRQ 72
[   15.659212] mpt3sas0-msix50: PCI-MSI-X enabled: IRQ 73
[   15.659212] mpt3sas0-msix50: PCI-MSI-X enabled: IRQ 73
[   15.669492] mpt3sas0-msix51: PCI-MSI-X enabled: IRQ 74
[   15.669492] mpt3sas0-msix51: PCI-MSI-X enabled: IRQ 74
[   15.679774] mpt3sas0-msix52: PCI-MSI-X enabled: IRQ 75
[   15.679774] mpt3sas0-msix52: PCI-MSI-X enabled: IRQ 75
[   15.690054] mpt3sas0-msix53: PCI-MSI-X enabled: IRQ 76
[   15.690054] mpt3sas0-msix53: PCI-MSI-X enabled: IRQ 76
[   15.700334] mpt3sas0-msix54: PCI-MSI-X enabled: IRQ 77
[   15.700334] mpt3sas0-msix54: PCI-MSI-X enabled: IRQ 77
[   15.710616] mpt3sas0-msix55: PCI-MSI-X enabled: IRQ 78
[   15.710616] mpt3sas0-msix55: PCI-MSI-X enabled: IRQ 78
[   15.720896] mpt3sas0-msix56: PCI-MSI-X enabled: IRQ 79
[   15.720896] mpt3sas0-msix56: PCI-MSI-X enabled: IRQ 79
[   15.731176] mpt3sas0-msix57: PCI-MSI-X enabled: IRQ 80
[   15.731176] mpt3sas0-msix57: PCI-MSI-X enabled: IRQ 80
[   15.741456] mpt3sas0-msix58: PCI-MSI-X enabled: IRQ 81
[   15.741456] mpt3sas0-msix58: PCI-MSI-X enabled: IRQ 81
[   15.751736] mpt3sas0-msix59: PCI-MSI-X enabled: IRQ 82
[   15.751736] mpt3sas0-msix59: PCI-MSI-X enabled: IRQ 82
[   15.762016] mpt3sas0-msix60: PCI-MSI-X enabled: IRQ 83
[   15.762016] mpt3sas0-msix60: PCI-MSI-X enabled: IRQ 83
[   15.772296] mpt3sas0-msix61: PCI-MSI-X enabled: IRQ 84
[   15.772296] mpt3sas0-msix61: PCI-MSI-X enabled: IRQ 84
[   15.782575] mpt3sas0-msix62: PCI-MSI-X enabled: IRQ 85
[   15.782575] mpt3sas0-msix62: PCI-MSI-X enabled: IRQ 85
[   15.792855] mpt3sas0-msix63: PCI-MSI-X enabled: IRQ 86
[   15.792855] mpt3sas0-msix63: PCI-MSI-X enabled: IRQ 86
[   15.803136] mpt3sas_cm0: iomem(0x00000000e3340000), mapped(0x(____ptrval____)), size(65536)
[   15.803136] mpt3sas_cm0: iomem(0x00000000e3340000), mapped(0x(____ptrval____)), size(65536)
[   15.819860] mpt3sas_cm0: ioport(0x0000000000002000), size(256)
[   15.819860] mpt3sas_cm0: ioport(0x0000000000002000), size(256)
[   15.889232] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[   15.889232] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[   15.905262] mpt3sas_cm0: sending diag reset !!
[   15.905262] mpt3sas_cm0: sending diag reset !!
[   17.010215] mpt3sas_cm0: diag reset: SUCCESS
[   17.010215] mpt3sas_cm0: diag reset: SUCCESS
[   17.104873] mpt3sas_cm0: Allocated physical memory: size(6212 kB)
[   17.104873] mpt3sas_cm0: Allocated physical memory: size(6212 kB)
[   17.117075] mpt3sas_cm0: Current Controller Queue Depth(3960),Max Controller Queue Depth(4096)
[   17.117075] mpt3sas_cm0: Current Controller Queue Depth(3960),Max Controller Queue Depth(4096)
[   17.134322] mpt3sas_cm0: Scatter Gather Elements per IO(128)
[   17.134322] mpt3sas_cm0: Scatter Gather Elements per IO(128)
[   17.345565] mpt3sas_cm0: _base_display_fwpkg_version: complete
[   17.345565] mpt3sas_cm0: _base_display_fwpkg_version: complete
[   17.357540] mpt3sas_cm0: LSISAS3008: FWVersion(12.00.02.00), ChipRevision(0x02), BiosVersion(14.00.00.00)
[   17.357540] mpt3sas_cm0: LSISAS3008: FWVersion(12.00.02.00), ChipRevision(0x02), BiosVersion(14.00.00.00)
[   17.376707] mpt3sas_cm0: Protocol=(
[   17.376707] mpt3sas_cm0: Protocol=(
[   17.376709] Initiator
[   17.376709] Initiator
[   17.383681] ), 
[   17.383681] ), 
[   17.388217] Capabilities=(
[   17.388217] Capabilities=(
[   17.391706] Raid
[   17.391706] Raid
[   17.397113] ,TLR
[   17.397113] ,TLR
[   17.400777] ,EEDP
[   17.400777] ,EEDP
[   17.404439] ,Snapshot Buffer
[   17.404439] ,Snapshot Buffer
[   17.408275] ,Diag Trace Buffer
[   17.408275] ,Diag Trace Buffer
[   17.414028] ,Task Set Full
[   17.414028] ,Task Set Full
[   17.420128] ,NCQ
[   17.420128] ,NCQ
[   17.425538] )
[   17.425538] )
[   17.432388] scsi host0: Fusion MPT SAS Host
[   17.432388] scsi host0: Fusion MPT SAS Host
[   17.445890] mpt3sas_cm0: sending port enable !!
[   17.445890] mpt3sas_cm0: sending port enable !!
[   18.966641] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x5e868198a7528000), phys(8)
[   18.966641] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x5e868198a7528000), phys(8)
[   19.978068] random: fast init done
[   19.978068] random: fast init done
[   31.353203] mpt3sas_cm0: port enable: SUCCESS
[   31.353203] mpt3sas_cm0: port enable: SUCCESS
[   31.362662] scsi 0:0:0:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.362662] scsi 0:0:0:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.378873] scsi 0:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca04ec2aefd), phy(0), device_name(0x5000cca04ec2aeff)
[   31.378873] scsi 0:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca04ec2aefd), phy(0), device_name(0x5000cca04ec2aeff)
[   31.399949] scsi 0:0:0:0: enclosure logical id (0x5e868198a7528000), slot(0) 
[   31.399949] scsi 0:0:0:0: enclosure logical id (0x5e868198a7528000), slot(0) 
[   31.414232] scsi 0:0:0:0: enclosure level(0x0000), connector name(     )
[   31.414232] scsi 0:0:0:0: enclosure level(0x0000), connector name(     )
[   31.429608] scsi 0:0:1:0: Direct-Access     ATA      ST3000VM002-1ET1 SC11 PQ: 0 ANSI: 6
[   31.429608] scsi 0:0:1:0: Direct-Access     ATA      ST3000VM002-1ET1 SC11 PQ: 0 ANSI: 6
[   31.445818] scsi 0:0:1:0: SATA: handle(0x000a), sas_addr(0x4433221106000000), phy(6), device_name(0x5000c500737bb77b)
[   31.445818] scsi 0:0:1:0: SATA: handle(0x000a), sas_addr(0x4433221106000000), phy(6), device_name(0x5000c500737bb77b)
[   31.467068] scsi 0:0:1:0: enclosure logical id (0x5e868198a7528000), slot(6) 
[   31.467068] scsi 0:0:1:0: enclosure logical id (0x5e868198a7528000), slot(6) 
[   31.481351] scsi 0:0:1:0: enclosure level(0x0000), connector name(     )
[   31.481351] scsi 0:0:1:0: enclosure level(0x0000), connector name(     )
[   31.494812] scsi 0:0:1:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   31.494812] scsi 0:0:1:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   31.518955] scsi 0:0:2:0: Direct-Access     ATA      ST2000DM001-1CH1 CC43 PQ: 0 ANSI: 6
[   31.518955] scsi 0:0:2:0: Direct-Access     ATA      ST2000DM001-1CH1 CC43 PQ: 0 ANSI: 6
[   31.535166] scsi 0:0:2:0: SATA: handle(0x000b), sas_addr(0x4433221105000000), phy(5), device_name(0x5000c5004e8c2e66)
[   31.535166] scsi 0:0:2:0: SATA: handle(0x000b), sas_addr(0x4433221105000000), phy(5), device_name(0x5000c5004e8c2e66)
[   31.556416] scsi 0:0:2:0: enclosure logical id (0x5e868198a7528000), slot(5) 
[   31.556416] scsi 0:0:2:0: enclosure logical id (0x5e868198a7528000), slot(5) 
[   31.570699] scsi 0:0:2:0: enclosure level(0x0000), connector name(     )
[   31.570699] scsi 0:0:2:0: enclosure level(0x0000), connector name(     )
[   31.584158] scsi 0:0:2:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   31.584158] scsi 0:0:2:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   31.602753] scsi 0:0:3:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.602753] scsi 0:0:3:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.618963] scsi 0:0:3:0: SSP: handle(0x000c), sas_addr(0x5000cca04ec2cba5), phy(1), device_name(0x5000cca04ec2cba7)
[   31.618963] scsi 0:0:3:0: SSP: handle(0x000c), sas_addr(0x5000cca04ec2cba5), phy(1), device_name(0x5000cca04ec2cba7)
[   31.640038] scsi 0:0:3:0: enclosure logical id (0x5e868198a7528000), slot(1) 
[   31.640038] scsi 0:0:3:0: enclosure logical id (0x5e868198a7528000), slot(1) 
[   31.654321] scsi 0:0:3:0: enclosure level(0x0000), connector name(     )
[   31.654321] scsi 0:0:3:0: enclosure level(0x0000), connector name(     )
[   31.668844] scsi 0:0:4:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.668844] scsi 0:0:4:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.685055] scsi 0:0:4:0: SSP: handle(0x000d), sas_addr(0x5000cca04ec2ee7d), phy(2), device_name(0x5000cca04ec2ee7f)
[   31.685055] scsi 0:0:4:0: SSP: handle(0x000d), sas_addr(0x5000cca04ec2ee7d), phy(2), device_name(0x5000cca04ec2ee7f)
[   31.706130] scsi 0:0:4:0: enclosure logical id (0x5e868198a7528000), slot(2) 
[   31.706130] scsi 0:0:4:0: enclosure logical id (0x5e868198a7528000), slot(2) 
[   31.720413] scsi 0:0:4:0: enclosure level(0x0000), connector name(     )
[   31.720413] scsi 0:0:4:0: enclosure level(0x0000), connector name(     )
[   31.734938] scsi 0:0:5:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.734938] scsi 0:0:5:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.751152] scsi 0:0:5:0: SSP: handle(0x000e), sas_addr(0x5000cca04ec2f36d), phy(3), device_name(0x5000cca04ec2f36f)
[   31.751152] scsi 0:0:5:0: SSP: handle(0x000e), sas_addr(0x5000cca04ec2f36d), phy(3), device_name(0x5000cca04ec2f36f)
[   31.772227] scsi 0:0:5:0: enclosure logical id (0x5e868198a7528000), slot(3) 
[   31.772227] scsi 0:0:5:0: enclosure logical id (0x5e868198a7528000), slot(3) 
[   31.786510] scsi 0:0:5:0: enclosure level(0x0000), connector name(     )
[   31.786510] scsi 0:0:5:0: enclosure level(0x0000), connector name(     )
[   31.801032] scsi 0:0:6:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.801032] scsi 0:0:6:0: Direct-Access     HGST     HUSMM1640ASS204  C2D0 PQ: 0 ANSI: 6
[   31.817246] scsi 0:0:6:0: SSP: handle(0x000f), sas_addr(0x5000cca04ec29859), phy(7), device_name(0x5000cca04ec2985b)
[   31.817246] scsi 0:0:6:0: SSP: handle(0x000f), sas_addr(0x5000cca04ec29859), phy(7), device_name(0x5000cca04ec2985b)
[   31.838321] scsi 0:0:6:0: enclosure logical id (0x5e868198a7528000), slot(7) 
[   31.838321] scsi 0:0:6:0: enclosure logical id (0x5e868198a7528000), slot(7) 
[   31.852604] scsi 0:0:6:0: enclosure level(0x0000), connector name(     )
[   31.852604] scsi 0:0:6:0: enclosure level(0x0000), connector name(     )
[   31.868047] scsi 0:0:7:0: Direct-Access     ATA      ST1000NM0011     SN03 PQ: 0 ANSI: 6
[   31.868047] scsi 0:0:7:0: Direct-Access     ATA      ST1000NM0011     SN03 PQ: 0 ANSI: 6
[   31.884262] scsi 0:0:7:0: SATA: handle(0x0010), sas_addr(0x4433221104000000), phy(4), device_name(0x5000c5004f47d9f2)
[   31.884262] scsi 0:0:7:0: SATA: handle(0x0010), sas_addr(0x4433221104000000), phy(4), device_name(0x5000c5004f47d9f2)
[   31.905511] scsi 0:0:7:0: enclosure logical id (0x5e868198a7528000), slot(4) 
[   31.905511] scsi 0:0:7:0: enclosure logical id (0x5e868198a7528000), slot(4) 
[   31.919794] scsi 0:0:7:0: enclosure level(0x0000), connector name(     )
[   31.919794] scsi 0:0:7:0: enclosure level(0x0000), connector name(     )
[   31.933254] scsi 0:0:7:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   31.933254] scsi 0:0:7:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   31.952063] sd 0:0:3:0: [sdd] Enabling DIF Type 1 protection
[   31.952063] sd 0:0:3:0: [sdd] Enabling DIF Type 1 protection
[   31.952139] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   31.952139] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   31.963414] sd 0:0:4:0: [sde] Enabling DIF Type 1 protection
[   31.963414] sd 0:0:4:0: [sde] Enabling DIF Type 1 protection
[   31.963768] sd 0:0:0:0: [sda] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   31.963768] sd 0:0:0:0: [sda] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   31.963771] sd 0:0:0:0: [sda] 4096-byte physical blocks
[   31.963771] sd 0:0:0:0: [sda] 4096-byte physical blocks
[   31.963803] sd 0:0:3:0: [sdd] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   31.963803] sd 0:0:3:0: [sdd] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   31.963805] sd 0:0:3:0: [sdd] 4096-byte physical blocks
[   31.963805] sd 0:0:3:0: [sdd] 4096-byte physical blocks
[   31.963877] sd 0:0:5:0: [sdf] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   31.963877] sd 0:0:5:0: [sdf] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   31.963880] sd 0:0:5:0: [sdf] 4096-byte physical blocks
[   31.963880] sd 0:0:5:0: [sdf] 4096-byte physical blocks
[   31.963883] sd 0:0:0:0: [sda] Write Protect is off
[   31.963883] sd 0:0:0:0: [sda] Write Protect is off
[   31.963911] sd 0:0:6:0: [sdg] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   31.963911] sd 0:0:6:0: [sdg] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   31.963913] sd 0:0:6:0: [sdg] 4096-byte physical blocks
[   31.963913] sd 0:0:6:0: [sdg] 4096-byte physical blocks
[   31.963921] sd 0:0:3:0: [sdd] Write Protect is off
[   31.963921] sd 0:0:3:0: [sdd] Write Protect is off
[   31.963995] sd 0:0:5:0: [sdf] Write Protect is off
[   31.963995] sd 0:0:5:0: [sdf] Write Protect is off
[   31.964030] sd 0:0:6:0: [sdg] Write Protect is off
[   31.964030] sd 0:0:6:0: [sdg] Write Protect is off
[   31.964035] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   31.964035] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   31.964082] sd 0:0:3:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   31.964082] sd 0:0:3:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   31.964158] sd 0:0:5:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   31.964158] sd 0:0:5:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   31.964178] sd 0:0:6:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   31.964178] sd 0:0:6:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   31.965087] sd 0:0:2:0: [sdc] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[   31.965087] sd 0:0:2:0: [sdc] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[   31.965090] sd 0:0:2:0: [sdc] 4096-byte physical blocks
[   31.965090] sd 0:0:2:0: [sdc] 4096-byte physical blocks
[   31.965208] sd 0:0:1:0: [sdb] 5860533168 512-byte logical blocks: (3.00 TB/2.73 TiB)
[   31.965208] sd 0:0:1:0: [sdb] 5860533168 512-byte logical blocks: (3.00 TB/2.73 TiB)
[   31.965211] sd 0:0:1:0: [sdb] 4096-byte physical blocks
[   31.965211] sd 0:0:1:0: [sdb] 4096-byte physical blocks
[   31.965835] sd 0:0:7:0: [sdh] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[   31.965835] sd 0:0:7:0: [sdh] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[   31.968604]  sdd: sdd1
[   31.968604]  sdd: sdd1
[   31.971770] sd 0:0:5:0: [sdf] Attached SCSI disk
[   31.971770] sd 0:0:5:0: [sdf] Attached SCSI disk
[   31.971876] sd 0:0:0:0: [sda] Attached SCSI disk
[   31.971876] sd 0:0:0:0: [sda] Attached SCSI disk
[   31.971882] sd 0:0:6:0: [sdg] Attached SCSI disk
[   31.971882] sd 0:0:6:0: [sdg] Attached SCSI disk
[   31.971942] sd 0:0:3:0: [sdd] Attached SCSI disk
[   31.971942] sd 0:0:3:0: [sdd] Attached SCSI disk
[   31.974098] sd 0:0:1:0: Attached scsi generic sg1 type 0
[   31.974098] sd 0:0:1:0: Attached scsi generic sg1 type 0
[   31.985714] sd 0:0:4:0: [sde] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   31.985714] sd 0:0:4:0: [sde] 781422768 512-byte logical blocks: (400 GB/373 GiB)
[   32.000386] sd 0:0:2:0: Attached scsi generic sg2 type 0
[   32.000386] sd 0:0:2:0: Attached scsi generic sg2 type 0
[   32.010810] sd 0:0:4:0: [sde] 4096-byte physical blocks
[   32.010810] sd 0:0:4:0: [sde] 4096-byte physical blocks
[   32.025827] sd 0:0:3:0: Attached scsi generic sg3 type 0
[   32.025827] sd 0:0:3:0: Attached scsi generic sg3 type 0
[   32.036359] sd 0:0:4:0: [sde] Write Protect is off
[   32.036359] sd 0:0:4:0: [sde] Write Protect is off
[   32.051265] sd 0:0:4:0: Attached scsi generic sg4 type 0
[   32.051265] sd 0:0:4:0: Attached scsi generic sg4 type 0
[   32.065455] sd 0:0:1:0: [sdb] Write Protect is off
[   32.065455] sd 0:0:1:0: [sdb] Write Protect is off
[   32.066423] sd 0:0:1:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   32.066423] sd 0:0:1:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   32.071308] sd 0:0:5:0: Attached scsi generic sg5 type 0
[   32.071308] sd 0:0:5:0: Attached scsi generic sg5 type 0
[   32.086407] sd 0:0:4:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   32.086407] sd 0:0:4:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   32.096746] sd 0:0:6:0: Attached scsi generic sg6 type 0
[   32.096746] sd 0:0:6:0: Attached scsi generic sg6 type 0
[   32.113668] sd 0:0:4:0: [sde] Attached SCSI disk
[   32.113668] sd 0:0:4:0: [sde] Attached SCSI disk
[   32.115914] sd 0:0:7:0: Attached scsi generic sg7 type 0
[   32.115914] sd 0:0:7:0: Attached scsi generic sg7 type 0
[   32.247747] sd 0:0:1:0: [sdb] Attached SCSI disk
[   32.247747] sd 0:0:1:0: [sdb] Attached SCSI disk
[   32.261311] iommu: Adding device 0000:74:02.0 to group 1
[   32.261311] iommu: Adding device 0000:74:02.0 to group 1
[   32.407817] sd 0:0:2:0: [sdc] Write Protect is off
[   32.407817] sd 0:0:2:0: [sdc] Write Protect is off
[   32.414480] sd 0:0:7:0: [sdh] Write Protect is off
[   32.414480] sd 0:0:7:0: [sdh] Write Protect is off
[   32.415434] sd 0:0:7:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   32.415434] sd 0:0:7:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   32.426244] scsi host1: hisi_sas_v3_hw
[   32.426244] scsi host1: hisi_sas_v3_hw
[   32.529309] sd 0:0:2:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   32.529309] sd 0:0:2:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   33.332593] sd 0:0:7:0: [sdh] Attached SCSI disk
[   33.332593] sd 0:0:7:0: [sdh] Attached SCSI disk
[   33.471569] sd 0:0:2:0: [sdc] Attached SCSI disk
[   33.471569] sd 0:0:2:0: [sdc] Attached SCSI disk
[   34.653592] iommu: Adding device 0000:74:03.0 to group 2
[   34.653592] iommu: Adding device 0000:74:03.0 to group 2
[   34.664956] ahci 0000:74:03.0: SSS flag set, parallel bus scan disabled
[   34.664956] ahci 0000:74:03.0: SSS flag set, parallel bus scan disabled
[   34.678216] ahci 0000:74:03.0: AHCI 0001.0300 32 slots 2 ports 6 Gbps 0x3 impl SATA mode
[   34.678216] ahci 0000:74:03.0: AHCI 0001.0300 32 slots 2 ports 6 Gbps 0x3 impl SATA mode
[   34.694421] ahci 0000:74:03.0: flags: 64bit ncq sntf stag pm led clo only pmp fbs slum part ccc sxs boh 
[   34.694421] ahci 0000:74:03.0: flags: 64bit ncq sntf stag pm led clo only pmp fbs slum part ccc sxs boh 
[   34.713413] ahci 0000:74:03.0: both AHCI_HFLAG_MULTI_MSI flag set and custom irq handler implemented
[   34.713413] ahci 0000:74:03.0: both AHCI_HFLAG_MULTI_MSI flag set and custom irq handler implemented
[   34.732391] scsi host2: ahci
[   34.732391] scsi host2: ahci
[   34.738292] scsi host3: ahci
[   34.738292] scsi host3: ahci
[   34.744122] ata1: SATA max UDMA/133 abar m4096@0xa2008000 port 0xa2008100 irq 119
[   34.744122] ata1: SATA max UDMA/133 abar m4096@0xa2008000 port 0xa2008100 irq 119
[   34.759108] ata2: SATA max UDMA/133 abar m4096@0xa2008000 port 0xa2008180 irq 120
[   34.759108] ata2: SATA max UDMA/133 abar m4096@0xa2008000 port 0xa2008180 irq 120
[   34.775322] libphy: Fixed MDIO Bus: probed
[   34.775322] libphy: Fixed MDIO Bus: probed
[   34.783824] tun: Universal TUN/TAP device driver, 1.6
[   34.783824] tun: Universal TUN/TAP device driver, 1.6
[   34.794251] thunder_xcv, ver 1.0
[   34.794251] thunder_xcv, ver 1.0
[   34.800729] thunder_bgx, ver 1.0
[   34.800729] thunder_bgx, ver 1.0
[   34.807202] nicpf, ver 1.0
[   34.807202] nicpf, ver 1.0
[   34.812797] hclge is initializing
[   34.812797] hclge is initializing
[   34.819426] hclgevf is initializing
[   34.819426] hclgevf is initializing
[   34.826398] hns3: Hisilicon Ethernet Network Driver for Hip08 Family - version
[   34.826398] hns3: Hisilicon Ethernet Network Driver for Hip08 Family - version
[   34.840860] hns3: Copyright (c) 2017 Huawei Corporation.
[   34.840860] hns3: Copyright (c) 2017 Huawei Corporation.
[   34.851599] iommu: Adding device 0000:7d:00.0 to group 3
[   34.851599] iommu: Adding device 0000:7d:00.0 to group 3
[   34.862910] hns3 0000:7d:00.0: The firmware version is b0311019
[   34.862910] hns3 0000:7d:00.0: The firmware version is b0311019
[   34.882605] hclge driver initialization finished.
[   34.882605] hclge driver initialization finished.
[   34.960916] iommu: Adding device 0000:7d:00.1 to group 4
[   34.960916] iommu: Adding device 0000:7d:00.1 to group 4
[   34.972297] hns3 0000:7d:00.1: The firmware version is b0311019
[   34.972297] hns3 0000:7d:00.1: The firmware version is b0311019
[   34.991985] hclge driver initialization finished.
[   34.991985] hclge driver initialization finished.
[   35.085846] DMA-API: debugging out of memory - disabling
[   35.085846] DMA-API: debugging out of memory - disabling
[   35.087358] ata1: SATA link down (SStatus 0 SControl 300)
[   35.087358] ata1: SATA link down (SStatus 0 SControl 300)
[   35.100152] iommu: Adding device 0000:7d:00.2 to group 5
[   35.100152] iommu: Adding device 0000:7d:00.2 to group 5
[   35.118682] hns3 0000:7d:00.2: The firmware version is b0311019
[   35.118682] hns3 0000:7d:00.2: The firmware version is b0311019
[   35.133998] libphy: hisilicon MII bus: probed
[   35.133998] libphy: hisilicon MII bus: probed
[   35.143238] hclge driver initialization finished.
[   35.143238] hclge driver initialization finished.
[   35.229736] iommu: Adding device 0000:7d:00.3 to group 6
[   35.229736] iommu: Adding device 0000:7d:00.3 to group 6
[   35.241133] hns3 0000:7d:00.3: The firmware version is b0311019
[   35.241133] hns3 0000:7d:00.3: The firmware version is b0311019
[   35.254812] libphy: hisilicon MII bus: probed
[   35.254812] libphy: hisilicon MII bus: probed
[   35.263865] hclge driver initialization finished.
[   35.263865] hclge driver initialization finished.
[   35.349766] iommu: Adding device 0000:bd:00.0 to group 7
[   35.349766] iommu: Adding device 0000:bd:00.0 to group 7
[   35.362413] hns3 0000:bd:00.0: The firmware version is b0311019
[   35.362413] hns3 0000:bd:00.0: The firmware version is b0311019
[   35.385731] hclge driver initialization finished.
[   35.385731] hclge driver initialization finished.
[   35.419332] ata2: SATA link down (SStatus 0 SControl 300)
[   35.419332] ata2: SATA link down (SStatus 0 SControl 300)
[   35.428860] iommu: Adding device 0000:bd:00.1 to group 8
[   35.428860] iommu: Adding device 0000:bd:00.1 to group 8
[   35.441567] hns3 0000:bd:00.1: The firmware version is b0311019
[   35.441567] hns3 0000:bd:00.1: The firmware version is b0311019
[   35.464803] hclge driver initialization finished.
[   35.464803] hclge driver initialization finished.
[   35.510189] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
[   35.510189] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
[   35.521867] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[   35.521867] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[   35.533750] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[   35.533750] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[   35.547689] igb: Copyright (c) 2007-2014 Intel Corporation.
[   35.547689] igb: Copyright (c) 2007-2014 Intel Corporation.
[   35.558870] igbvf: Intel(R) Gigabit Virtual Function Network Driver - version 2.4.0-k
[   35.558870] igbvf: Intel(R) Gigabit Virtual Function Network Driver - version 2.4.0-k
[   35.574551] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[   35.574551] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[   35.586421] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k
[   35.586421] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k
[   35.601752] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[   35.601752] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[   35.613330] ixgbevf: Intel(R) 10 Gigabit PCI Express Virtual Function Network Driver - version 4.1.0-k
[   35.613330] ixgbevf: Intel(R) 10 Gigabit PCI Express Virtual Function Network Driver - version 4.1.0-k
[   35.631972] ixgbevf: Copyright (c) 2009 - 2015 Intel Corporation.
[   35.631972] ixgbevf: Copyright (c) 2009 - 2015 Intel Corporation.
[   35.644433] sky2: driver version 1.30
[   35.644433] sky2: driver version 1.30
[   35.652092] QLogic 1/10 GbE Converged/Intelligent Ethernet Driver v5.3.66
[   35.652092] QLogic 1/10 GbE Converged/Intelligent Ethernet Driver v5.3.66
[   35.665730] QLogic/NetXen Network Driver v4.0.82
[   35.665730] QLogic/NetXen Network Driver v4.0.82
[   35.674989] QLogic FastLinQ 4xxxx Core Module qed 8.33.0.20
[   35.674989] QLogic FastLinQ 4xxxx Core Module qed 8.33.0.20
[   35.686142] qede_init: QLogic FastLinQ 4xxxx Ethernet Driver qede 8.33.0.20
[   35.686142] 
[   35.686142] qede_init: QLogic FastLinQ 4xxxx Ethernet Driver qede 8.33.0.20
[   35.686142] 
[   35.703303] VFIO - User Level meta-driver version: 0.3
[   35.703303] VFIO - User Level meta-driver version: 0.3
[   35.714070] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[   35.714070] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[   35.727144] ehci-pci: EHCI PCI platform driver
[   35.727144] ehci-pci: EHCI PCI platform driver
[   35.736392] ehci-pci 0000:7a:01.0: EHCI Host Controller
[   35.736392] ehci-pci 0000:7a:01.0: EHCI Host Controller
[   35.746860] ehci-pci 0000:7a:01.0: new USB bus registered, assigned bus number 1
[   35.746860] ehci-pci 0000:7a:01.0: new USB bus registered, assigned bus number 1
[   35.761770] ehci-pci 0000:7a:01.0: irq 22, io mem 0x20c101000
[   35.761770] ehci-pci 0000:7a:01.0: irq 22, io mem 0x20c101000
[   35.789208] ehci-pci 0000:7a:01.0: USB 0.0 started, EHCI 1.00
[   35.789208] ehci-pci 0000:7a:01.0: USB 0.0 started, EHCI 1.00
[   35.800876] hub 1-0:1.0: USB hub found
[   35.800876] hub 1-0:1.0: USB hub found
[   35.808382] hub 1-0:1.0: 2 ports detected
[   35.808382] hub 1-0:1.0: 2 ports detected
[   35.816867] ehci-pci 0000:ba:01.0: EHCI Host Controller
[   35.816867] ehci-pci 0000:ba:01.0: EHCI Host Controller
[   35.827391] ehci-pci 0000:ba:01.0: new USB bus registered, assigned bus number 2
[   35.827391] ehci-pci 0000:ba:01.0: new USB bus registered, assigned bus number 2
[   35.842407] ehci-pci 0000:ba:01.0: irq 22, io mem 0x40020c101000
[   35.842407] ehci-pci 0000:ba:01.0: irq 22, io mem 0x40020c101000
[   35.869217] ehci-pci 0000:ba:01.0: USB 0.0 started, EHCI 1.00
[   35.869217] ehci-pci 0000:ba:01.0: USB 0.0 started, EHCI 1.00
[   35.881023] hub 2-0:1.0: USB hub found
[   35.881023] hub 2-0:1.0: USB hub found
[   35.888557] hub 2-0:1.0: 2 ports detected
[   35.888557] hub 2-0:1.0: 2 ports detected
[   35.896763] ehci-platform: EHCI generic platform driver
[   35.896763] ehci-platform: EHCI generic platform driver
[   35.907288] ehci-orion: EHCI orion driver
[   35.907288] ehci-orion: EHCI orion driver
[   35.915355] ehci-exynos: EHCI EXYNOS driver
[   35.915355] ehci-exynos: EHCI EXYNOS driver
[   35.923764] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[   35.923764] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[   35.936158] ohci-pci: OHCI PCI platform driver
[   35.936158] ohci-pci: OHCI PCI platform driver
[   35.945351] ohci-pci 0000:7a:00.0: OHCI PCI host controller
[   35.945351] ohci-pci 0000:7a:00.0: OHCI PCI host controller
[   35.956510] ohci-pci 0000:7a:00.0: new USB bus registered, assigned bus number 3
[   35.956510] ohci-pci 0000:7a:00.0: new USB bus registered, assigned bus number 3
[   35.971383] ohci-pci 0000:7a:00.0: irq 22, io mem 0x20c100000
[   35.971383] ohci-pci 0000:7a:00.0: irq 22, io mem 0x20c100000
[   36.045379] hub 3-0:1.0: USB hub found
[   36.045379] hub 3-0:1.0: USB hub found
[   36.052884] hub 3-0:1.0: 2 ports detected
[   36.052884] hub 3-0:1.0: 2 ports detected
[   36.061291] ohci-pci 0000:ba:00.0: OHCI PCI host controller
[   36.061291] ohci-pci 0000:ba:00.0: OHCI PCI host controller
[   36.072502] ohci-pci 0000:ba:00.0: new USB bus registered, assigned bus number 4
[   36.072502] ohci-pci 0000:ba:00.0: new USB bus registered, assigned bus number 4
[   36.087479] ohci-pci 0000:ba:00.0: irq 22, io mem 0x40020c100000
[   36.087479] ohci-pci 0000:ba:00.0: irq 22, io mem 0x40020c100000
[   36.161421] hub 4-0:1.0: USB hub found
[   36.161421] hub 4-0:1.0: USB hub found
[   36.168950] hub 4-0:1.0: 2 ports detected
[   36.168950] hub 4-0:1.0: 2 ports detected
[   36.177168] ohci-platform: OHCI generic platform driver
[   36.177168] ohci-platform: OHCI generic platform driver
[   36.187694] ohci-exynos: OHCI EXYNOS driver
[   36.187694] ohci-exynos: OHCI EXYNOS driver
[   36.196188] xhci_hcd 0000:7a:02.0: xHCI Host Controller
[   36.196188] xhci_hcd 0000:7a:02.0: xHCI Host Controller
[   36.206654] xhci_hcd 0000:7a:02.0: new USB bus registered, assigned bus number 5
[   36.206654] xhci_hcd 0000:7a:02.0: new USB bus registered, assigned bus number 5
[   36.221471] usb 1-1: new high-speed USB device number 2 using ehci-pci
[   36.221471] usb 1-1: new high-speed USB device number 2 using ehci-pci
[   36.234745] xhci_hcd 0000:7a:02.0: hcc params 0x0220f66d hci version 0x100 quirks 0x0000000000000010
[   36.234745] xhci_hcd 0000:7a:02.0: hcc params 0x0220f66d hci version 0x100 quirks 0x0000000000000010
[   36.253341] hub 5-0:1.0: USB hub found
[   36.253341] hub 5-0:1.0: USB hub found
[   36.260851] hub 5-0:1.0: 1 port detected
[   36.260851] hub 5-0:1.0: 1 port detected
[   36.268801] xhci_hcd 0000:7a:02.0: xHCI Host Controller
[   36.268801] xhci_hcd 0000:7a:02.0: xHCI Host Controller
[   36.279267] xhci_hcd 0000:7a:02.0: new USB bus registered, assigned bus number 6
[   36.279267] xhci_hcd 0000:7a:02.0: new USB bus registered, assigned bus number 6
[   36.294080] xhci_hcd 0000:7a:02.0: Host supports USB 3.0  SuperSpeed
[   36.294080] xhci_hcd 0000:7a:02.0: Host supports USB 3.0  SuperSpeed
[   36.306817] usb usb6: We don't know the algorithms for LPM for this host, disabling LPM.
[   36.306817] usb usb6: We don't know the algorithms for LPM for this host, disabling LPM.
[   36.323331] hub 6-0:1.0: USB hub found
[   36.323331] hub 6-0:1.0: USB hub found
[   36.330837] hub 6-0:1.0: 1 port detected
[   36.330837] hub 6-0:1.0: 1 port detected
[   36.338866] xhci_hcd 0000:ba:02.0: xHCI Host Controller
[   36.338866] xhci_hcd 0000:ba:02.0: xHCI Host Controller
[   36.349374] xhci_hcd 0000:ba:02.0: new USB bus registered, assigned bus number 7
[   36.349374] xhci_hcd 0000:ba:02.0: new USB bus registered, assigned bus number 7
[   36.364517] xhci_hcd 0000:ba:02.0: hcc params 0x0220f66d hci version 0x100 quirks 0x0000000000000010
[   36.364517] xhci_hcd 0000:ba:02.0: hcc params 0x0220f66d hci version 0x100 quirks 0x0000000000000010
[   36.383268] hub 7-0:1.0: USB hub found
[   36.383268] hub 7-0:1.0: USB hub found
[   36.390805] hub 7-0:1.0: 1 port detected
[   36.390805] hub 7-0:1.0: 1 port detected
[   36.398808] xhci_hcd 0000:ba:02.0: xHCI Host Controller
[   36.398808] xhci_hcd 0000:ba:02.0: xHCI Host Controller
[   36.409308] xhci_hcd 0000:ba:02.0: new USB bus registered, assigned bus number 8
[   36.409308] xhci_hcd 0000:ba:02.0: new USB bus registered, assigned bus number 8
[   36.409729] hub 1-1:1.0: USB hub found
[   36.409729] hub 1-1:1.0: USB hub found
[   36.424180] xhci_hcd 0000:ba:02.0: Host supports USB 3.0  SuperSpeed
[   36.424180] xhci_hcd 0000:ba:02.0: Host supports USB 3.0  SuperSpeed
[   36.444455] usb usb8: We don't know the algorithms for LPM for this host, disabling LPM.
[   36.444455] usb usb8: We don't know the algorithms for LPM for this host, disabling LPM.
[   36.444703] hub 1-1:1.0: 4 ports detected
[   36.444703] hub 1-1:1.0: 4 ports detected
[   36.460922] hub 8-0:1.0: USB hub found
[   36.460922] hub 8-0:1.0: USB hub found
[   36.476269] hub 8-0:1.0: 1 port detected
[   36.476269] hub 8-0:1.0: 1 port detected
[   36.484432] usbcore: registered new interface driver usb-storage
[   36.484432] usbcore: registered new interface driver usb-storage
[   36.537638] rtc-efi rtc-efi: rtc core: registered rtc-efi as rtc0
[   36.537638] rtc-efi rtc-efi: rtc core: registered rtc-efi as rtc0
[   36.550130] i2c /dev entries driver
[   36.550130] i2c /dev entries driver
[   36.558652] sdhci: Secure Digital Host Controller Interface driver
[   36.558652] sdhci: Secure Digital Host Controller Interface driver
[   36.571032] sdhci: Copyright(c) Pierre Ossman
[   36.571032] sdhci: Copyright(c) Pierre Ossman
[   36.579875] Synopsys Designware Multimedia Card Interface Driver
[   36.579875] Synopsys Designware Multimedia Card Interface Driver
[   36.592190] sdhci-pltfm: SDHCI platform and OF driver helper
[   36.592190] sdhci-pltfm: SDHCI platform and OF driver helper
[   36.597207] usb 1-2: new high-speed USB device number 3 using ehci-pci
[   36.597207] usb 1-2: new high-speed USB device number 3 using ehci-pci
[   36.617442] ledtrig-cpu: registered to indicate activity on CPUs
[   36.617442] ledtrig-cpu: registered to indicate activity on CPUs
[   36.630219] usbcore: registered new interface driver usbhid
[   36.630219] usbcore: registered new interface driver usbhid
[   36.641378] usbhid: USB HID core driver
[   36.641378] usbhid: USB HID core driver
[   36.650122] NET: Registered protocol family 10
[   36.650122] NET: Registered protocol family 10
[   36.659660] Segment Routing with IPv6
[   36.659660] Segment Routing with IPv6
[   36.667005] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[   36.667005] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[   36.679014] NET: Registered protocol family 17
[   36.679014] NET: Registered protocol family 17
[   36.688194] RPC: Registered rdma transport module.
[   36.688194] RPC: Registered rdma transport module.
[   36.697783] RPC: Registered rdma backchannel transport module.
[   36.697783] RPC: Registered rdma backchannel transport module.
[   36.709469] 9pnet: Installing 9P2000 support
[   36.709469] 9pnet: Installing 9P2000 support
[   36.718028] Key type dns_resolver registered
[   36.718028] Key type dns_resolver registered
[   36.726752] registered taskstats version 1
[   36.726752] registered taskstats version 1
[   36.734946] Loading compiled-in X.509 certificates
[   36.734946] Loading compiled-in X.509 certificates
[   36.745153] iommu: Adding device 0000:00:00.0 to group 9
[   36.745153] iommu: Adding device 0000:00:00.0 to group 9
[   36.756826] pcieport 0000:00:00.0: Signaling PME with IRQ 993
[   36.756826] pcieport 0000:00:00.0: Signaling PME with IRQ 993
[   36.768386] pcieport 0000:00:00.0: AER enabled with IRQ 994
[   36.768386] pcieport 0000:00:00.0: AER enabled with IRQ 994
[   36.779589] pciehp 0000:00:00.0:pcie004: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise- Interlock- NoCompl- LLActRep+
[   36.779589] pciehp 0000:00:00.0:pcie004: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise- Interlock- NoCompl- LLActRep+
[   36.804724] hub 1-2:1.0: USB hub found
[   36.804724] hub 1-2:1.0: USB hub found
[   36.812321] hub 1-2:1.0: 4 ports detected
[   36.812321] hub 1-2:1.0: 4 ports detected
[   37.105207] usb 1-2.1: new full-speed USB device number 4 using ehci-pci
[   37.105207] usb 1-2.1: new full-speed USB device number 4 using ehci-pci
[   38.821203] pciehp 0000:00:00.0:pcie004: Timeout on hotplug command 0x03c0 (issued 2020 msec ago)
[   38.821203] pciehp 0000:00:00.0:pcie004: Timeout on hotplug command 0x03c0 (issued 2020 msec ago)
[   40.857201] pciehp 0000:00:00.0:pcie004: Timeout on hotplug command 0x07c0 (issued 2020 msec ago)
[   40.857201] pciehp 0000:00:00.0:pcie004: Timeout on hotplug command 0x07c0 (issued 2020 msec ago)
[   40.875113] iommu: Adding device 0000:00:04.0 to group 10
[   40.875113] iommu: Adding device 0000:00:04.0 to group 10
[   40.886890] pcieport 0000:00:04.0: Signaling PME with IRQ 995
[   40.886890] pcieport 0000:00:04.0: Signaling PME with IRQ 995
[   40.898442] pcieport 0000:00:04.0: AER enabled with IRQ 996
[   40.898442] pcieport 0000:00:04.0: AER enabled with IRQ 996
[   40.909783] iommu: Adding device 0000:00:08.0 to group 11
[   40.909783] iommu: Adding device 0000:00:08.0 to group 11
[   40.921538] pcieport 0000:00:08.0: Signaling PME with IRQ 997
[   40.921538] pcieport 0000:00:08.0: Signaling PME with IRQ 997
[   40.933110] pcieport 0000:00:08.0: AER enabled with IRQ 998
[   40.933110] pcieport 0000:00:08.0: AER enabled with IRQ 998
[   40.944366] iommu: Adding device 0000:00:0c.0 to group 12
[   40.944366] iommu: Adding device 0000:00:0c.0 to group 12
[   40.956104] pcieport 0000:00:0c.0: Signaling PME with IRQ 999
[   40.956104] pcieport 0000:00:0c.0: Signaling PME with IRQ 999
[   40.967667] pcieport 0000:00:0c.0: AER enabled with IRQ 1000
[   40.967667] pcieport 0000:00:0c.0: AER enabled with IRQ 1000
[   40.979103] iommu: Adding device 0000:00:10.0 to group 13
[   40.979103] iommu: Adding device 0000:00:10.0 to group 13
[   40.990832] pcieport 0000:00:10.0: Signaling PME with IRQ 1001
[   40.990832] pcieport 0000:00:10.0: Signaling PME with IRQ 1001
[   41.002570] pcieport 0000:00:10.0: AER enabled with IRQ 1002
[   41.002570] pcieport 0000:00:10.0: AER enabled with IRQ 1002
[   41.014004] iommu: Adding device 0000:00:12.0 to group 14
[   41.014004] iommu: Adding device 0000:00:12.0 to group 14
[   41.025753] pcieport 0000:00:12.0: Signaling PME with IRQ 1003
[   41.025753] pcieport 0000:00:12.0: Signaling PME with IRQ 1003
[   41.037494] pcieport 0000:00:12.0: AER enabled with IRQ 1004
[   41.037494] pcieport 0000:00:12.0: AER enabled with IRQ 1004
[   41.048862] pciehp 0000:00:12.0:pcie004: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise- Interlock- NoCompl- LLActRep+
[   41.048862] pciehp 0000:00:12.0:pcie004: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise- Interlock- NoCompl- LLActRep+
[   42.346450] input: Keyboard/Mouse KVM 1.1.0 as /devices/pci0000:7a/0000:7a:01.0/usb1/1-2/1-2.1/1-2.1:1.0/0003:12D1:0003.0001/input/input1
[   42.346450] input: Keyboard/Mouse KVM 1.1.0 as /devices/pci0000:7a/0000:7a:01.0/usb1/1-2/1-2.1/1-2.1:1.0/0003:12D1:0003.0001/input/input1
[   42.429371] hid-generic 0003:12D1:0003.0001: input: USB HID v1.10 Keyboard [Keyboard/Mouse KVM 1.1.0] on usb-0000:7a:01.0-2.1/input0
[   42.429371] hid-generic 0003:12D1:0003.0001: input: USB HID v1.10 Keyboard [Keyboard/Mouse KVM 1.1.0] on usb-0000:7a:01.0-2.1/input0
[   42.454786] input: Keyboard/Mouse KVM 1.1.0 as /devices/pci0000:7a/0000:7a:01.0/usb1/1-2/1-2.1/1-2.1:1.1/0003:12D1:0003.0002/input/input2
[   42.454786] input: Keyboard/Mouse KVM 1.1.0 as /devices/pci0000:7a/0000:7a:01.0/usb1/1-2/1-2.1/1-2.1:1.1/0003:12D1:0003.0002/input/input2
[   42.479569] hid-generic 0003:12D1:0003.0002: input: USB HID v1.10 Mouse [Keyboard/Mouse KVM 1.1.0] on usb-0000:7a:01.0-2.1/input1
[   42.479569] hid-generic 0003:12D1:0003.0002: input: USB HID v1.10 Mouse [Keyboard/Mouse KVM 1.1.0] on usb-0000:7a:01.0-2.1/input1
[   43.093204] pciehp 0000:00:12.0:pcie004: Timeout on hotplug command 0x03c0 (issued 2020 msec ago)
[   43.093204] pciehp 0000:00:12.0:pcie004: Timeout on hotplug command 0x03c0 (issued 2020 msec ago)
[   45.129204] pciehp 0000:00:12.0:pcie004: Timeout on hotplug command 0x07c0 (issued 2020 msec ago)
[   45.129204] pciehp 0000:00:12.0:pcie004: Timeout on hotplug command 0x07c0 (issued 2020 msec ago)
[   45.147140] iommu: Adding device 0000:7c:00.0 to group 15
[   45.147140] iommu: Adding device 0000:7c:00.0 to group 15
[   45.158414] iommu: Adding device 0000:74:00.0 to group 16
[   45.158414] iommu: Adding device 0000:74:00.0 to group 16
[   45.169704] iommu: Adding device 0000:80:00.0 to group 17
[   45.169704] iommu: Adding device 0000:80:00.0 to group 17
[   45.181876] pcieport 0000:80:00.0: Signaling PME with IRQ 1005
[   45.181876] pcieport 0000:80:00.0: Signaling PME with IRQ 1005
[   45.193662] pcieport 0000:80:00.0: AER enabled with IRQ 1006
[   45.193662] pcieport 0000:80:00.0: AER enabled with IRQ 1006
[   45.205156] iommu: Adding device 0000:80:04.0 to group 18
[   45.205156] iommu: Adding device 0000:80:04.0 to group 18
[   45.217185] pcieport 0000:80:04.0: Signaling PME with IRQ 1007
[   45.217185] pcieport 0000:80:04.0: Signaling PME with IRQ 1007
[   45.228967] pcieport 0000:80:04.0: AER enabled with IRQ 1008
[   45.228967] pcieport 0000:80:04.0: AER enabled with IRQ 1008
[   45.240459] iommu: Adding device 0000:80:08.0 to group 19
[   45.240459] iommu: Adding device 0000:80:08.0 to group 19
[   45.252455] pcieport 0000:80:08.0: Signaling PME with IRQ 1009
[   45.252455] pcieport 0000:80:08.0: Signaling PME with IRQ 1009
[   45.264268] pcieport 0000:80:08.0: AER enabled with IRQ 1010
[   45.264268] pcieport 0000:80:08.0: AER enabled with IRQ 1010
[   45.275768] iommu: Adding device 0000:80:0c.0 to group 20
[   45.275768] iommu: Adding device 0000:80:0c.0 to group 20
[   45.287792] pcieport 0000:80:0c.0: Signaling PME with IRQ 1011
[   45.287792] pcieport 0000:80:0c.0: Signaling PME with IRQ 1011
[   45.299605] pcieport 0000:80:0c.0: AER enabled with IRQ 1012
[   45.299605] pcieport 0000:80:0c.0: AER enabled with IRQ 1012
[   45.311103] iommu: Adding device 0000:80:10.0 to group 21
[   45.311103] iommu: Adding device 0000:80:10.0 to group 21
[   45.323135] pcieport 0000:80:10.0: Signaling PME with IRQ 1013
[   45.323135] pcieport 0000:80:10.0: Signaling PME with IRQ 1013
[   45.334949] pcieport 0000:80:10.0: AER enabled with IRQ 1014
[   45.334949] pcieport 0000:80:10.0: AER enabled with IRQ 1014
[   45.346491] iommu: Adding device 0000:bc:00.0 to group 22
[   45.346491] iommu: Adding device 0000:bc:00.0 to group 22
[   45.357821] iommu: Adding device 0000:b4:00.0 to group 23
[   45.357821] iommu: Adding device 0000:b4:00.0 to group 23
[   45.389255] rtc-efi rtc-efi: setting system clock to 2015-07-04 18:14:27 UTC (1436033667)
[   45.389255] rtc-efi rtc-efi: setting system clock to 2015-07-04 18:14:27 UTC (1436033667)
[   45.407804] ALSA device list:
[   45.407804] ALSA device list:
[   45.413737]   No soundcards found.
[   45.413737]   No soundcards found.
[   45.421093] Freeing unused kernel memory: 1216K
[   45.421093] Freeing unused kernel memory: 1216K
[   45.430235] Run /init as init process
[   45.430235] Run /init as init process
root@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ dmesg | |   grep DIF
[   31.952063] sd 0:0:3:0: [sdd] Enabling DIF Type 1 protection
[   31.963414] sd 0:0:4:0: [sde] Enabling DIF Type 1 protection
root@(none)$ L lsscsi
[0:0:0:0]    disk    HGST     HUSMM1640ASS204  C2D0  /dev/sda 
[0:0:1:0]    disk    ATA      ST3000VM002-1ET1 SC11  /dev/sdb 
[0:0:2:0]    disk    ATA      ST2000DM001-1CH1 CC43  /dev/sdc 
[0:0:3:0]    disk    HGST     HUSMM1640ASS204  C2D0  /dev/sdd 
[0:0:4:0]    disk    HGST     HUSMM1640ASS204  C2D0  /dev/sde 
[0:0:5:0]    disk    HGST     HUSMM1640ASS204  C2D0  /dev/sdf 
[0:0:6:0]    disk    HGST     HUSMM1640ASS204  C2D0  /dev/sdg 
[0:0:7:0]    disk    ATA      ST1000NM0011     SN03  /dev/sdh 
root@(none)$ fisk      fdisk -l

Disk /dev/sda: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: s[   90.026732] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[   90.026732] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[   90.046091] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[   90.046091] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[   90.058285] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[   90.058285] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[   90.069087] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[   90.069087] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[   90.084763] print_req_error: protection error, dev sde, sector 8
[   90.084763] print_req_error: protection error, dev sde, sector 8
[   90.096787] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[   90.096787] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[   90.113515] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[   90.113515] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[   90.130411] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[   90.130411] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[   90.142605] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[   90.142605] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[   90.153405] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[   90.153405] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[   90.169081] print_req_error: protection error, dev sde, sector 8
[   90.169081] print_req_error: protection error, dev sde, sector 8
[   90.181101] Buffer I/O error on dev sde, logical block 1, async page read
[   90.181101] Buffer I/O error on dev sde, logical block 1, async page read
[   90.194692] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[   90.194692] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[   90.211417] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[   90.211417] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[   90.228312] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[   90.228312] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[   90.240505] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[   90.240505] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[   90.251306] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[   90.251306] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[   90.266981] print_req_error: protection error, dev sde, sector 8
[   90.266981] print_req_error: protection error, dev sde, sector 8
[   90.279000] Buffer I/O error on dev sde, logical block 1, async page read
[   90.279000] Buffer I/O error on dev sde, logical block 1, async page read
[ectors of 1 * 512 = 512 bytes
S   90.292590] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[   90.292590] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
ector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdf: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdd: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: dos
Disk identifier: 0xcaf57b5c

Device    Boot Start       End    Blocks  Id System
/dev/sdd1       2048 209717247 104857600  83 Linux


Disk /dev/sdg: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdb: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sde: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdh: 931.5 GiB, 1000204886016 bytes, 1953525168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk /dev/sdc: 1.8 TiB, 2000398934016 bytes, 3907029168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

root@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ fdisk -l

Disk /dev/sda: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units:[  155.890241] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  155.890241] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  155.909720] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[  155.909720] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[  155.921913] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[  155.921913] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[  155.932713] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  155.932713] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  155.948389] print_req_error: protection error, dev sde, sector 8
[  155.948389] print_req_error: protection error, dev sde, sector 8
[  155.960413] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  155.960413] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  155.977140] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  155.977140] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  155.994035] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[  155.994035] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[  156.006228] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[  156.006228] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[  156.017028] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  156.017028] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  156.032704] print_req_error: protection error, dev sde, sector 8
[  156.032704] print_req_error: protection error, dev sde, sector 8
[  156.044723] Buffer I/O error on dev sde, logical block 1, async page read
[  156.044723] Buffer I/O error on dev sde, logical block 1, async page read
[  156.058313] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  156.058313] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  156.075037] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  156.075037] sd 0:0:4:0: [sde] tag#2645 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  156.091933] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[  156.091933] sd 0:0:4:0: [sde] tag#2645 Sense Key : 0x5 [current] 
[  156.104126] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[  156.104126] sd 0:0:4:0: [sde] tag#2645 ASC=0x10 ASCQ=0x3 
[  156.114926] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  156.114926] sd 0:0:4:0: [sde] tag#2645 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  156.130602] print_req_error: protection error, dev sde, sector 8
[  156.130602] print_req_error: protection error, dev sde, sector 8
[  156.142621] Buffer I/O error on dev sde, logical block 1, async page read
[  156.142621] Buffer I/O error on dev sde, logical block 1, async page read
[ sectors of 1 * 512 = 512 bytes
  156.156211] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  156.156211] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)

Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdf: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdd: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: dos
Disk identifier: 0xcaf57b5c

Device    Boot Start       End    Blocks  Id System
/dev/sdd1       2048 209717247 104857600  83 Linux


Disk /dev/sdg: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdb: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sde: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdh: 931.5 GiB, 1000204886016 bytes, 1953525168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk /dev/sdc: 1.8 TiB, 2000398934016 bytes, 3907029168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

root@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ vi creat_fio_task.sh 
[?1049h#!/bin/bash###echo "$1_$2_$3_test" > $filenameecho "[global]rw=$2direct=1ramp_time=10ioengine=libaioiodepth=$3numjobs=1bs=$1;size=102400m;zero_buffers=1group_reporting=1group_reporting=1ioscheduler=noopcpus_allowed=24-47;gtod_reduce=1;iodepth_batch=2;iodepth_batch_complete=2- creat_fio_task.sh 1/49 2%- creat_fio_task.sh 1/49 2%'[' is not implemented- creat_fio_task.sh 1/49 2%- creat_fio_task.sh 1/49 2%'[' is not implemented- creat_fio_task.sh 1/49 2%- creat_fio_task.sh 2/49 4%- creat_fio_task.sh 3/49 6%- creat_fio_task.sh 4/49 8%- creat_fio_task.sh 5/49 10%- creat_fio_task.sh 6/49 12%- creat_fio_task.sh 7/49 14%- creat_fio_task.sh 8/49 16%- creat_fio_task.sh 9/49 18%- creat_fio_task.sh 10/49 20%- creat_fio_task.sh 11/49 22%- creat_fio_task.sh 12/49 24%- creat_fio_task.sh 13/49 26%- creat_fio_task.sh 14/49 28%- creat_fio_task.sh 15/49 30%- creat_fio_task.sh 16/49 32%- creat_fio_task.sh 17/49 34%- creat_fio_task.sh 18/49 36%- creat_fio_task.sh 19/49 38%- creat_fio_task.sh 20/49 40%- creat_fio_task.sh 21/49 42%- creat_fio_task.sh 22/49 44%- creat_fio_task.sh 22/49 44%'[' is not implemented- creat_fio_task.sh 21/49 42%- creat_fio_task.sh 22/49 44%- creat_fio_task.sh 23/49 46%          echo "$1_$2_$3_test" > $filenameecho "                           [global]rw=$2   direct=1ramp_time=10ioengine=libaiodepth=$3     numjobs=1 bs=$1         ;size=102400mzero_buffers=1group_reporting=1ioscheduler=noop cpus_allowed=24-47;gtod_reduce=1    iodepth_batch=2_complete=2runtime=180              - creat_fio_task.sh 24/49 48%- creat_fio_task.sh 25/49 51%echo "$1_$2_$3_test" > $filenameecho "[global]                         rw=$2 direct=1amp_time=10ioengine=libaioiodepth=$3  numjobs=1      bs=$1              ;size=102400m;zero_buffers=1group_reporting=1group_reporting=1ioscheduler=noop cpus_allowed=24-47;gtod_reduce=1  ;iodepth_batch=2  iodepth_batch_complete=2runtime=180     thread                  loops = 10 - creat_fio_task.sh 26/49 53%echo "                           [global]rw=$2   direct=1ramp_time=10ioengine=libaiodepth=$3     numjobs=1 bs=$1         ;size=102400mzero_buffers=1group_reporting=1ioscheduler=noop cpus_allowed=24-47;gtod_reduce=1    iodepth_batch=2_complete=2runtime=180              ;thread    loops = 10" > $1_$2_depth$3_fiotest- creat_fio_task.sh 27/49 55%- creat_fio_task.sh 27/49 55%'[' is not implemented- creat_fio_task.sh 26/49 53%- creat_fio_task.sh 26/49 53%'[' is not implemented- creat_fio_task.sh 26/49 53%- creat_fio_task.sh 26/49 53%'[' is not implemented- creat_fio_task.sh 26/49 53%- creat_fio_task.sh 26/49 53%'[' is not implemented- creat_fio_task.sh 25/49 51%- creat_fio_task.sh 25/49 51%'[' is not implemented- creat_fio_task.sh 24/49 48%- creat_fio_task.sh 24/49 48%'[' is not implemented- creat_fio_task.sh 23/49 46%- creat_fio_task.sh 23/49 46%'[' is not implemented- creat_fio_task.sh 22/49 44%- creat_fio_task.sh 22/49 44%'[' is not implemented- creat_fio_task.sh 21/49 42%- creat_fio_task.sh 21/49 42%'[' is not implemented- creat_fio_task.sh 20/49 40%- creat_fio_task.sh 21/49 42%- creat_fio_task.sh 21/49 42%'[' is not implemented- creat_fio_task.sh 20/49 40%- creat_fio_task.sh 20/49 40%'[' is not implemented- creat_fio_task.sh 19/49 38%I creat_fio_task.sh 19/49 38%;ioscheduler=noopI creat_fio_task.sh [Modified] 19/49 38%- creat_fio_task.sh [Modified] 19/49 38%:wq'creat_fio_task.sh' 49L, 860C1049lroot@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ zcat /proc/config.gz | grep MQ_DEFAULT
CONFIG_SCSI_MQ_DEFAULT=y
root@(none)$ 
root@(none)$ 
root@(none)$ ./CR  creat_fio_task.sh 4k rw 128
[  212.239707] sd 0:0:4:0: [sde] tag#3164 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.239707] sd 0:0:4:0: [sde] tag#3164 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.256603] sd 0:0:4:0: [sde] tag#3164 Sense Key : 0x5 [current] 
[  212.256603] sd 0:0:4:0: [sde] tag#3164 Sense Key : 0x5 [current] 
[  212.268797] sd 0:0:4:0: [sde] tag#3164 ASC=0x10 ASCQ=0x3 
[  212.268797] sd 0:0:4:0: [sde] tag#3164 ASC=0x10 ASCQ=0x3 
[  212.279597] sd 0:0:4:0: [sde] tag#3164 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  212.279597] sd 0:0:4:0: [sde] tag#3164 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  212.295273] print_req_error: protection error, dev sde, sector 8
[  212.295273] print_req_error: protection error, dev sde, sector 8
[  212.307297] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.307297] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.324024] sd 0:0:4:0: [sde] tag#3164 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.324024] sd 0:0:4:0: [sde] tag#3164 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.340920] sd 0:0:4:0: [sde] tag#3164 Sense Key : 0x5 [current] 
[  212.340920] sd 0:0:4:0: [sde] tag#3164 Sense Key : 0x5 [current] 
[  212.353113] sd 0:0:4:0: [sde] tag#3164 ASC=0x10 ASCQ=0x3 
[  212.353113] sd 0:0:4:0: [sde] tag#3164 ASC=0x10 ASCQ=0x3 
[  212.363914] sd 0:0:4:0: [sde] tag#3164 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  212.363914] sd 0:0:4:0: [sde] tag#3164 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  212.379590] print_req_error: protection error, dev sde, sector 8
[  212.379590] print_req_error: protection error, dev sde, sector 8
[  212.391609] Buffer I/O error on dev sde, logical block 1, async page read
[  212.391609] Buffer I/O error on dev sde, logical block 1, async page read
[  212.405198] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.405198] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.421923] sd 0:0:4:0: [sde] tag#3164 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.421923] sd 0:0:4:0: [sde] tag#3164 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.438818] sd 0:0:4:0: [sde] tag#3164 Sense Key : 0x5 [current] 
[  212.438818] sd 0:0:4:0: [sde] tag#3164 Sense Key : 0x5 [current] 
[  212.451011] sd 0:0:4:0: [sde] tag#3164 ASC=0x10 ASCQ=0x3 
[  212.451011] sd 0:0:4:0: [sde] tag#3164 ASC=0x10 ASCQ=0x3 
[  212.461812] sd 0:0:4:0: [sde] tag#3164 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  212.461812] sd 0:0:4:0: [sde] tag#3164 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  212.477487] print_req_error: protection error, dev sde, sector 8
[  212.477487] print_req_error: protection error, dev sde, sector 8
[  212.489506] Buffer I/O error on dev sde, logical block 1, async page read
[  212.489506] Buffer I/O error on dev sde, logical block 1, async page read
[  212.503095] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.503095] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
Creat 4k_rw_depth128_fiotest file sucessfully
[  212.557371] random: fio: uninitialized urandom read (64 bytes read)
[  212.557371] random: fio: uninitialized urandom read (64 bytes read)
job1: (g=0): rw=rw, bs=4K-4K/4K-4[K, ioengine=libaio, iodepth=128
  212.570019] random: fio: uninitialized urandom read (64 bytes read)
[  212.570019] random: fio: uninitialized urandom read (64 bytes read)
job1: (g=0): rw=rw, bs=4K-4K/4K-4[K, ioengine=libaio, iodepth=128
  212.588302] random: fio: uninitialized urandom read (64 bytes read)
[  212.588302] random: fio: uninitialized urandom read (64 bytes read)
job1: (g=0): rw=rw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=128
job1: (g=0): rw=rw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=128
job1: (g=0): rw=rw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=128
job1: (g=0): rw=rw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=128
job1: (g=0): rw=rw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=128
job1: (g=0): rw=rw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=128
fio 2.0.5
Starting 8 processes
[  212.816323] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.816323] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.816332] sd 0:0:3:0: [sdd] tag#2812 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.816332] sd 0:0:3:0: [sdd] tag#2812 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.833585] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.833585] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[ fio: io_u error on file /dev/sde: 212.849945] sd 0:0:3:0: [sdd] tag#2812 Sense Key : 0x5 [current] 
[  212.849945] sd 0:0:3:0: [sdd] tag#2812 Sense Key : 0x5 [current] 
[  212.866680] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.866680] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.866758] Invalid or incomplete multibyte or wide character
     read offset=28672, buflen=4096
 sd 0:0:4:0: [sde] tag#3592 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.866758] sd 0:0:4:0: [sde] tag#3592 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.866761] sd 0:0:4:0: [sde] tag#3592 Sense Key : 0x5 [current] 
[  212.866761] sd 0:0:4:0: [sde] tag#3592 Sense Key : 0x5 [current] 
[  212.866763] sd 0:0:4:0: [sde] tag#3592 ASC=0x10 ASCQ=0x3 
[  212.866763] sd 0:0:4:0: [sde] tag#3592 ASC=0x10 ASCQ=0x3 
[  212.866766] sd 0:0:4:0: [sde] tag#3592 CDB: opcode=0x28 28 20 00 00 00 38 00 00 08 00
[  212.866766] sd 0:0:4:0: [sde] tag#3592 CDB: opcode=0x28 28 20 00 00 00 38 00 00 08 00
[  212.866768] print_req_error: protection error, dev sde, sector 56
[  212.866768] print_req_error: protection error, dev sde, sector 56
[fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=32768, buflen=4096
  212.881721] sd 0:0:3:0: [sdd] tag#2812 ASC=0x10 ASCQ=0x3 
[  212.881721] sd 0:0:3:0: [sdd] tag#2812 ASC=0x10 ASCQ=0x3 
[  212.898545] sd 0:0:4:0: [sde] tag#3586 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[  212.898545] sd 0:0:4:0: [sde] tag#3586 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[  212.899109] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899109] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899112] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899112] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899115] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899115] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899117] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899117] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899124] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899124] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899145] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899145] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899150] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899150] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899167] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899167] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899172] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899172] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899174] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899174] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899181] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899181] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899184] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.899184] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.920893] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.920893] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.921487] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.921487] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.923063] sd 0:0:3:0: [sdd] tag#2812 CDB: opcode=0x28 28 20 00 00 00 40 00 00 08 00
[  212.923063] sd 0:0:3:0: [sdd] tag#2812 CDB: opcode=0x28 28 20 00 00 00 40 00 00 08 00
[  212.935256] sd 0:0:4:0: [sde] tag#3586 Sense Key : 0xb [current] 
[  212.935256] sd 0:0:4:0: [sde] tag#3586 Sense Key : 0xb [current] 
[  212.946054] print_req_error: protection error, dev sdd, sector 64
[  212.946054] print_req_error: protection error, dev sdd, sector 64
[  212.952459] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.952459] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.953005] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.953005] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.961729] sd 0:0:4:0: [sde] tag#3586 ASC=0x10 ASCQ=0x3 
[  212.961729] sd 0:0:4:0: [sde] tag#3586 ASC=0x10 ASCQ=0x3 
[  212.968534] random: crng init done
[  212.968534] random: crng init done
[  212.968536] random: 5 urandom warning(s) missed due to ratelimiting
[  212.968536] random: 5 urandom warning(s) missed due to ratelimiting
[  212.973973] sd 0:0:3:0: [sdd] tag#2805 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.973973] sd 0:0:3:0: [sdd] tag#2805 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  212.988708] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.988708] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.989373] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.989373] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  212.995310] sd 0:0:4:0: [sde] tag#3586 CDB: opcode=0x2a 2a 20 00 00 00 08 00 00 08 00
[  212.995310] sd 0:0:4:0: [sde] tag#3586 CDB: opcode=0x2a 2a 20 00 00 00 08 00 00 08 00
[  213.005795] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.005795] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.012205] sd 0:0:3:0: [sdd] tag#2805 Sense Key : 0x5 [current] 
[  213.012205] sd 0:0:3:0: [sdd] tag#2805 Sense Key : 0x5 [current] 
[  213.018362] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.018362] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.021289] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.021289] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.023082] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.023082] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.024709] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.024709] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.026520] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.026520] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.027166] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.027166] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.028806] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.028806] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.028924] print_req_error: protection error, dev sde, sector 8
[  213.028924] print_req_error: protection error, dev sde, sector 8
[  213.029495] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.029495] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.032351] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.032351] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.032902] mpt3sJobs: 8 (f=0)
as_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.032902] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.045644] sd 0:0:3:0: [sdd] tag#2805 ASC=0x10 ASCQ=0x3 
[  213.045644] sd 0:0:3:0: [sdd] tag#2805 ASC=0x10 ASCQ=0x3 
[  213.062469] sd 0:0:4:0: [sde] tag#3591 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[  213.062469] sd 0:0:4:0: [sde] tag#3591 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[  213.079084] sd 0:0:3:0: [sdd] tag#2805 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  213.079084] sd 0:0:3:0: [sdd] tag#2805 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  213.092221] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.092221] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.095154] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.095154] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.095803] sd 0:0:4:0: [sde] tag#3591 Sense Key : 0xb [current] 
[  213.095803] sd 0:0:4:0: [sde] tag#3591 Sense Key : 0xb [current] 
[  213.098077] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.098077] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.099793] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.099793] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.100398] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.100398] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.112523] print_req_error: protection error, dev sdd, sector 8
[  213.112523] print_req_error: protection error, dev sdd, sector 8
[  213.113015] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.113015] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.115780] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.115780] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.116390] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.116390] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.118079] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.118079] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.119794] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.119794] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[Jobs: 8 (f=0)
  213.121520] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.121520] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.122127] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.122127] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.129243] sd 0:0:4:0: [sde] tag#3591 ASC=0x10 ASCQ=0x3 
[  213.129243] sd 0:0:4:0: [sde] tag#3591 ASC=0x10 ASCQ=0x3 
[  213.145985] sd 0:0:3:0: [sdd] tag#2806 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[  213.145985] sd 0:0:3:0: [sdd] tag#2806 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[  213.162682] sd 0:0:4:0: [sde] tag#3591 CDB: opcode=0x2a 2a 20 00 00 00 30 00 00 08 00
[  213.162682] sd 0:0:4:0: [sde] tag#3591 CDB: opcode=0x2a 2a 20 00 00 00 30 00 00 08 00
[  213.169060] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.169060] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.179401] sd 0:0:3:0: [sdd] tag#2806 Sense Key : 0xb [current] 
[  213.179401] sd 0:0:3:0: [sdd] tag#2806 Sense Key : 0xb [current] 
[  213.189953] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.189953] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.190539] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.190539] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.193329] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.193329] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.194995] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.194995] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.196121] print_req_error: protection error, dev sde, sector 48
[  213.196121] print_req_error: protection error, dev sde, sector 48
[  213.198932] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.198932] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.199633] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.199633] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.200084] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.200084] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.200592] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.200592] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[Jobs: 8 (f=0)
  213.212842] sd 0:0:3:0: [sdd] tag#2806 ASC=0x10 ASCQ=0x3 
[  213.212842] sd 0:0:3:0: [sdd] tag#2806 ASC=0x10 ASCQ=0x3 
[  213.214932] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.214932] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.217979] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.217979] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.229580] sd 0:0:4:0: [sde] tag#3587 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  213.229580] sd 0:0:4:0: [sde] tag#3587 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  213.246281] sd 0:0:3:0: [sdd] tag#2806 CDB: opcode=0x2a 2a 20 00 00 00 10 00 00 08 00
[  213.246281] sd 0:0:3:0: [sdd] tag#2806 CDB: opcode=0x2a 2a 20 00 00 00 10 00 00 08 00
[  213.261956] sd 0:0:4:0: [sde] tag#3587 Sense Key : 0x5 [current] 
[  213.261956] sd 0:0:4:0: [sde] tag#3587 Sense Key : 0x5 [current] 
[  213.266724] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.266724] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.267281] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.267281] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.274148] print_req_error: protection error, dev sdd, sector 16
[  213.274148] print_req_error: protection error, dev sdd, sector 16
[  213.284628] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.284628] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.285399] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.285399] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.286340] sd 0:0:4:0: [sde] tag#3587 ASC=0x10 ASCQ=0x3 
[  213.286340] sd 0:0:4:0: [sde] tag#3587 ASC=0x10 ASCQ=0x3 
[  213.287121] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.287121] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.301954] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.301954] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.303088] print_req_error: protection error, dev sdd, sector 40
[  213.303088] print_req_error: protection error, dev sdd, sector 40
[  213.303593] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.303593] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.305271] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043bJobs: 8 (f=0)
)
[  213.305271] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.306958] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.306958] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.307553] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.307553] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.319781] sd 0:0:4:0: [sde] tag#3587 CDB: opcode=0x28 28 20 00 00 00 10 00 00 08 00
[  213.319781] sd 0:0:4:0: [sde] tag#3587 CDB: opcode=0x28 28 20 00 00 00 10 00 00 08 00
[  213.321825] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.321825] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.322531] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.322531] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.325304] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.325304] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.325858] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.325858] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.336814] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  213.336814] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.506427] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.506427] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.523750] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.523750] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.540531] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.540531] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.557255] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.557255] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.573978] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.573978] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.590701] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.590701] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.607430] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12)Jobs: 8 (f=0): [////////] [-.-% , sub_code(0x043b)
[  214.607430] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.626932] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.626932] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.643655] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.643655] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.660380] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.660380] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.677102] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.677102] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.693825] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.693825] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.710549] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.710549] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.727278] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.727278] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.744002] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.744002] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.760725] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.760725] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.777448] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.777448] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.794171] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.794171] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.810895] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.810895] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.827618] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.827618] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.844341] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.844341] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.861084] mpt3sas_cm0: log_info(0x31done] [0K/0K /s] [0 /0  iops] [e12043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.861084] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.880587] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.880587] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.897324] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.897324] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.914047] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.914047] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.930770] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.930770] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.947492] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.947492] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.964215] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.964215] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.980938] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.980938] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.997660] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  214.997660] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.014382] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.014382] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.031105] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.031105] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.047827] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.047827] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.064568] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.064568] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.081291] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.081291] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.098013] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.098013] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  21ta 03m:08s]
Jobs: 8 (f=0): [////5.114736] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.114736] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.134237] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.134237] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.150959] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.150959] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.167682] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.167682] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.184408] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.184408] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.201131] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.201131] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.217854] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.217854] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.234576] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.234576] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.251305] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.251305] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.268027] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.268027] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.284750] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.284750] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.301472] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.301472] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.318197] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.318197] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.334921] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.334921] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[////] [-.-% done] [0K/0K /s] [0 /0    215.351644] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.351644] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.371492] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.371492] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.388215] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.388215] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.404937] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.404937] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.421660] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  215.421660] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
iops] [eta 03m:07s]
Jobs: 8 (f=0): [////////] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:07s]
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=4096, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=8192, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=20480, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=24576, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=28672, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=36864, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=12288, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=16384, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=40960, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=45056, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=49152, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=53248, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=61440, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=65536, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=69632, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=73728, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=77824, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=94208, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=98304, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=102400, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=106496, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=81920, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=122880, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=126976, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=135168, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=114688, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=57344, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=131072, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=139264, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=143360, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=110592, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=86016, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=147456, buflen=4096
Jobs: 8 (f=0): [////////] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:07s]
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=159744, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     write offset=163840, buflen=4096
 on file /dev/sdefio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=188416, buflen=4096
fio: io_u error     write offset=4096, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=196608, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=24576, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=200704, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=8192, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=151552, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=20480, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=184320, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=12288, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=155648, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=32768, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=167936, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=16384, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=180224, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=36864, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=172032, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=40960, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=204800, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=45056, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=212992, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=53248, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=217088, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=57344, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=225280, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=49152, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=237568, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=61440, buflen=4096
 on file /dev/sdd: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=221184, buflen=4096
fio: io_u error on file /dev/sdd on file /dev/sdeJobs: 8 (f=0): [////////] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:06s]
: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=233472, buflen=4096
     write offset=65536, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=90112, buflen=4096
     write offset=69632, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=118784, buflen=4096
     write offset=73728, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=192512, buflen=4096
     write offset=81920, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=176128, buflen=4096
     read offset=86016, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=241664, buflen=4096
     read offset=77824, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=208896, buflen=4096
     write offset=90112, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=229376, buflen=4096
     write offset=94208, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=245760, buflen=4096
     write offset=106496, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=249856, buflen=4096
     write offset=110592, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=258048, buflen=4096
     read offset=98304, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=266240, buflen=4096
     write offset=114688, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=278528, buflen=4096
     read offset=118784, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=270336, buflen=4096
     read offset=122880, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd on file /dev/sde: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=262144, buflen=4096
     write offset=131072, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sddJobs: 8 (f=0): [////////] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:06s]
 on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=274432, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error on file /dev/sdd     write offset=135168, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=290816, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     write offset=143360, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=286720, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     write offset=147456, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=253952, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     write offset=151552, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=282624, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     read offset=139264, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=299008, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     write offset=159744, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=294912, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     read offset=163840, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=303104, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     write offset=172032, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=307200, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     read offset=155648, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=311296, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     read offset=126976, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=315392, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     read offset=167936, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=319488, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     write offset=176128, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=323584, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     read offset=180224, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=327680, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     write offset=184320, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=331776, buflen=4096
 on file /dev/sdefio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sdd     write offset=188416, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=339968, buflen=4096
fio: io_u error on file /dev/sddJobs: 8 (f=0): [////////] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:06s]
 on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=348160, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=192512, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=352256, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=200704, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=356352, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=196608, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=344064, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=204800, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=368640, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=208896, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=372736, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=225280, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=360448, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=217088, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=380928, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=212992, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=389120, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=229376, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=376832, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=233472, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=385024, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=237568, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=335872, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=245760, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=364544, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=253952, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=393216, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=249856, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=401408, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error on file /dev/sdd     read offset=241664, buflen=4096
: Invalid or incomplete multibyte or wide character
     write offset=405504, buflen=4096
fio: io_u errorJobs: 8 (f=0): [////////] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:05s]
fio: io_u error on file /dev/sde on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=258048, buflen=4096
     write offset=409600, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sde on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=262144, buflen=4096
     write offset=413696, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sde on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=274432, buflen=4096
     write offset=438272, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sde on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=282624, buflen=4096
     write offset=446464, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sde on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=270336, buflen=4096
     write offset=450560, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sde on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=278528, buflen=4096
     write offset=454656, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sde on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=286720, buflen=4096
     write offset=458752, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sde on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     read offset=266240, buflen=4096
     read offset=397312, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sde on file /dev/sdd: Invalid or incomplete multibyte or wide character
: Invalid or incomplete multibyte or wide character
     write offset=290816, buflen=4096
     read offset=421888, buflen=4096
fio: io_u errorfio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=417792, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
     read offset=434176, buflen=4096
fio: io_u error on file /dev/sdd: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=442368, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=319488, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=466944, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=323584, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=425984, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=294912, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=462848, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=303104, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=430080, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=299008, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
Jobs: 8 (f=0): [////////] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:05s]
 on file /dev/sde     read offset=471040, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=307200, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=475136, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=327680, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=479232, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=335872, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=487424, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=339968, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=491520, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=352256, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=499712, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=315392, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=503808, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=356352, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     write offset=507904, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=360448, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=483328, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=364544, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=512000, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=311296, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=495616, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=344064, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=516096, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     read offset=348160, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=520192, buflen=4096
: Invalid or incomplete multibyte or wide character
fio: io_u error     write offset=368640, buflen=4096
 on file /dev/sddfio: io_u error: Invalid or incomplete multibyte or wide character
 on file /dev/sde     read offset=524288, buflen=4096
: Invalid or incomplete multibyte or wide character
     write offset=372736, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=376832, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=380928, buflen=4096
fio: pid=3211, err=84/file:io_u.c:1282, func=io_u error, error=Invalid or incomplete multibyte or wide character
fio: io_u error on file /dev/sdeJobs: 8 (f=0): [////////] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:05s]
: Invalid or incomplete multibyte or wide character
     write offset=385024, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=397312, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=393216, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=401408, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=405504, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=425984, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=434176, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=438272, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=442368, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=446464, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=462848, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=487424, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=430080, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=409600, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=413696, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=417792, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=450560, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=495616, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=475136, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=458752, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=491520, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=479232, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=454656, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=503808, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=512000, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=507904, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=499712, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=466944, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=483328, buflen=4096
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     read offset=516096, buflen=4096
Jobs: 7 (f=0): [//_/////] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:04s]
fio: io_u error on file /dev/sde: Invalid or incomplete multibyte or wide character
     write offset=520192, buflen=4096
fio: pid=3214, err=84/file:io_u.c:1282, func=io_u error, error=Invalid or incomplete multibyte or wide character
Jobs: 6 (f=0): [//_//_//] [-.-% done] [26K/0K /s] [6 /0  iops] [eta 03m:03s]
Jobs: 6 (f=0): [//_//_//] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:02s] 
Jobs: 6 (f=0): [//_//_//] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:01s]
Jobs: 6 (f=0): [//_//_//] [-.-% done] [0K/0K /s] [0 /0  iops] [eta 03m:00s]
Jobs: 6 (f=6): [MM_MM_MM] [5.5% done] [179.9M/279.7M /s] [43.1K/68.3K iops] [eta 03m:08s]
Jobs: 6 (f=6): [MM_MM_MM] [6.0% done] [503.1M/853.2M /s] [123K/208K iops] [eta 03m:07s]  
Jobs: 6 (f=6): [MM_MM_MM] [6.5% done] [514.1M/787.5M /s] [126K/192K iops] [eta 03m:06s]
Jobs: 6 (f=6): [MM_MM_MM] [7.0% done] [845.1M/507.3M /s] [207K/124K iops] [eta 03m:05s]
Jobs: 6 (f=6): [MM_MM_MM] [7.5% done] [661.6M/660.6M /s] [162K/161K iops] [eta 03m:04s]
Jobs: 6 (f=6): [MM_MM_MM] [8.0% done] [652.5M/651.7M /s] [159K/159K iops] [eta 03m:03s]
Jobs: 6 (f=6): [MM_MM_MM] [8.5% done] [663.7M/664.9M /s] [162K/162K iops] [eta 03m:02s]
Jobs: 6 (f=6): [MM_MM_MM] [9.0% done] [652.1M/651.6M /s] [159K/159K iops] [eta 03m:01s]
Jobs: 6 (f=6): [MM_MM_MM] [9.5% done] [670.5M/671.6M /s] [164K/164K iops] [eta 03m:00s]
Jobs: 6 (f=6): [MM_MM_MM] [10.1% done] [670.3M/672.4M /s] [164K/164K iops] [eta 02m:59s]
Jobs: 6 (f=6): [MM_MM_MM] [10.6% done] [673.4M/675.2M /s] [164K/165K iops] [eta 02m:58s]
Jobs: 6 (f=6): [MM_MM_MM] [11.1% done] [671.9M/676.3M /s] [164K/165K iops] [eta 02m:57s]
Jobs: 6 (f=6): [MM_MM_MM] [11.6% done] [662.4M/661.7M /s] [162K/162K iops] [eta 02m:56s]
Jobs: 6 (f=6): [MM_MM_MM] [12.1% done] [666.4M/667.5M /s] [163K/163K iops] [eta 02m:55s]
Jobs: 6 (f=6): [MM_MM_MM] [12.6% done] [673.8M/674.7M /s] [164K/165K iops] [eta 02m:54s]
Jobs: 6 (f=6): [MM_MM_MM] [13.1% done] [676.9M/673.6M /s] [165K/164K iops] [eta 02m:53s]
Jobs: 6 (f=6): [MM_MM_MM] [13.6% done] [669.9M/671.8M /s] [164K/164K iops] [eta 02m:52s]
Jobs: 6 (f=6): [MM_MM_MM] [14.1% done] [668.5M/671.9M /s] [163K/164K iops] [eta 02m:51s]
Jobs: 6 (f=6): [MM_MM_MM] [14.6% done] [665.7M/667.5M /s] [163K/163K iops] [eta 02m:50s]
Jobs: 6 (f=6): [MM_MM_MM] [15.1% done] [666.1M/666.4M /s] [163K/163K iops] [eta 02m:49s]
Jobs: 6 (f=6): [MM_MM_MM] [15.6% done] [671.5M/670.6M /s] [164K/164K iops] [eta 02m:48s]
Jobs: 6 (f=6): [MM_MM_MM] [16.1% done] [683.6M/679.8M /s] [167K/166K iops] [eta 02m:47s]
Jobs: 6 (f=6): [MM_MM_MM] [16.6% done] [671.1M/675.3M /s] [164K/165K iops] [eta 02m:46s]
Jobs: 6 (f=6): [MM_MM_MM] [17.1% done] [668.3M/671.9M /s] [163K/164K iops] [eta 02m:45s]



Jobs: 6 (f=6): [MM_MM_MM] [17.6% done] [666.6M/665.6M /s] [163K/162K iops] [eta 02m:44s]
Jobs: 6 (f=6): [MM_MM_MM] [18.1% done] [673.2M/673.4M /s] [164K/164K iops] [eta 02m:43s]
Jobs: 6 (f=6): [MM_MM_MM] [18.6% done] [673.4M/672.4M /s] [164K/164K iops] [eta 02m:42s]
Jobs: 6 (f=6): [MM_MM_MM] [19.1% done] [663.7M/662.6M /s] [162K/162K iops] [eta 02m:41s]
Jobs: 6 (f=6): [MM_MM_MM] [19.6% done] [673.3M/675.5M /s] [164K/165K iops] [eta 02m:40s]
Jobs: 6 (f=6): [MM_MM_MM] [20.1% done] [671.4M/671.8M /s] [164K/164K iops] [eta 02m:39s]
Jobs: 6 (f=6): [MM_MM_MM] [20.6% done] [673.6M/676.3M /s] [164K/165K iops] [eta 02m:38s]
Jobs: 6 (f=6): [MM_MM_MM] [21.1% done] [679.2M/674.7M /s] [166K/165K iops] [eta 02m:37s]
Jobs: 6 (f=6): [MM_MM_MM] [21.6% done] [666.2M/670.6M /s] [163K/164K iops] [eta 02m:36s]
Jobs: 6 (f=6): [MM_MM_MM] [22.1% done] [668.4M/667.3M /s] [163K/163K iops] [eta 02m:35s]
Jobs: 6 (f=6): [MM_MM_MM] [22.6% done] [663.5M/663.2M /s] [162K/162K iops] [eta 02m:34s]
Jobs: 6 (f=6): [MM_MM_MM] [23.1% done] [661.8M/663.9M /s] [162K/162K iops] [eta 02m:33s]
Jobs: 6 (f=6): [MM_MM_MM] [23.6% done] [665.4M/670.3M /s] [162K/164K iops] [eta 02m:32s]
Jobs: 6 (f=6): [MM_MM_MM] [24.1% done] [676.5M/672.6M /s] [165K/164K iops] [eta 02m:31s]
Jobs: 6 (f=6): [MM_MM_MM] [24.6% done] [668.5M/670.7M /s] [163K/164K iops] [eta 02m:30s]
Jobs: 6 (f=6): [MM_MM_MM] [25.1% done] [667.3M/662.6M /s] [163K/162K iops] [eta 02m:29s]
Jobs: 6 (f=6): [MM_MM_MM] [25.6% done] [669.3M/673.3M /s] [163K/164K iops] [eta 02m:28s]
Jobs: 6 (f=6): [MM_MM_MM] [26.1% done] [661.2M/662.6M /s] [161K/162K iops] [eta 02m:27s]
Jobs: 6 (f=6): [MM_MM_MM] [26.6% done] [673.6M/673.5M /s] [164K/164K iops] [eta 02m:26s]
Jobs: 6 (f=6): [MM_MM_MM] [27.1% done] [675.2M/672.4M /s] [165K/164K iops] [eta 02m:25s]
Jobs: 6 (f=6): [MM_MM_MM] [27.6% done] [667.7M/672.7M /s] [163K/164K iops] [eta 02m:24s]
Jobs: 6 (f=6): [MM_MM_MM] [28.1% done] [661.6M/663.5M /s] [162K/162K iops] [eta 02m:23s]
Jobs: 6 (f=6): [MM_MM_MM] [28.6% done] [662.6M/660.6M /s] [162K/161K iops] [eta 02m:22s]
Jobs: 6 (f=6): [MM_MM_MM] [29.1% done] [662.5M/660.2M /s] [162K/161K iops] [eta 02m:21s]
Jobs: 6 (f=6): [MM_MM_MM] [29.6% done] [661.5M/663.7M /s] [161K/162K iops] [eta 02m:20s]
Jobs: 6 (f=6): [MM_MM_MM] [30.2% done] [671.4M/672.2M /s] [164K/164K iops] [eta 02m:19s]
Jobs: 6 (f=6): [MM_MM_MM] [30.7% done] [673.9M/674.6M /s] [165K/165K iops] [eta 02m:18s]
Jobs: 6 (f=6): [MM_MM_MM] [31.2% done] [670.2M/672.4M /s] [164K/164K iops] [eta 02m:17s]
Jobs: 6 (f=6): [MM_MM_MM] [31.7% done] [654.2M/654.5M /s] [160K/160K iops] [eta 02m:16s]
Jobs: 6 (f=6): [MM_MM_MM] [32.2% done] [662.1M/660.1M /s] [162K/161K iops] [eta 02m:15s]
Jobs: 6 (f=6): [MM_MM_MM] [32.7% done] [668.3M/668.3M /s] [163K/163K iops] [eta 02m:14s]
Jobs: 6 (f=6): [MM_MM_MM] [33.2% done] [667.4M/664.4M /s] [163K/162K iops] [eta 02m:13s]
Jobs: 6 (f=6): [MM_MM_MM] [33.7% done] [665.9M/664.6M /s] [163K/162K iops] [eta 02m:12s]
Jobs: 6 (f=6): [MM_MM_MM] [34.2% done] [667.7M/665.8M /s] [163K/162K iops] [eta 02m:11s]
Jobs: 6 (f=6): [MM_MM_MM] [34.7% done] [663.8M/663.5M /s] [162K/162K iops] [eta 02m:10s]
Jobs: 6 (f=6): [MM_MM_MM] [35.2% done] [658.8M/660.6M /s] [161K/161K iops] [eta 02m:09s]
Jobs: 6 (f=6): [MM_MM_MM] [35.7% done] [677.9M/675.2M /s] [165K/165K iops] [eta 02m:08s]
Jobs: 6 (f=6): [MM_MM_MM] [36.2% done] [670.2M/668.6M /s] [164K/163K iops] [eta 02m:07s]
Jobs: 6 (f=6): [MM_MM_MM] [36.7% done] [665.4M/664.6M /s] [162K/162K iops] [eta 02m:06s]
Jobs: 6 (f=6): [MM_MM_MM] [37.2% done] [670.6M/670.2M /s] [164K/164K iops] [eta 02m:05s]
Jobs: 6 (f=6): [MM_MM_MM] [37.7% done] [667.3M/668.4M /s] [163K/163K iops] [eta 02m:04s]
Jobs: 6 (f=6): [MM_MM_MM] [38.2% done] [674.6M/673.6M /s] [165K/164K iops] [eta 02m:03s]
Jobs: 6 (f=6): [MM_MM_MM] [38.7% done] [671.8M/672.5M /s] [164K/164K iops] [eta 02m:02s]
Jobs: 6 (f=6): [MM_MM_MM] [39.2% done] [669.8M/669.2M /s] [163K/163K iops] [eta 02m:01s]
Jobs: 6 (f=6): [MM_MM_MM] [39.7% done] [668.6M/666.7M /s] [163K/163K iops] [eta 02m:00s]
Jobs: 6 (f=6): [MM_MM_MM] [40.2% done] [674.8M/674.7M /s] [165K/165K iops] [eta 01m:59s]
Jobs: 6 (f=6): [MM_MM_MM] [40.7% done] [673.3M/672.4M /s] [164K/164K iops] [eta 01m:58s]
Jobs: 6 (f=6): [MM_MM_MM] [41.2% done] [673.4M/671.8M /s] [164K/164K iops] [eta 01m:57s]
Jobs: 6 (f=6): [MM_MM_MM] [41.7% done] [672.8M/671.8M /s] [164K/164K iops] [eta 01m:56s]
Jobs: 6 (f=6): [MM_MM_MM] [42.2% done] [677.9M/679.1M /s] [165K/166K iops] [eta 01m:55s]
Jobs: 6 (f=6): [MM_MM_MM] [42.7% done] [674.4M/671.2M /s] [165K/164K iops] [eta 01m:54s]
Jobs: 6 (f=6): [MM_MM_MM] [43.2% done] [670.2M/671.1M /s] [164K/164K iops] [eta 01m:53s]
Jobs: 6 (f=6): [MM_MM_MM] [43.7% done] [675.8M/674.3M /s] [165K/165K iops] [eta 01m:52s]
Jobs: 6 (f=6): [MM_MM_MM] [44.2% done] [672.9M/672.3M /s] [164K/164K iops] [eta 01m:51s]
Jobs: 6 (f=6): [MM_MM_MM] [44.7% done] [677.7M/674.9M /s] [165K/165K iops] [eta 01m:50s]
Jobs: 6 (f=6): [MM_MM_MM] [45.2% done] [676.9M/677.8M /s] [165K/165K iops] [eta 01m:49s]
Jobs: 6 (f=6): [MM_MM_MM] [45.7% done] [671.9M/672.2M /s] [164K/164K iops] [eta 01m:48s]
Jobs: 6 (f=6): [MM_MM_MM] [46.2% done] [672.1M/675.4M /s] [164K/165K iops] [eta 01m:47s]
Jobs: 6 (f=6): [MM_MM_MM] [46.7% done] [667.5M/672.6M /s] [163K/164K iops] [eta 01m:46s]
Jobs: 6 (f=6): [MM_MM_MM] [47.2% done] [677.9M/675.7M /s] [165K/165K iops] [eta 01m:45s]
Jobs: 6 (f=6): [MM_MM_MM] [47.7% done] [676.2M/677.3M /s] [165K/165K iops] [eta 01m:44s]
Jobs: 6 (f=6): [MM_MM_MM] [48.2% done] [674.6M/673.3M /s] [165K/164K iops] [eta 01m:43s]
Jobs: 6 (f=6): [MM_MM_MM] [48.7% done] [674.3M/676.4M /s] [165K/165K iops] [eta 01m:42s]
Jobs: 6 (f=6): [MM_MM_MM] [49.2% done] [677.9M/676.8M /s] [165K/165K iops] [eta 01m:41s]
Jobs: 6 (f=6): [MM_MM_MM] [49.7% done] [678.2M/678.7M /s] [166K/166K iops] [eta 01m:40s]
Jobs: 6 (f=6): [MM_MM_MM] [50.3% done] [675.9M/677.5M /s] [165K/165K iops] [eta 01m:39s]
Jobs: 6 (f=6): [MM_MM_MM] [50.8% done] [676.8M/672.9M /s] [165K/164K iops] [eta 01m:38s]
Jobs: 6 (f=6): [MM_MM_MM] [51.3% done] [674.5M/674.3M /s] [165K/165K iops] [eta 01m:37s]
Jobs: 6 (f=6): [MM_MM_MM] [51.8% done] [677.8M/673.8M /s] [165K/164K iops] [eta 01m:36s]
Jobs: 6 (f=6): [MM_MM_MM] [52.3% done] [678.2M/674.8M /s] [166K/165K iops] [eta 01m:35s]
Jobs: 6 (f=6): [MM_MM_MM] [52.8% done] [674.9M/679.2M /s] [165K/166K iops] [eta 01m:34s]
Jobs: 6 (f=6): [MM_MM_MM] [53.3% done] [673.7M/679.1M /s] [164K/166K iops] [eta 01m:33s]
Jobs: 6 (f=6): [MM_MM_MM] [53.8% done] [675.6M/675.1M /s] [165K/165K iops] [eta 01m:32s]
Jobs: 6 (f=6): [MM_MM_MM] [54.3% done] [673.9M/673.5M /s] [165K/164K iops] [eta 01m:31s]
Jobs: 6 (f=6): [MM_MM_MM] [54.8% done] [671.6M/672.2M /s] [164K/164K iops] [eta 01m:30s]
Jobs: 6 (f=6): [MM_MM_MM] [55.3% done] [678.4M/680.8M /s] [166K/166K iops] [eta 01m:29s]
Jobs: 6 (f=6): [MM_MM_MM] [55.8% done] [675.2M/672.1M /s] [165K/164K iops] [eta 01m:28s]
Jobs: 6 (f=6): [MM_MM_MM] [56.3% done] [669.8M/673.5M /s] [164K/164K iops] [eta 01m:27s]
Jobs: 6 (f=6): [MM_MM_MM] [56.8% done] [674.7M/674.7M /s] [165K/165K iops] [eta 01m:26s]
Jobs: 6 (f=6): [MM_MM_MM] [57.3% done] [676.5M/675.3M /s] [165K/165K iops] [eta 01m:25s]
Jobs: 6 (f=6): [MM_MM_MM] [57.8% done] [676.3M/673.1M /s] [165K/165K iops] [eta 01m:24s]
Jobs: 6 (f=6): [MM_MM_MM] [58.3% done] [673.1M/674.7M /s] [164K/165K iops] [eta 01m:23s]
Jobs: 6 (f=6): [MM_MM_MM] [58.8% done] [671.1M/673.9M /s] [164K/165K iops] [eta 01m:22s]


Jobs: 6 (f=6): [MM_MM_MM] [59.3% done] [676.6M/678.3M /s] [165K/166K iops] [eta 01m:21s]
Jobs: 6 (f=6): [MM_MM_MM] [59.8% done] [677.7M/674.3M /s] [165K/165K iops] [eta 01m:20s]
Jobs: 6 (f=6): [MM_MM_MM] [60.3% done] [673.1M/675.8M /s] [165K/165K iops] [eta 01m:19s]
Jobs: 6 (f=6): [MM_MM_MM] [60.8% done] [674.6M/672.5M /s] [165K/164K iops] [eta 01m:18s]
^X^C
fio: terminating on signal 2

job1: (groupid=0, jobs=8): err=84 (file:io_u.c:1282, func=io_u error, error=Invalid or incomplete multibyte or wide character): pid=3209
  read : io=70877MB, bw=653202KB/s, iops=163298 , runt=111111msec
    slat (usec): min=1 , max=5017 , avg= 7.34, stdev= 2.83
    clat (usec): min=67 , max=800775 , avg=2004.93, stdev=4127.91
     lat (usec): min=73 , max=800779 , avg=2012.40, stdev=4127.29
    clat percentiles (usec):
     |  1.00th=[  820],  5.00th=[  996], 10.00th=[ 1080], 20.00th=[ 1144],
     | 30.00th=[ 1176], 40.00th=[ 1192], 50.00th=[ 1224], 60.00th=[ 1240],
     | 70.00th=[ 1288], 80.00th=[ 1384], 90.00th=[ 2256], 95.00th=[ 3376],
     | 99.00th=[25216], 99.50th=[31360], 99.90th=[47872]
    bw (KB/s)  : min=    0, max=440064, per=16.78%, avg=109607.43, stdev=103341.43
  write: io=71256MB, bw=656696KB/s, iops=164171 , runt=111111msec
    slat (usec): min=2 , max=514615 , avg= 7.52, stdev=116.53
    clat (usec): min=457 , max=968125 , avg=2665.86, stdev=8697.90
     lat (usec): min=462 , max=968129 , avg=2673.49, stdev=8697.20
    clat percentiles (usec):
     |  1.00th=[  668],  5.00th=[  796], 10.00th=[  884], 20.00th=[  996],
     | 30.00th=[ 1048], 40.00th=[ 1080], 50.00th=[ 1112], 60.00th=[ 1128],
     | 70.00th=[ 1144], 80.00th=[ 1160], 90.00th=[ 1208], 95.00th=[ 1304],
     | 99.00th=[52992], 99.50th=[61696], 99.90th=[74240]
    bw (KB/s)  : min=    0, max=393544, per=16.70%, avg=109695.19, stdev=103406.88
    lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=1.78%, 1000=10.98%
    lat (msec) : 2=79.61%, 4=3.86%, 10=0.58%, 20=0.53%, 50=1.96%
    lat (msec) : 100=0.66%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
  cpu          : usr=8.62%, sys=33.58%, ctx=3348085, majf=0, minf=159
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=107.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
     issued    : total=r=18144287/w=18241228/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=70877MB, aggrb=653201KB/s, minb=668878KB/s, maxb=668878KB/s, mint=111111msec, maxt=111111msec
  WRITE: io=71256MB, aggrb=656696KB/s, minb=672457KB/s, maxb=672457KB/s, mint=111111msec, maxt=111111msec

Disk stats (read/write):
  sda: ios=6129085/6222470, merge=0/0, ticks=164568/138208, in_queue=3550704, util=99.69%
  sdf: ios=6194058/6302085, merge=0/0, ticks=180144/135148, in_queue=3772308, util=99.99%
  sdd: ios=71/58, merge=0/0, ticks=79788/66948, in_queue=146800, util=50.27%
  sdg: ios=6318580/6216859, merge=0/0, ticks=164916/135352, in_queue=2829772, util=100.00%
  sdb: ios=137838/136492, merge=135007/141124, ticks=2055092/5198204, in_queue=3870056, util=100.00%
  sde: ios=62/66, merge=0/0, ticks=83428/74100, in_queue=158004, util=49.08%
  sdh: ios=102894/100937, merge=103906/102672, ticks=1993104/5405680, in_queue=3870112, util=100.00%
  sdc: ios=133817/130331, merge=133807/133170, ticks=2310348/4985188, in_queue=3870040, util=100.00%
root@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ 
root@(none)$ fdisk -l

Disk /dev/sda: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 byte[  338.675002] scsi_io_completion_action: 242 callbacks suppressed
[  338.675002] scsi_io_completion_action: 242 callbacks suppressed
[  338.675007] sd 0:0:4:0: [sde] tag#965 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  338.675007] sd 0:0:4:0: [sde] tag#965 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  338.705631] sd 0:0:4:0: [sde] tag#965 Sense Key : 0x5 [current] 
[  338.705631] sd 0:0:4:0: [sde] tag#965 Sense Key : 0x5 [current] 
[  338.717650] sd 0:0:4:0: [sde] tag#965 ASC=0x10 ASCQ=0x3 
[  338.717650] sd 0:0:4:0: [sde] tag#965 ASC=0x10 ASCQ=0x3 
[  338.728277] sd 0:0:4:0: [sde] tag#965 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  338.728277] sd 0:0:4:0: [sde] tag#965 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  338.743779] print_req_error: 242 callbacks suppressed
[  338.743779] print_req_error: 242 callbacks suppressed
[  338.743780] print_req_error: protection error, dev sde, sector 8
[  338.743780] print_req_error: protection error, dev sde, sector 8
[  338.765907] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  338.765907] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  338.782632] sd 0:0:4:0: [sde] tag#965 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  338.782632] sd 0:0:4:0: [sde] tag#965 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  338.799353] sd 0:0:4:0: [sde] tag#965 Sense Key : 0x5 [current] 
[  338.799353] sd 0:0:4:0: [sde] tag#965 Sense Key : 0x5 [current] 
[  338.811372] sd 0:0:4:0: [sde] tag#965 ASC=0x10 ASCQ=0x3 
[  338.811372] sd 0:0:4:0: [sde] tag#965 ASC=0x10 ASCQ=0x3 
[  338.821999] sd 0:0:4:0: [sde] tag#965 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  338.821999] sd 0:0:4:0: [sde] tag#965 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  338.837500] print_req_error: protection error, dev sde, sector 8
[  338.837500] print_req_error: protection error, dev sde, sector 8
[  338.849520] Buffer I/O error on dev sde, logical block 1, async page read
[  338.849520] Buffer I/O error on dev sde, logical block 1, async page read
[  338.863110] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  338.863110] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  338.879835] sd 0:0:4:0: [sde] tag#965 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  338.879835] sd 0:0:4:0: [sde] tag#965 UNKNOWN(0x2003) Result: hostbyte=0x05 driverbyte=0x08
[  338.896556] sd 0:0:4:0: [sde] tag#965 Sense Key : 0x5 [current] 
[  338.896556] sd 0:0:4:0: [sde] tag#965 Sense Key : 0x5 [current] 
[  338.908575] sd 0:0:4:0: [sde] tag#965 ASC=0x10 ASCQ=0x3 
[  338.908575] sd 0:0:4:0: [sde] tag#965 ASC=0x10 ASCQ=0x3 
[  338.919201] sd 0:0:4:0: [sde] tag#965 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  338.919201] sd 0:0:4:0: [sde] tag#965 CDB: opcode=0x28 28 20 00 00 00 08 00 00 08 00
[  338.934702] print_req_error: protection error, dev sde, sector 8
[  338.934702] print_req_error: protection error, dev sde, sector 8
[  338.946721] Buffer I/O error on dev sde, logical block 1, async page read
[  338.946721] Buffer I/O error on dev sde, logical block 1, async page read
[s

Disk /dev/sdf: 372.6 GiB, 4  338.960311] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
[  338.960311] mpt3sas_cm0: log_info(0x3112043b): originator(PL), code(0x12), sub_code(0x043b)
00088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdd: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: dos
Disk identifier: 0xcaf57b5c

Device    Boot Start       End    Blocks  Id System
/dev/sdd1       2048 209717247 104857600  83 Linux


Disk /dev/sdg: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdb: 2.7 TiB, 3000592982016 bytes, 5860533168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sde: 372.6 GiB, 400088457216 bytes, 781422768 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Disk /dev/sdh: 931.5 GiB, 1000204886016 bytes, 1953525168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk /dev/sdc: 1.8 TiB, 2000398934016 bytes, 3907029168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

root@(none)$ 

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [SCSI Target Devel]     [Linux SCSI Target Infrastructure]     [Kernel Newbies]     [IDE]     [Security]     [Git]     [Netfilter]     [Bugtraq]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Linux ATA RAID]     [Linux IIO]     [Samba]     [Device Mapper]

  Powered by Linux