On 03/28/2018 05:26 PM, Ming Lei wrote:
> Hi Christian,
>
> On Wed, Mar 28, 2018 at 09:45:10AM +0200, Christian Borntraeger wrote:
>> FWIW, this patch does not fix the issue for me:
>>
>> ostname=? addr=? terminal=? res=success'
>> [ 21.454961] WARNING: CPU: 3 PID: 1882 at block/blk-mq.c:1410 __blk_mq_delay_run_hw_queue+0xbe/0xd8
>> [ 21.454968] Modules linked in: scsi_dh_rdac scsi_dh_emc scsi_dh_alua dm_mirror dm_region_hash dm_log dm_multipath dm_mod autofs4
>> [ 21.454984] CPU: 3 PID: 1882 Comm: dasdconf.sh Not tainted 4.16.0-rc7+ #26
>> [ 21.454987] Hardware name: IBM 2964 NC9 704 (LPAR)
>> [ 21.454990] Krnl PSW : 00000000c0131ea3 000000003ea2f7bf (__blk_mq_delay_run_hw_queue+0xbe/0xd8)
>> [ 21.454996] R:0 T:1 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:0 PM:0 RI:0 EA:3
>> [ 21.455005] Krnl GPRS: 0000013abb69a000 0000013a00000000 0000013ac6c0dc00 0000000000000001
>> [ 21.455008] 0000000000000000 0000013abb69a710 0000013a00000000 00000001b691fd98
>> [ 21.455011] 00000001b691fd98 0000013ace4775c8 0000000000000001 0000000000000000
>> [ 21.455014] 0000013ac6c0dc00 0000000000b47238 00000001b691fc08 00000001b691fbd0
>> [ 21.455032] Krnl Code: 000000000069c596: ebaff0a00004 lmg %r10,%r15,160(%r15)
>> 000000000069c59c: c0f4ffff7a5e brcl 15,68ba58
>> #000000000069c5a2: a7f40001 brc 15,69c5a4
>> >000000000069c5a6: e340f0c00004 lg %r4,192(%r15)
>> 000000000069c5ac: ebaff0a00004 lmg %r10,%r15,160(%r15)
>> 000000000069c5b2: 07f4 bcr 15,%r4
>> 000000000069c5b4: c0e5fffffeea brasl %r14,69c388
>> 000000000069c5ba: a7f4fff6 brc 15,69c5a6
>> [ 21.455067] Call Trace:
>> [ 21.455072] ([<00000001b691fd98>] 0x1b691fd98)
>> [ 21.455079] [<000000000069c692>] blk_mq_run_hw_queue+0xba/0x100
>> [ 21.455083] [<000000000069c740>] blk_mq_run_hw_queues+0x68/0x88
>> [ 21.455089] [<000000000069b956>] __blk_mq_complete_request+0x11e/0x1d8
>> [ 21.455091] [<000000000069ba9c>] blk_mq_complete_request+0x8c/0xc8
>> [ 21.455103] [<00000000008aa250>] dasd_block_tasklet+0x158/0x490
>> [ 21.455110] [<000000000014c742>] tasklet_hi_action+0x92/0x120
>> [ 21.455118] [<0000000000a7cfc0>] __do_softirq+0x120/0x348
>> [ 21.455122] [<000000000014c212>] irq_exit+0xba/0xd0
>> [ 21.455130] [<000000000010bf92>] do_IRQ+0x8a/0xb8
>> [ 21.455133] [<0000000000a7c298>] io_int_handler+0x130/0x298
>> [ 21.455136] Last Breaking-Event-Address:
>> [ 21.455138] [<000000000069c5a2>] __blk_mq_delay_run_hw_queue+0xba/0xd8
>> [ 21.455140] ---[ end trace be43f99a5d1e553e ]---
>> [ 21.510046] dasdconf.sh Warning: 0.0.241e is already online, not configuring
>
> Thinking about this issue further, I can't understand the root cause for
> this issue.
>
> After commit 20e4d813931961fe ("blk-mq: simplify queue mapping & schedule with
> each possisble CPU"), each hw queue should be mapped to at least one CPU, that
> means this issue shouldn't happen. Maybe blk_mq_map_queues() works wrong?
>
> Could you dump 'lscpu' and provide blk-mq debugfs for your DASD via the
> following command?
# lscpu
Architecture: s390x
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Big Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Thread(s) per core: 2
Core(s) per socket: 8
Socket(s) per book: 3
Book(s) per drawer: 2
Drawer(s): 4
NUMA node(s): 1
Vendor ID: IBM/S390
Machine type: 2964
CPU dynamic MHz: 5000
CPU static MHz: 5000
BogoMIPS: 20325.00
Hypervisor: PR/SM
Hypervisor vendor: IBM
Virtualization type: full
Dispatching mode: horizontal
L1d cache: 128K
L1i cache: 96K
L2d cache: 2048K
L2i cache: 2048K
L3 cache: 65536K
L4 cache: 491520K
NUMA node0 CPU(s): 0-15
Flags: esan3 zarch stfle msa ldisp eimm dfp edat etf3eh highgprs te vx sie
# lsdasd
Bus-ID Status Name Device Type BlkSz Size Blocks
==============================================================================
0.0.3f75 active dasda 94:0 ECKD 4096 21129MB 5409180
0.0.3f76 active dasdb 94:4 ECKD 4096 21129MB 5409180
0.0.3f77 active dasdc 94:8 ECKD 4096 21129MB 5409180
0.0.3f74 active dasdd 94:12 ECKD 4096 21129MB 5409180
>
> (cd /sys/kernel/debug/block/$DASD && find . -type f -exec grep -aH . {} \;)
see attachement:
dasda/range:4
dasda/capability:10
dasda/inflight: 0 0
dasda/ext_range:4
dasda/power/runtime_suspended_time:0
dasda/power/runtime_active_time:0
dasda/power/control:auto
dasda/power/runtime_status:unsupported
dasda/dev:94:0
dasda/hidden:0
dasda/ro:0
dasda/mq/7/nr_tags:1024
dasda/mq/7/nr_reserved_tags:0
dasda/mq/7/cpu_list:7
dasda/mq/15/nr_tags:1024
dasda/mq/15/nr_reserved_tags:0
dasda/mq/15/cpu_list:15
dasda/mq/5/nr_tags:1024
dasda/mq/5/nr_reserved_tags:0
dasda/mq/5/cpu_list:5
dasda/mq/13/nr_tags:1024
dasda/mq/13/nr_reserved_tags:0
dasda/mq/13/cpu_list:13
dasda/mq/3/nr_tags:1024
dasda/mq/3/nr_reserved_tags:0
dasda/mq/3/cpu_list:3
dasda/mq/11/nr_tags:1024
dasda/mq/11/nr_reserved_tags:0
dasda/mq/11/cpu_list:11
dasda/mq/1/nr_tags:1024
dasda/mq/1/nr_reserved_tags:0
dasda/mq/1/cpu_list:1
dasda/mq/8/nr_tags:1024
dasda/mq/8/nr_reserved_tags:0
dasda/mq/8/cpu_list:8
dasda/mq/6/nr_tags:1024
dasda/mq/6/nr_reserved_tags:0
dasda/mq/6/cpu_list:6
dasda/mq/14/nr_tags:1024
dasda/mq/14/nr_reserved_tags:0
dasda/mq/14/cpu_list:14
dasda/mq/4/nr_tags:1024
dasda/mq/4/nr_reserved_tags:0
dasda/mq/4/cpu_list:4
dasda/mq/12/nr_tags:1024
dasda/mq/12/nr_reserved_tags:0
dasda/mq/12/cpu_list:12
dasda/mq/2/nr_tags:1024
dasda/mq/2/nr_reserved_tags:0
dasda/mq/2/cpu_list:2
dasda/mq/10/nr_tags:1024
dasda/mq/10/nr_reserved_tags:0
dasda/mq/10/cpu_list:10
dasda/mq/0/nr_tags:1024
dasda/mq/0/nr_reserved_tags:0
dasda/mq/0/cpu_list:0, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260, 261, 262, 263, 264, 265, 266, 267, 268, 269, 270, 271, 272, 273, 274, 275, 276, 277, 278, 279, 280, 281
dasda/mq/9/nr_tags:1024
dasda/mq/9/nr_reserved_tags:0
dasda/mq/9/cpu_list:9
dasda/stat: 126 0 10728 60 0 0 0 0 0 10 20
dasda/removable:0
dasda/size:43273440
dasda/alignment_offset:0
dasda/queue/hw_sector_size:4096
dasda/queue/max_discard_segments:1
dasda/queue/max_segment_size:4096
dasda/queue/physical_block_size:4096
dasda/queue/discard_max_bytes:0
dasda/queue/rotational:0
dasda/queue/iosched/fifo_batch:16
dasda/queue/iosched/read_expire:500
dasda/queue/iosched/writes_starved:2
dasda/queue/iosched/write_expire:5000
dasda/queue/iosched/front_merges:1
dasda/queue/write_same_max_bytes:0
dasda/queue/zoned:none
dasda/queue/max_sectors_kb:760
dasda/queue/discard_zeroes_data:0
dasda/queue/read_ahead_kb:128
dasda/queue/discard_max_hw_bytes:0
dasda/queue/wbt_lat_usec:75000
dasda/queue/nomerges:0
dasda/queue/max_segments:65535
dasda/queue/rq_affinity:1
dasda/queue/iostats:1
dasda/queue/dax:0
dasda/queue/minimum_io_size:4096
dasda/queue/chunk_sectors:0
dasda/queue/io_poll:1
dasda/queue/write_zeroes_max_bytes:0
dasda/queue/max_hw_sectors_kb:760
dasda/queue/add_random:0
dasda/queue/optimal_io_size:0
dasda/queue/nr_requests:256
dasda/queue/scheduler:[mq-deadline] kyber none
dasda/queue/discard_granularity:0
dasda/queue/logical_block_size:4096
dasda/queue/io_poll_delay:-1
dasda/queue/max_integrity_segments:0
dasda/queue/write_cache:write through
dasda/trace/end_lba:disabled
dasda/trace/act_mask:disabled
dasda/trace/start_lba:disabled
dasda/trace/enable:0
dasda/trace/pid:disabled
dasda/uevent:MAJOR=94
dasda/uevent:MINOR=0
dasda/uevent:DEVNAME=dasda
dasda/uevent:DEVTYPE=disk
dasda/integrity/write_generate:0
dasda/integrity/device_is_integrity_capable:0
dasda/integrity/tag_size:0
dasda/integrity/read_verify:0
dasda/integrity/protection_interval_bytes:0
dasda/integrity/format:none
dasda/discard_alignment:0
dasda/dasda1/start:192
dasda/dasda1/inflight: 0 0
dasda/dasda1/power/runtime_suspended_time:0
dasda/dasda1/power/runtime_active_time:0
dasda/dasda1/power/control:auto
dasda/dasda1/power/runtime_status:unsupported
dasda/dasda1/dev:94:1
dasda/dasda1/ro:0
dasda/dasda1/partition:1
dasda/dasda1/stat: 115 0 10216 60 0 0 0 0 0 10 20
dasda/dasda1/size:43273248
dasda/dasda1/alignment_offset:0
dasda/dasda1/trace/end_lba:disabled
dasda/dasda1/trace/act_mask:disabled
dasda/dasda1/trace/start_lba:disabled
dasda/dasda1/trace/enable:0
dasda/dasda1/trace/pid:disabled
dasda/dasda1/uevent:MAJOR=94
dasda/dasda1/uevent:MINOR=1
dasda/dasda1/uevent:DEVNAME=dasda1
dasda/dasda1/uevent:DEVTYPE=partition
dasda/dasda1/uevent:PARTN=1
dasda/dasda1/discard_alignment:0
dasdb/range:4
dasdb/capability:10
dasdb/inflight: 0 0
dasdb/ext_range:4
dasdb/power/runtime_suspended_time:0
dasdb/power/runtime_active_time:0
dasdb/power/control:auto
dasdb/power/runtime_status:unsupported
dasdb/dev:94:4
dasdb/hidden:0
dasdb/ro:0
dasdb/mq/7/nr_tags:1024
dasdb/mq/7/nr_reserved_tags:0
dasdb/mq/7/cpu_list:7
dasdb/mq/15/nr_tags:1024
dasdb/mq/15/nr_reserved_tags:0
dasdb/mq/15/cpu_list:15
dasdb/mq/5/nr_tags:1024
dasdb/mq/5/nr_reserved_tags:0
dasdb/mq/5/cpu_list:5
dasdb/mq/13/nr_tags:1024
dasdb/mq/13/nr_reserved_tags:0
dasdb/mq/13/cpu_list:13
dasdb/mq/3/nr_tags:1024
dasdb/mq/3/nr_reserved_tags:0
dasdb/mq/3/cpu_list:3
dasdb/mq/11/nr_tags:1024
dasdb/mq/11/nr_reserved_tags:0
dasdb/mq/11/cpu_list:11
dasdb/mq/1/nr_tags:1024
dasdb/mq/1/nr_reserved_tags:0
dasdb/mq/1/cpu_list:1
dasdb/mq/8/nr_tags:1024
dasdb/mq/8/nr_reserved_tags:0
dasdb/mq/8/cpu_list:8
dasdb/mq/6/nr_tags:1024
dasdb/mq/6/nr_reserved_tags:0
dasdb/mq/6/cpu_list:6
dasdb/mq/14/nr_tags:1024
dasdb/mq/14/nr_reserved_tags:0
dasdb/mq/14/cpu_list:14
dasdb/mq/4/nr_tags:1024
dasdb/mq/4/nr_reserved_tags:0
dasdb/mq/4/cpu_list:4
dasdb/mq/12/nr_tags:1024
dasdb/mq/12/nr_reserved_tags:0
dasdb/mq/12/cpu_list:12
dasdb/mq/2/nr_tags:1024
dasdb/mq/2/nr_reserved_tags:0
dasdb/mq/2/cpu_list:2
dasdb/mq/10/nr_tags:1024
dasdb/mq/10/nr_reserved_tags:0
dasdb/mq/10/cpu_list:10
dasdb/mq/0/nr_tags:1024
dasdb/mq/0/nr_reserved_tags:0
dasdb/mq/0/cpu_list:0, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260, 261, 262, 263, 264, 265, 266, 267, 268, 269, 270, 271, 272, 273, 274, 275, 276, 277, 278, 279, 280, 281
dasdb/mq/9/nr_tags:1024
dasdb/mq/9/nr_reserved_tags:0
dasdb/mq/9/cpu_list:9
dasdb/stat: 129 0 10504 50 1 0 8 0 0 10 10
dasdb/removable:0
dasdb/size:43273440
dasdb/alignment_offset:0
dasdb/queue/hw_sector_size:4096
dasdb/queue/max_discard_segments:1
dasdb/queue/max_segment_size:4096
dasdb/queue/physical_block_size:4096
dasdb/queue/discard_max_bytes:0
dasdb/queue/rotational:0
dasdb/queue/iosched/fifo_batch:16
dasdb/queue/iosched/read_expire:500
dasdb/queue/iosched/writes_starved:2
dasdb/queue/iosched/write_expire:5000
dasdb/queue/iosched/front_merges:1
dasdb/queue/write_same_max_bytes:0
dasdb/queue/zoned:none
dasdb/queue/max_sectors_kb:760
dasdb/queue/discard_zeroes_data:0
dasdb/queue/read_ahead_kb:128
dasdb/queue/discard_max_hw_bytes:0
dasdb/queue/wbt_lat_usec:75000
dasdb/queue/nomerges:0
dasdb/queue/max_segments:65535
dasdb/queue/rq_affinity:1
dasdb/queue/iostats:1
dasdb/queue/dax:0
dasdb/queue/minimum_io_size:4096
dasdb/queue/chunk_sectors:0
dasdb/queue/io_poll:1
dasdb/queue/write_zeroes_max_bytes:0
dasdb/queue/max_hw_sectors_kb:760
dasdb/queue/add_random:0
dasdb/queue/optimal_io_size:0
dasdb/queue/nr_requests:256
dasdb/queue/scheduler:[mq-deadline] kyber none
dasdb/queue/discard_granularity:0
dasdb/queue/logical_block_size:4096
dasdb/queue/io_poll_delay:-1
dasdb/queue/max_integrity_segments:0
dasdb/queue/write_cache:write through
dasdb/trace/end_lba:disabled
dasdb/trace/act_mask:disabled
dasdb/trace/start_lba:disabled
dasdb/trace/enable:0
dasdb/trace/pid:disabled
dasdb/uevent:MAJOR=94
dasdb/uevent:MINOR=4
dasdb/uevent:DEVNAME=dasdb
dasdb/uevent:DEVTYPE=disk
dasdb/integrity/write_generate:0
dasdb/integrity/device_is_integrity_capable:0
dasdb/integrity/tag_size:0
dasdb/integrity/read_verify:0
dasdb/integrity/protection_interval_bytes:0
dasdb/integrity/format:none
dasdb/dasdb1/start:192
dasdb/dasdb1/inflight: 0 0
dasdb/dasdb1/power/runtime_suspended_time:0
dasdb/dasdb1/power/runtime_active_time:0
dasdb/dasdb1/power/control:auto
dasdb/dasdb1/power/runtime_status:unsupported
dasdb/dasdb1/dev:94:5
dasdb/dasdb1/ro:0
dasdb/dasdb1/partition:1
dasdb/dasdb1/stat: 118 0 9992 30 1 0 8 0 0 0 0
dasdb/dasdb1/size:43273248
dasdb/dasdb1/alignment_offset:0
dasdb/dasdb1/trace/end_lba:disabled
dasdb/dasdb1/trace/act_mask:disabled
dasdb/dasdb1/trace/start_lba:disabled
dasdb/dasdb1/trace/enable:0
dasdb/dasdb1/trace/pid:disabled
dasdb/dasdb1/uevent:MAJOR=94
dasdb/dasdb1/uevent:MINOR=5
dasdb/dasdb1/uevent:DEVNAME=dasdb1
dasdb/dasdb1/uevent:DEVTYPE=partition
dasdb/dasdb1/uevent:PARTN=1
dasdb/dasdb1/discard_alignment:0
dasdb/discard_alignment:0
dasdc/range:4
dasdc/capability:10
dasdc/inflight: 0 0
dasdc/ext_range:4
dasdc/power/runtime_suspended_time:0
dasdc/power/runtime_active_time:0
dasdc/power/control:auto
dasdc/power/runtime_status:unsupported
dasdc/dev:94:8
dasdc/hidden:0
dasdc/ro:0
dasdc/mq/7/nr_tags:1024
dasdc/mq/7/nr_reserved_tags:0
dasdc/mq/7/cpu_list:7
dasdc/mq/15/nr_tags:1024
dasdc/mq/15/nr_reserved_tags:0
dasdc/mq/15/cpu_list:15
dasdc/mq/5/nr_tags:1024
dasdc/mq/5/nr_reserved_tags:0
dasdc/mq/5/cpu_list:5
dasdc/mq/13/nr_tags:1024
dasdc/mq/13/nr_reserved_tags:0
dasdc/mq/13/cpu_list:13
dasdc/mq/3/nr_tags:1024
dasdc/mq/3/nr_reserved_tags:0
dasdc/mq/3/cpu_list:3
dasdc/mq/11/nr_tags:1024
dasdc/mq/11/nr_reserved_tags:0
dasdc/mq/11/cpu_list:11
dasdc/mq/1/nr_tags:1024
dasdc/mq/1/nr_reserved_tags:0
dasdc/mq/1/cpu_list:1
dasdc/mq/8/nr_tags:1024
dasdc/mq/8/nr_reserved_tags:0
dasdc/mq/8/cpu_list:8
dasdc/mq/6/nr_tags:1024
dasdc/mq/6/nr_reserved_tags:0
dasdc/mq/6/cpu_list:6
dasdc/mq/14/nr_tags:1024
dasdc/mq/14/nr_reserved_tags:0
dasdc/mq/14/cpu_list:14
dasdc/mq/4/nr_tags:1024
dasdc/mq/4/nr_reserved_tags:0
dasdc/mq/4/cpu_list:4
dasdc/mq/12/nr_tags:1024
dasdc/mq/12/nr_reserved_tags:0
dasdc/mq/12/cpu_list:12
dasdc/mq/2/nr_tags:1024
dasdc/mq/2/nr_reserved_tags:0
dasdc/mq/2/cpu_list:2
dasdc/mq/10/nr_tags:1024
dasdc/mq/10/nr_reserved_tags:0
dasdc/mq/10/cpu_list:10
dasdc/mq/0/nr_tags:1024
dasdc/mq/0/nr_reserved_tags:0
dasdc/mq/0/cpu_list:0, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260, 261, 262, 263, 264, 265, 266, 267, 268, 269, 270, 271, 272, 273, 274, 275, 276, 277, 278, 279, 280, 281
dasdc/mq/9/nr_tags:1024
dasdc/mq/9/nr_reserved_tags:0
dasdc/mq/9/cpu_list:9
dasdc/stat: 129 0 10504 50 1 0 8 0 0 0 0
dasdc/removable:0
dasdc/size:43273440
dasdc/alignment_offset:0
dasdc/queue/hw_sector_size:4096
dasdc/queue/max_discard_segments:1
dasdc/queue/max_segment_size:4096
dasdc/queue/physical_block_size:4096
dasdc/queue/discard_max_bytes:0
dasdc/queue/rotational:0
dasdc/queue/iosched/fifo_batch:16
dasdc/queue/iosched/read_expire:500
dasdc/queue/iosched/writes_starved:2
dasdc/queue/iosched/write_expire:5000
dasdc/queue/iosched/front_merges:1
dasdc/queue/write_same_max_bytes:0
dasdc/queue/zoned:none
dasdc/queue/max_sectors_kb:760
dasdc/queue/discard_zeroes_data:0
dasdc/queue/read_ahead_kb:128
dasdc/queue/discard_max_hw_bytes:0
dasdc/queue/wbt_lat_usec:75000
dasdc/queue/nomerges:0
dasdc/queue/max_segments:65535
dasdc/queue/rq_affinity:1
dasdc/queue/iostats:1
dasdc/queue/dax:0
dasdc/queue/minimum_io_size:4096
dasdc/queue/chunk_sectors:0
dasdc/queue/io_poll:1
dasdc/queue/write_zeroes_max_bytes:0
dasdc/queue/max_hw_sectors_kb:760
dasdc/queue/add_random:0
dasdc/queue/optimal_io_size:0
dasdc/queue/nr_requests:256
dasdc/queue/scheduler:[mq-deadline] kyber none
dasdc/queue/discard_granularity:0
dasdc/queue/logical_block_size:4096
dasdc/queue/io_poll_delay:-1
dasdc/queue/max_integrity_segments:0
dasdc/queue/write_cache:write through
dasdc/trace/end_lba:disabled
dasdc/trace/act_mask:disabled
dasdc/trace/start_lba:disabled
dasdc/trace/enable:0
dasdc/trace/pid:disabled
dasdc/uevent:MAJOR=94
dasdc/uevent:MINOR=8
dasdc/uevent:DEVNAME=dasdc
dasdc/uevent:DEVTYPE=disk
dasdc/dasdc1/start:192
dasdc/dasdc1/inflight: 0 0
dasdc/dasdc1/power/runtime_suspended_time:0
dasdc/dasdc1/power/runtime_active_time:0
dasdc/dasdc1/power/control:auto
dasdc/dasdc1/power/runtime_status:unsupported
dasdc/dasdc1/dev:94:9
dasdc/dasdc1/ro:0
dasdc/dasdc1/partition:1
dasdc/dasdc1/stat: 118 0 9992 50 1 0 8 0 0 0 0
dasdc/dasdc1/size:43273248
dasdc/dasdc1/alignment_offset:0
dasdc/dasdc1/trace/end_lba:disabled
dasdc/dasdc1/trace/act_mask:disabled
dasdc/dasdc1/trace/start_lba:disabled
dasdc/dasdc1/trace/enable:0
dasdc/dasdc1/trace/pid:disabled
dasdc/dasdc1/uevent:MAJOR=94
dasdc/dasdc1/uevent:MINOR=9
dasdc/dasdc1/uevent:DEVNAME=dasdc1
dasdc/dasdc1/uevent:DEVTYPE=partition
dasdc/dasdc1/uevent:PARTN=1
dasdc/dasdc1/discard_alignment:0
dasdc/integrity/write_generate:0
dasdc/integrity/device_is_integrity_capable:0
dasdc/integrity/tag_size:0
dasdc/integrity/read_verify:0
dasdc/integrity/protection_interval_bytes:0
dasdc/integrity/format:none
dasdc/discard_alignment:0
dasdd/range:4
dasdd/capability:10
dasdd/inflight: 0 0
dasdd/ext_range:4
dasdd/power/runtime_suspended_time:0
dasdd/power/runtime_active_time:0
dasdd/power/control:auto
dasdd/power/runtime_status:unsupported
dasdd/dev:94:12
dasdd/hidden:0
dasdd/ro:0
dasdd/mq/7/nr_tags:1024
dasdd/mq/7/nr_reserved_tags:0
dasdd/mq/7/cpu_list:7
dasdd/mq/15/nr_tags:1024
dasdd/mq/15/nr_reserved_tags:0
dasdd/mq/15/cpu_list:15
dasdd/mq/5/nr_tags:1024
dasdd/mq/5/nr_reserved_tags:0
dasdd/mq/5/cpu_list:5
dasdd/mq/13/nr_tags:1024
dasdd/mq/13/nr_reserved_tags:0
dasdd/mq/13/cpu_list:13
dasdd/mq/3/nr_tags:1024
dasdd/mq/3/nr_reserved_tags:0
dasdd/mq/3/cpu_list:3
dasdd/mq/11/nr_tags:1024
dasdd/mq/11/nr_reserved_tags:0
dasdd/mq/11/cpu_list:11
dasdd/mq/1/nr_tags:1024
dasdd/mq/1/nr_reserved_tags:0
dasdd/mq/1/cpu_list:1
dasdd/mq/8/nr_tags:1024
dasdd/mq/8/nr_reserved_tags:0
dasdd/mq/8/cpu_list:8
dasdd/mq/6/nr_tags:1024
dasdd/mq/6/nr_reserved_tags:0
dasdd/mq/6/cpu_list:6
dasdd/mq/14/nr_tags:1024
dasdd/mq/14/nr_reserved_tags:0
dasdd/mq/14/cpu_list:14
dasdd/mq/4/nr_tags:1024
dasdd/mq/4/nr_reserved_tags:0
dasdd/mq/4/cpu_list:4
dasdd/mq/12/nr_tags:1024
dasdd/mq/12/nr_reserved_tags:0
dasdd/mq/12/cpu_list:12
dasdd/mq/2/nr_tags:1024
dasdd/mq/2/nr_reserved_tags:0
dasdd/mq/2/cpu_list:2
dasdd/mq/10/nr_tags:1024
dasdd/mq/10/nr_reserved_tags:0
dasdd/mq/10/cpu_list:10
dasdd/mq/0/nr_tags:1024
dasdd/mq/0/nr_reserved_tags:0
dasdd/mq/0/cpu_list:0, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260, 261, 262, 263, 264, 265, 266, 267, 268, 269, 270, 271, 272, 273, 274, 275, 276, 277, 278, 279, 280, 281
dasdd/mq/9/nr_tags:1024
dasdd/mq/9/nr_reserved_tags:0
dasdd/mq/9/cpu_list:9
dasdd/stat: 6591 1270 412856 4720 24963 7143 743920 30530 0 3670 8400
dasdd/removable:0
dasdd/size:43273440
dasdd/alignment_offset:0
dasdd/queue/hw_sector_size:4096
dasdd/queue/max_discard_segments:1
dasdd/queue/max_segment_size:4096
dasdd/queue/physical_block_size:4096
dasdd/queue/discard_max_bytes:0
dasdd/queue/rotational:0
dasdd/queue/iosched/fifo_batch:16
dasdd/queue/iosched/read_expire:500
dasdd/queue/iosched/writes_starved:2
dasdd/queue/iosched/write_expire:5000
dasdd/queue/iosched/front_merges:1
dasdd/queue/write_same_max_bytes:0
dasdd/queue/zoned:none
dasdd/queue/max_sectors_kb:760
dasdd/queue/discard_zeroes_data:0
dasdd/queue/read_ahead_kb:128
dasdd/queue/discard_max_hw_bytes:0
dasdd/queue/wbt_lat_usec:75000
dasdd/queue/nomerges:0
dasdd/queue/max_segments:65535
dasdd/queue/rq_affinity:1
dasdd/queue/iostats:1
dasdd/queue/dax:0
dasdd/queue/minimum_io_size:4096
dasdd/queue/chunk_sectors:0
dasdd/queue/io_poll:1
dasdd/queue/write_zeroes_max_bytes:0
dasdd/queue/max_hw_sectors_kb:760
dasdd/queue/add_random:0
dasdd/queue/optimal_io_size:0
dasdd/queue/nr_requests:256
dasdd/queue/scheduler:[mq-deadline] kyber none
dasdd/queue/discard_granularity:0
dasdd/queue/logical_block_size:4096
dasdd/queue/io_poll_delay:-1
dasdd/queue/max_integrity_segments:0
dasdd/queue/write_cache:write through
dasdd/trace/end_lba:disabled
dasdd/trace/act_mask:disabled
dasdd/trace/start_lba:disabled
dasdd/trace/enable:0
dasdd/trace/pid:disabled
dasdd/uevent:MAJOR=94
dasdd/uevent:MINOR=12
dasdd/uevent:DEVNAME=dasdd
dasdd/uevent:DEVTYPE=disk
dasdd/dasdd1/start:192
dasdd/dasdd1/inflight: 0 0
dasdd/dasdd1/power/runtime_suspended_time:0
dasdd/dasdd1/power/runtime_active_time:0
dasdd/dasdd1/power/control:auto
dasdd/dasdd1/power/runtime_status:unsupported
dasdd/dasdd1/dev:94:13
dasdd/dasdd1/ro:0
dasdd/dasdd1/partition:1
dasdd/dasdd1/stat: 6580 1270 412344 4720 24963 7143 743920 30530 0 3670 8400
dasdd/dasdd1/size:43273248
dasdd/dasdd1/alignment_offset:0
dasdd/dasdd1/trace/end_lba:disabled
dasdd/dasdd1/trace/act_mask:disabled
dasdd/dasdd1/trace/start_lba:disabled
dasdd/dasdd1/trace/enable:0
dasdd/dasdd1/trace/pid:disabled
dasdd/dasdd1/uevent:MAJOR=94
dasdd/dasdd1/uevent:MINOR=13
dasdd/dasdd1/uevent:DEVNAME=dasdd1
dasdd/dasdd1/uevent:DEVTYPE=partition
dasdd/dasdd1/uevent:PARTN=1
dasdd/dasdd1/discard_alignment:0
dasdd/integrity/write_generate:0
dasdd/integrity/device_is_integrity_capable:0
dasdd/integrity/tag_size:0
dasdd/integrity/read_verify:0
dasdd/integrity/protection_interval_bytes:0
dasdd/integrity/format:none
dasdd/discard_alignment:0
