On Fri, 14 Jul 2017 14:45:39 +0200
"hch@xxxxxx" <hch@xxxxxx> wrote:
> On Fri, Jul 14, 2017 at 05:56:41PM +0800, Jonathan Cameron wrote:
> > Just wondering if you had any thoughts on how we can proceed with tracking
> > down this regression?
> >
> > I'm not familiar enough with the multiqueue code to really know where
> > to start.
> >
> > If there are any other tests that would be of use, let us know.
>
> Can you send the blktrace and perf output for each of the runs?
>
> Thanks!
Hi
Sorry for the delay,
blktrace for now (or at least the btt output based on blktrace).
All runs are 1 minute of fio with reads and iodepth of 2048 as
before. Just the summaries to keep this compact. Also 6 disks
were running but results just presented for first one.
mq disabled, noop scheduler
==================== All Devices ====================
ALL MIN AVG MAX N
--------------- ------------- ------------- ------------- -----------
Q2Q 0.000003960 0.000008760 0.016291960 6849306
Q2G 0.000000780 0.000001547 0.011354860 1420699
G2I 0.000000660 0.000000975 0.011092540 1420699
Q2M 0.000000340 0.000000431 0.003383260 5428608
I2D 0.000000440 0.000196038 0.023731660 1420699
M2D 0.000000480 0.001475398 0.023726860 5428608
D2C 0.000022420 0.002887338 0.026416340 6849307
Q2C 0.000025360 0.004098233 0.035045140 6849307
==================== Device Overhead ====================
DEV | Q2G G2I Q2M I2D D2C
---------- | --------- --------- --------- --------- ---------
( 8, 0) | 0.0078% 0.0049% 0.0083% 0.9922% 70.4532%
---------- | --------- --------- --------- --------- ---------
Overall | 0.0078% 0.0049% 0.0083% 0.9922% 70.4532%
==================== Device Merge Information ====================
DEV | #Q #D Ratio | BLKmin BLKavg BLKmax Total
---------- | -------- -------- ------- | -------- -------- -------- --------
( 8, 0) | 6849307 1420699 4.8 | 8 38 256 54794456
==================== Device Q2Q Seek Information ====================
DEV | NSEEKS MEAN MEDIAN | MODE
---------- | --------------- --------------- --------------- | ---------------
( 8, 0) | 6849307 0.0 0 | 0(6849307)
---------- | --------------- --------------- --------------- | ---------------
Overall | NSEEKS MEAN MEDIAN | MODE
Average | 6849307 0.0 0 | 0(6849307)
==================== Device D2D Seek Information ====================
DEV | NSEEKS MEAN MEDIAN | MODE
---------- | --------------- --------------- --------------- | ---------------
( 8, 0) | 1420699 0.0 0 | 0(1420699)
---------- | --------------- --------------- --------------- | ---------------
Overall | NSEEKS MEAN MEDIAN | MODE
Average | 1420699 0.0 0 | 0(1420699)
==================== Plug Information ====================
DEV | # Plugs # Timer Us | % Time Q Plugged
---------- | ---------- ---------- | ----------------
( 8, 0) | 1420699( 0) | 2.231949107%
DEV | IOs/Unp IOs/Unp(to)
---------- | ---------- ----------
( 8, 0) | 1.0 0.0
---------- | ---------- ----------
Overall | IOs/Unp IOs/Unp(to)
Average | 1.0 0.0
==================== Active Requests At Q Information ====================
DEV | Avg Reqs @ Q
---------- | -------------
( 8, 0) | 5.9
==================== I/O Active Period Information ====================
DEV | # Live Avg. Act Avg. !Act % Live
---------- | ---------- ------------- ------------- ------
( 8, 0) | 340 0.175645918 0.001273008 99.28
---------- | ---------- ------------- ------------- ------
Total Sys | 340 0.175645918 0.001273008 99.28
# Total System
# Total System : q activity
0.145330280 0.0
0.145330280 0.4
60.145690780 0.4
60.145690780 0.0
# Total System : c activity
0.145450660 0.5
0.145450660 0.9
60.151161760 0.9
60.151161760 0.5
MQ none scheduler
==================== All Devices ====================
ALL MIN AVG MAX N
--------------- ------------- ------------- ------------- -----------
Q2Q 0.000004000 0.000010185 0.011803940 5890750
Q2G 0.000000320 0.000000763 0.011078580 1831198
G2I 0.000001080 0.000001682 0.010839860 1831198
Q2M 0.000000340 0.000000484 0.008391040 4059553
I2D 0.000000560 0.000087068 0.014350600 1831198
M2D 0.000000740 0.000874582 0.014343840 4059553
D2C 0.000045440 0.001720173 0.022475360 5890751
Q2C 0.000047940 0.002351043 0.027917120 5890751
==================== Device Overhead ====================
DEV | Q2G G2I Q2M I2D D2C
---------- | --------- --------- --------- --------- ---------
( 8, 0) | 0.0101% 0.0222% 0.0142% 1.1512% 73.1664%
---------- | --------- --------- --------- --------- ---------
Overall | 0.0101% 0.0222% 0.0142% 1.1512% 73.1664%
==================== Device Merge Information ====================
DEV | #Q #D Ratio | BLKmin BLKavg BLKmax Total
---------- | -------- -------- ------- | -------- -------- -------- --------
( 8, 0) | 6098099 1831198 3.3 | 8 25 256 47126008
==================== Device Q2Q Seek Information ====================
DEV | NSEEKS MEAN MEDIAN | MODE
---------- | --------------- --------------- --------------- | ---------------
( 8, 0) | 5890751 0.0 0 | 0(5890751)
---------- | --------------- --------------- --------------- | ---------------
Overall | NSEEKS MEAN MEDIAN | MODE
Average | 5890751 0.0 0 | 0(5890751)
==================== Device D2D Seek Information ====================
DEV | NSEEKS MEAN MEDIAN | MODE
---------- | --------------- --------------- --------------- | ---------------
( 8, 0) | 1831198 14.9 0 | 0(1788470)
---------- | --------------- --------------- --------------- | ---------------
Overall | NSEEKS MEAN MEDIAN | MODE
Average | 1831198 14.9 0 | 0(1788470)
==================== Plug Information ====================
DEV | # Plugs # Timer Us | % Time Q Plugged
---------- | ---------- ---------- | ----------------
( 8, 0) | 0( 1831198) | 1.413429756%
DEV | IOs/Unp IOs/Unp(to)
---------- | ---------- ----------
( 8, 0) | 0.0 1.0
---------- | ---------- ----------
Overall | IOs/Unp IOs/Unp(to)
Average | 0.0 1.0
==================== Active Requests At Q Information ====================
DEV | Avg Reqs @ Q
---------- | -------------
( 8, 0) | 103313.4
==================== I/O Active Period Information ====================
DEV | # Live Avg. Act Avg. !Act % Live
---------- | ---------- ------------- ------------- ------
( 8, 0) | 3524 0.016706167 0.000374821 97.81
---------- | ---------- ------------- ------------- ------
Total Sys | 3524 0.016706167 0.000374821 97.81
# Total System
# Total System : q activity
0.192011040 0.0
0.192011040 0.4
60.191890980 0.4
60.191890980 0.0
# Total System : c activity
0.192155040 0.5
0.192155040 0.9
60.193025700 0.9
60.193025700 0.5
mq-deadline
==================== All Devices ====================
ALL MIN AVG MAX N
--------------- ------------- ------------- ------------- -----------
Q2Q 0.000004280 0.000021677 0.011974760 2767943
Q2G 0.000000440 0.000000624 0.004582540 1784446
G2I 0.000001060 0.000011345 0.010930560 1784446
Q2M 0.000000400 0.000000497 0.000384020 983498
I2D 0.000000840 0.005639927 1.439620540 1784446
M2D 0.000001500 0.010220524 1.180956080 983498
D2C 0.000062460 0.001896701 0.013208260 2767944
Q2C 0.000066940 0.009172085 1.441107160 2767944
==================== Device Overhead ====================
DEV | Q2G G2I Q2M I2D D2C
---------- | --------- --------- --------- --------- ---------
( 8, 0) | 0.0044% 0.0797% 0.0019% 39.6416% 20.6791%
---------- | --------- --------- --------- --------- ---------
Overall | 0.0044% 0.0797% 0.0019% 39.6416% 20.6791%
==================== Device Merge Information ====================
DEV | #Q #D Ratio | BLKmin BLKavg BLKmax Total
---------- | -------- -------- ------- | -------- -------- -------- --------
( 8, 0) | 6224597 1784446 3.5 | 8 12 256 22143552
==================== Device Q2Q Seek Information ====================
DEV | NSEEKS MEAN MEDIAN | MODE
---------- | --------------- --------------- --------------- | ---------------
( 8, 0) | 2767944 0.0 0 | 0(2767944)
---------- | --------------- --------------- --------------- | ---------------
Overall | NSEEKS MEAN MEDIAN | MODE
Average | 2767944 0.0 0 | 0(2767944)
==================== Device D2D Seek Information ====================
DEV | NSEEKS MEAN MEDIAN | MODE
---------- | --------------- --------------- --------------- | ---------------
( 8, 0) | 1784446 358.3 0 | 0(1549194)
---------- | --------------- --------------- --------------- | ---------------
Overall | NSEEKS MEAN MEDIAN | MODE
Average | 1784446 358.3 0 | 0(1549194)
==================== Plug Information ====================
DEV | # Plugs # Timer Us | % Time Q Plugged
---------- | ---------- ---------- | ----------------
( 8, 0) | 0( 1784446) | 1.244944150%
DEV | IOs/Unp IOs/Unp(to)
---------- | ---------- ----------
( 8, 0) | 0.0 1.0
---------- | ---------- ----------
Overall | IOs/Unp IOs/Unp(to)
Average | 0.0 1.0
==================== Active Requests At Q Information ====================
DEV | Avg Reqs @ Q
---------- | -------------
( 8, 0) | 1731603.5
==================== I/O Active Period Information ====================
DEV | # Live Avg. Act Avg. !Act % Live
---------- | ---------- ------------- ------------- ------
( 8, 0) | 554 0.108154299 0.000462375 99.58
---------- | ---------- ------------- ------------- ------
Total Sys | 554 0.108154299 0.000462375 99.58
# Total System
# Total System : q activity
0.167375140 0.0
0.167375140 0.4
60.167642920 0.4
60.167642920 0.0
# Total System : c activity
0.167503100 0.5
0.167503100 0.9
60.173175400 0.9
60.173175400 0.5
Thanks
Jonathan
