Re: Disk utilization statistics in terse format

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 2014-07-12 01:25, Vasily Tarasov wrote:
If we just remove is_backend in the _v3_v4, then there will be
inconsistencies in the terse output between server-client and
standalone modes. In the server-client mode disk utilization will be
printed in the very end, while in the standalone mode corresponding
fields will be somewhere in the middle.

Actually, there are more inconsistencies between these modes. Check this out:

In the client-server mode:

<snip starts>
[user@frontend fios-24-reads]$ fio --minimal --status-interval=10
--client frontend 1.fio
hostname=bison01, be=0, 64-bit, os=Linux, arch=x86-64, fio=fio-2.1.10, flags=1
<bison01> sdaa: (g=0): rw=read, bs=1M-1M/1M-1M/1M-1M, ioengine=sync, iodepth=1
<bison01> Starting 1 process
<bison01> =1): [] [11.9% done] [191.2M/0K/0K /s] [186/0/0 iops] [eta 10m:50s]
fio: terminating on signal 2
<bison01>
3;fio-2.1.10;sdaa;0;0;17233920;195675;191;88074;0;0;0.000000;0.000000;4829;10900;5228.857219;220.162611;1.000000%=4896;5.000000%=4960;10.000000%=4960;20.000000%=5024;30.000000%=5088;40.000000%=5152;50.000000%=5280;60.000000%=5280;70.000000%=5344;80.000000%=5408;90.000000%=5472;95.000000%=5472;99.000000%=5536;99.500000%=5856;99.900000%=6432;99.950000%=9024;99.990000%=9408;0%=0;0%=0;0%=0;4830;10900;5229.256982;220.166861;188039;206023;100.000000%;195845.737143;5595.466346;0;0;0;0;0;0;0.000000;0.000000;0;0;0.000000;0.000000;1.000000%=0;5.000000%=0;10.000000%=0;20.000000%=0;30.000000%=0;40.000000%=0;50.000000%=0;60.000000%=0;70.000000%=0;80.000000%=0;90.000000%=0;95.000000%=0;99.000000%=0;99.500000%=0;99.900000%=0;99.950000%=0;99.990000%=0;0%=0;0%=0;0%=0;0;0;0.000000;0.000000;0;0;0.000000%;0.000000;0.000000;0.130574%;1.704268%;18221;0;286;100.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;99.99%;0.01%;0.00%;0.00%;0.00%;0.00%;0.00
%;0.00%;0.00%;0.00%

Run status group 0 (all jobs):
    READ: io=16830MB, aggrb=195675KB/s, minb=195675KB/s,
maxb=195675KB/s, mint=88074msec, maxt=88074msec

Disk stats (read/write):
;sdaa;33614;0;0;0;130703;0;130681;99.31%client: host=bison01 disconnected
<snip ends>

In the server mode:

<snip starts>
root@backend fios-24-reads]# fio --minimal --status-interval=10  1.fio
3;fio-2.1.10;sdaa;0;0;1943552;196278;191;9902;0;0;0.000000;0.000000;4835;9504;5210.884676;307.928200;1.000000%=4896;5.000000%=4896;10.000000%=4960;20.000000%=4960;30.000000%=4960;40.000000%=5024;50.000000%=5280;60.000000%=5344;70.000000%=5344;80.000000%=5408;90.000000%=5472;95.000000%=5536;99.000000%=5600;99.500000%=5984;99.900000%=9408;99.950000%=9536;99.990000%=9536;0%=0;0%=0;0%=0;4836;9504;5211.332807;307.944109;188039;206023;99.949829%;196179.526316;7200.889724;0;0;0;0;0;0;0.000000;0.000000;0;0;0.000000;0.000000;1.000000%=0;5.000000%=0;10.000000%=0;20.000000%=0;30.000000%=0;40.000000%=0;50.000000%=0;60.000000%=0;70.000000%=0;80.000000%=0;90.000000%=0;95.000000%=0;99.000000%=0;99.500000%=0;99.900000%=0;99.950000%=0;99.990000%=0;0%=0;0%=0;0%=0;0;0;0.000000;0.000000;0;0;0.000000%;0.000000;0.000000;0.090891%;1.959200%;2046;0;287;100.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;100.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.0
0%;0.00%;0.00%
3;fio-2.1.10;sdaa;0;0;3913728;196620;192;19905;0;0;0.000000;0.000000;4835;9543;5203.414596;282.073042;1.000000%=4896;5.000000%=4896;10.000000%=4960;20.000000%=4960;30.000000%=4960;40.000000%=5024;50.000000%=5280;60.000000%=5344;70.000000%=5344;80.000000%=5408;90.000000%=5472;95.000000%=5536;99.000000%=5536;99.500000%=5920;99.900000%=9280;99.950000%=9536;99.990000%=9536;0%=0;0%=0;0%=0;4836;9543;5203.836254;282.086563;187665;206023;100.000000%;196695.435897;7344.748539;0;0;0;0;0;0;0.000000;0.000000;0;0;0.000000;0.000000;1.000000%=0;5.000000%=0;10.000000%=0;20.000000%=0;30.000000%=0;40.000000%=0;50.000000%=0;60.000000%=0;70.000000%=0;80.000000%=0;90.000000%=0;95.000000%=0;99.000000%=0;99.500000%=0;99.900000%=0;99.950000%=0;99.990000%=0;0%=0;0%=0;0%=0;0;0;0.000000;0.000000;0;0;0.000000%;0.000000;0.000000;0.110525%;1.914092%;4106;0;288;100.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;100.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0
.00%;0.00%;0.00%
3;fio-2.1.10;sdaa;0;0;5872640;196356;191;29908;0;0;0.000000;0.000000;4835;44944;5210.319038;585.202403;1.000000%=4896;5.000000%=4896;10.000000%=4960;20.000000%=4960;30.000000%=4960;40.000000%=5088;50.000000%=5280;60.000000%=5344;70.000000%=5344;80.000000%=5408;90.000000%=5472;95.000000%=5536;99.000000%=5536;99.500000%=5792;99.900000%=9152;99.950000%=9536;99.990000%=44800;0%=0;0%=0;0%=0;4836;44945;5210.726464;585.217778;185256;206023;100.000000%;196535.135593;7198.734852;0;0;0;0;0;0;0.000000;0.000000;0;0;0.000000;0.000000;1.000000%=0;5.000000%=0;10.000000%=0;20.000000%=0;30.000000%=0;40.000000%=0;50.000000%=0;60.000000%=0;70.000000%=0;80.000000%=0;90.000000%=0;95.000000%=0;99.000000%=0;99.500000%=0;99.900000%=0;99.950000%=0;99.990000%=0;0%=0;0%=0;0%=0;0;0;0.000000;0.000000;0;0;0.000000%;0.000000;0.000000;0.103651%;1.895814%;6174;0;288;100.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;99.98%;0.00%;0.02%;0.00%;0.00%;0.00%;0.00%
;0.00%;0.00%;0.00%
^C
fio: terminating on signal 2
3;fio-2.1.10;sdaa;0;0;7492608;196275;191;38174;0;0;0.000000;0.000000;4835;44944;5212.864015;523.029154;1.000000%=4896;5.000000%=4960;10.000000%=4960;20.000000%=4960;30.000000%=5024;40.000000%=5088;50.000000%=5280;60.000000%=5344;70.000000%=5344;80.000000%=5408;90.000000%=5472;95.000000%=5472;99.000000%=5536;99.500000%=5792;99.900000%=6432;99.950000%=9408;99.990000%=44800;0%=0;0%=0;0%=0;4836;44945;5213.266366;523.043881;185256;206023;100.000000%;196534.373333;6663.858266;0;0;0;0;0;0;0.000000;0.000000;0;0;0.000000;0.000000;1.000000%=0;5.000000%=0;10.000000%=0;20.000000%=0;30.000000%=0;40.000000%=0;50.000000%=0;60.000000%=0;70.000000%=0;80.000000%=0;90.000000%=0;95.000000%=0;99.000000%=0;99.500000%=0;99.900000%=0;99.950000%=0;99.990000%=0;0%=0;0%=0;0%=0;0;0;0.000000;0.000000;0;0;0.000000%;0.000000;0.000000;0.110025%;1.888770%;7891;0;288;100.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.0%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;0.00%;99.99%;0.00%;0.01%;0.00%;0.00%;0.00%;0.00%
;0.00%;0.00%;0.00%
<snip ends>

Notice, it seems like  --status-interval does not work at all in the
client-server mode.

So, I would say that there are two problems:

1) --status-interval does not  work in the client server mode

2) Terse output should look the same in both modes

Do you think what I say is reasonable?..

Yes, that sounds very reasonable. It's the main reason I hate the terse format, it's just impossible to both verify and present nicely (and uniformly). I usually encourage people to use the json output, which has the nice property of being easily readable for both humans and computers. And it's easily extendable.

--
Jens Axboe

--
To unsubscribe from this list: send the line "unsubscribe fio" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html




[Index of Archives]     [Linux Kernel]     [Linux SCSI]     [Linux IDE]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux SCSI]

  Powered by Linux