problem with the "write_bw_log" parameter in a virtualized environment using a write iopattern

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi everybody,

I'am using fio in a vmware virtualized environment. I have got a guest
virtual machine based on centos5.2 on which I run fio in order to
measure the virtual disks IO performances.
I use the "write_bw_log" parameter in order to build graphs for the
experiments but the problem is that the file generated by fio for each
job is empty (size = 0).
However, i also use "write_clat_log" parameter and the 'clat.log' and
'slat.log' files are not empty. The mean bandwidth in the fio output
summary seams to be good.

By the way, this problem only happen with write workloads either write
or randwrite.
Here is the fio config file I used:
===================
[global]
thread
ioengine=libaio
write_bw_log
write_lat_log
[/dev/sdc]
name=job0
rw=write
bs=4096k
iodepth=1
direct=1
runtime=60
===================

And the fio stdout was:
===================
job0: (g=0): rw=write, bs=4M-4M/4M-4M, ioengine=libaio, iodepth=1
Starting 1 thread

job0: (groupid=0, jobs=1): err= 0: pid=4063
  write: io=996MiB, bw=16,967KiB/s, iops=4, runt= 60111msec
    slat (usec): min=3,204, max=6,461, avg=3659.85, stdev=525.91
    clat (msec): min=94, max=4,236, avg=237.72, stdev=335.46
  cpu          : usr=0.00%, sys=1.54%, ctx=5616, majf=0, minf=249
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%,
 >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
 >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
 >=64=0.0%
     issued r/w: total=0/249, short=0/0

     lat (msec): 100=0.40%, 250=81.93%, 500=16.87%, >=2000=0.80%

Run status group 0 (all jobs):
  WRITE: io=996MiB, aggrb=16,967KiB/s, minb=16,967KiB/s,
maxb=16,967KiB/s, mint=60111msec, maxt=60111msec

Disk stats (read/write):
  sdc: ios=0/1990, merge=0/0, ticks=0/371851, in_queue=372233, util=99.67%
===================

The logs job0_bw.log, job0_clat.log and job0_slat.log are in the
attachement.

Did someone already have such a problem? If so, is there a workaround or
a patch to correct it?

Regards.

Ivan Frain
--
*Seanodes*
Bâtiment Platon
25 boulevard Victor Hugo
31770 Colomiers
tél : 05.62.12.00.19
http://www.seanodes.com

4240, 4236944, 1, 4194304
7812, 3569074, 1, 4194304
8024, 208533, 1, 4194304
8232, 203449, 1, 4194304
8423, 186506, 1, 4194304
8711, 283756, 1, 4194304
8883, 168660, 1, 4194304
9089, 201178, 1, 4194304
9291, 198174, 1, 4194304
9548, 251832, 1, 4194304
9773, 221891, 1, 4194304
10081, 304446, 1, 4194304
10346, 260687, 1, 4194304
10538, 187928, 1, 4194304
10645, 104508, 1, 4194304
10987, 337934, 1, 4194304
11220, 229091, 1, 4194304
11461, 237953, 1, 4194304
11686, 221918, 1, 4194304
11911, 221440, 1, 4194304
12132, 216939, 1, 4194304
12349, 212441, 1, 4194304
12507, 153260, 1, 4194304
12674, 163849, 1, 4194304
12910, 232048, 1, 4194304
13148, 235123, 1, 4194304
13385, 233796, 1, 4194304
13646, 257159, 1, 4194304
13831, 182124, 1, 4194304
14013, 178818, 1, 4194304
14193, 176009, 1, 4194304
14385, 189283, 1, 4194304
14558, 168633, 1, 4194304
14774, 212869, 1, 4194304
14941, 163073, 1, 4194304
15194, 249330, 1, 4194304
15392, 195177, 1, 4194304
15562, 166582, 1, 4194304
15744, 177923, 1, 4194304
15895, 147953, 1, 4194304
16133, 234581, 1, 4194304
16536, 399573, 1, 4194304
16701, 162203, 1, 4194304
16873, 168752, 1, 4194304
17103, 225076, 1, 4194304
17376, 268073, 1, 4194304
17576, 196752, 1, 4194304
17802, 222414, 1, 4194304
17994, 189252, 1, 4194304
18244, 246568, 1, 4194304
18465, 217984, 1, 4194304
18828, 359308, 1, 4194304
19001, 169218, 1, 4194304
19152, 147573, 1, 4194304
19374, 218653, 1, 4194304
19624, 244368, 1, 4194304
19818, 188662, 1, 4194304
20097, 275759, 1, 4194304
20315, 215013, 1, 4194304
20507, 188239, 1, 4194304
20712, 201430, 1, 4194304
20820, 104993, 1, 4194304
21019, 194665, 1, 4194304
21227, 204990, 1, 4194304
21493, 262118, 1, 4194304
21712, 216116, 1, 4194304
22023, 307219, 1, 4194304
22219, 192647, 1, 4194304
22406, 183407, 1, 4194304
22640, 230734, 1, 4194304
22917, 273848, 1, 4194304
23295, 374183, 1, 4194304
23484, 185411, 1, 4194304
23685, 197993, 1, 4194304
23867, 177358, 1, 4194304
24095, 224916, 1, 4194304
24377, 278614, 1, 4194304
24534, 153480, 1, 4194304
24765, 227933, 1, 4194304
24975, 207017, 1, 4194304
25229, 250185, 1, 4194304
25501, 268229, 1, 4194304
25705, 200656, 1, 4194304
25969, 260774, 1, 4194304
26223, 250724, 1, 4194304
26368, 142339, 1, 4194304
26498, 126464, 1, 4194304
26629, 127150, 1, 4194304
26815, 182673, 1, 4194304
26996, 177478, 1, 4194304
27167, 167143, 1, 4194304
27358, 187520, 1, 4194304
27514, 152372, 1, 4194304
27698, 181030, 1, 4194304
27940, 238960, 1, 4194304
28215, 270663, 1, 4194304
28417, 198277, 1, 4194304
28689, 268621, 1, 4194304
29039, 347277, 1, 4194304
29272, 229095, 1, 4194304
29478, 202227, 1, 4194304
29725, 243462, 1, 4194304
30018, 289745, 1, 4194304
30256, 234582, 1, 4194304
30468, 209061, 1, 4194304
30648, 175596, 1, 4194304
30855, 203792, 1, 4194304
31014, 154142, 1, 4194304
31211, 193550, 1, 4194304
31362, 147732, 1, 4194304
31530, 165089, 1, 4194304
31782, 247968, 1, 4194304
32022, 236684, 1, 4194304
32167, 141523, 1, 4194304
32371, 200798, 1, 4194304
32560, 185291, 1, 4194304
32811, 246951, 1, 4194304
33035, 219951, 1, 4194304
33243, 204834, 1, 4194304
33422, 174954, 1, 4194304
33667, 242215, 1, 4194304
33896, 224812, 1, 4194304
34085, 186147, 1, 4194304
34294, 205098, 1, 4194304
34475, 176174, 1, 4194304
34691, 211898, 1, 4194304
34869, 175104, 1, 4194304
35084, 211307, 1, 4194304
35255, 167644, 1, 4194304
35384, 125138, 1, 4194304
35590, 202466, 1, 4194304
35790, 196391, 1, 4194304
36084, 291001, 1, 4194304
36360, 272522, 1, 4194304
36593, 229102, 1, 4194304
36892, 296155, 1, 4194304
37084, 187895, 1, 4194304
37215, 127517, 1, 4194304
37340, 122062, 1, 4194304
37562, 218165, 1, 4194304
37775, 209765, 1, 4194304
37970, 190420, 1, 4194304
38164, 190537, 1, 4194304
38420, 252247, 1, 4194304
38553, 129986, 1, 4194304
38782, 225684, 1, 4194304
38972, 186405, 1, 4194304
39200, 223855, 1, 4194304
39439, 236480, 1, 4194304
39617, 173946, 1, 4194304
39812, 191496, 1, 4194304
40064, 248650, 1, 4194304
40263, 195501, 1, 4194304
40487, 221161, 1, 4194304
40709, 218420, 1, 4194304
40932, 218428, 1, 4194304
41130, 194601, 1, 4194304
41336, 202973, 1, 4194304
41526, 186070, 1, 4194304
41796, 266322, 1, 4194304
42058, 258751, 1, 4194304
42264, 201529, 1, 4194304
42502, 232949, 1, 4194304
42719, 213968, 1, 4194304
42891, 168772, 1, 4194304
43160, 264662, 1, 4194304
43345, 181910, 1, 4194304
43509, 160430, 1, 4194304
43693, 179771, 1, 4194304
43900, 202918, 1, 4194304
44124, 220671, 1, 4194304
44318, 190108, 1, 4194304
44596, 274567, 1, 4194304
44760, 160147, 1, 4194304
45036, 273103, 1, 4194304
45227, 186251, 1, 4194304
45389, 158732, 1, 4194304
45553, 160891, 1, 4194304
45737, 179987, 1, 4194304
45952, 211623, 1, 4194304
46117, 161257, 1, 4194304
46296, 174086, 1, 4194304
46520, 217560, 1, 4194304
46733, 208391, 1, 4194304
47041, 304529, 1, 4194304
47247, 202221, 1, 4194304
47428, 176910, 1, 4194304
47673, 241933, 1, 4194304
47894, 217772, 1, 4194304
48082, 183817, 1, 4194304
48250, 165274, 1, 4194304
48545, 291051, 1, 4194304
48767, 218712, 1, 4194304
49087, 316347, 1, 4194304
49235, 144980, 1, 4194304
49445, 205107, 1, 4194304
49641, 191909, 1, 4194304
49816, 171857, 1, 4194304
50010, 190687, 1, 4194304
50194, 180425, 1, 4194304
50376, 178080, 1, 4194304
50733, 353406, 1, 4194304
50935, 198457, 1, 4194304
51116, 176448, 1, 4194304
51308, 188643, 1, 4194304
51507, 193971, 1, 4194304
51700, 190356, 1, 4194304
51901, 196259, 1, 4194304
52109, 204484, 1, 4194304
52326, 213234, 1, 4194304
52543, 213982, 1, 4194304
52839, 292117, 1, 4194304
53086, 241995, 1, 4194304
53320, 230071, 1, 4194304
53557, 232921, 1, 4194304
53776, 216058, 1, 4194304
54030, 249921, 1, 4194304
54245, 211583, 1, 4194304
54406, 157230, 1, 4194304
54572, 161299, 1, 4194304
54856, 280843, 1, 4194304
55083, 222443, 1, 4194304
55205, 117172, 1, 4194304
55497, 287162, 1, 4194304
55657, 156256, 1, 4194304
55921, 260935, 1, 4194304
56149, 222579, 1, 4194304
56356, 201651, 1, 4194304
56607, 247578, 1, 4194304
56897, 286306, 1, 4194304
57070, 168991, 1, 4194304
57255, 180942, 1, 4194304
57408, 149830, 1, 4194304
57563, 151394, 1, 4194304
57703, 136853, 1, 4194304
57879, 172438, 1, 4194304
58018, 134572, 1, 4194304
58178, 156861, 1, 4194304
58349, 167847, 1, 4194304
58485, 132239, 1, 4194304
58664, 175691, 1, 4194304
58851, 183694, 1, 4194304
58991, 134978, 1, 4194304
59122, 126940, 1, 4194304
59347, 221566, 1, 4194304
59445, 94285, 1, 4194304
59612, 160155, 1, 4194304
59791, 174620, 1, 4194304
60110, 315029, 1, 4194304

3, 3358, 1, 4194304
4243, 3400, 1, 4194304
7816, 3396, 1, 4194304
8028, 3749, 1, 4194304
8236, 4477, 1, 4194304
8427, 4510, 1, 4194304
8715, 3591, 1, 4194304
8888, 4326, 1, 4194304
9093, 3844, 1, 4194304
9296, 5244, 1, 4194304
9551, 3328, 1, 4194304
9776, 3391, 1, 4194304
10086, 4687, 1, 4194304
10350, 3370, 1, 4194304
10541, 3313, 1, 4194304
10649, 3458, 1, 4194304
10990, 3529, 1, 4194304
11223, 3488, 1, 4194304
11464, 3490, 1, 4194304
11690, 3337, 1, 4194304
11915, 3779, 1, 4194304
12137, 4733, 1, 4194304
12354, 4386, 1, 4194304
12510, 3397, 1, 4194304
12678, 3473, 1, 4194304
12913, 3273, 1, 4194304
13151, 3334, 1, 4194304
13389, 3326, 1, 4194304
13649, 3344, 1, 4194304
13834, 3283, 1, 4194304
14017, 3382, 1, 4194304
14196, 3422, 1, 4194304
14389, 3682, 1, 4194304
14562, 3786, 1, 4194304
14778, 3363, 1, 4194304
14944, 3340, 1, 4194304
15197, 3511, 1, 4194304
15396, 3414, 1, 4194304
15566, 3315, 1, 4194304
15747, 3253, 1, 4194304
15898, 3331, 1, 4194304
16136, 3422, 1, 4194304
16539, 3426, 1, 4194304
16705, 3280, 1, 4194304
16878, 4741, 1, 4194304
17108, 4232, 1, 4194304
17379, 3426, 1, 4194304
17579, 3225, 1, 4194304
17805, 3278, 1, 4194304
17997, 3271, 1, 4194304
18247, 3270, 1, 4194304
18469, 3588, 1, 4194304
18832, 3423, 1, 4194304
19004, 3391, 1, 4194304
19155, 3526, 1, 4194304
19380, 5953, 1, 4194304
19629, 4465, 1, 4194304
19821, 3374, 1, 4194304
20100, 3424, 1, 4194304
20319, 3471, 1, 4194304
20510, 3401, 1, 4194304
20715, 3515, 1, 4194304
20824, 3558, 1, 4194304
21022, 3468, 1, 4194304
21231, 3420, 1, 4194304
21496, 3377, 1, 4194304
21716, 3339, 1, 4194304
22026, 3341, 1, 4194304
22222, 3420, 1, 4194304
22409, 3486, 1, 4194304
22643, 3446, 1, 4194304
22921, 3380, 1, 4194304
23298, 3469, 1, 4194304
23487, 3607, 1, 4194304
23689, 3993, 1, 4194304
23870, 3292, 1, 4194304
24098, 3272, 1, 4194304
24380, 3336, 1, 4194304
24537, 3403, 1, 4194304
24768, 3350, 1, 4194304
24979, 3368, 1, 4194304
25232, 3303, 1, 4194304
25504, 3349, 1, 4194304
25708, 3292, 1, 4194304
25972, 3347, 1, 4194304
26226, 3280, 1, 4194304
26372, 3536, 1, 4194304
26502, 3592, 1, 4194304
26633, 3462, 1, 4194304
26819, 3528, 1, 4194304
27000, 3260, 1, 4194304
27170, 3457, 1, 4194304
27361, 3411, 1, 4194304
27517, 3392, 1, 4194304
27701, 3375, 1, 4194304
27944, 3791, 1, 4194304
28218, 3490, 1, 4194304
28420, 3444, 1, 4194304
28692, 3379, 1, 4194304
29043, 3472, 1, 4194304
29275, 3391, 1, 4194304
29481, 3571, 1, 4194304
29728, 3366, 1, 4194304
30021, 3332, 1, 4194304
30259, 3335, 1, 4194304
30472, 3993, 1, 4194304
30652, 3832, 1, 4194304
30860, 4110, 1, 4194304
31017, 3444, 1, 4194304
31214, 3378, 1, 4194304
31365, 3389, 1, 4194304
31534, 3312, 1, 4194304
31785, 3689, 1, 4194304
32026, 3552, 1, 4194304
32170, 3300, 1, 4194304
32375, 3912, 1, 4194304
32564, 3570, 1, 4194304
32815, 3929, 1, 4194304
33038, 3469, 1, 4194304
33247, 3448, 1, 4194304
33425, 3453, 1, 4194304
33671, 3327, 1, 4194304
33899, 3404, 1, 4194304
34089, 3423, 1, 4194304
34299, 5508, 1, 4194304
34479, 3452, 1, 4194304
34694, 3431, 1, 4194304
34873, 3382, 1, 4194304
35087, 3364, 1, 4194304
35259, 3436, 1, 4194304
35387, 3533, 1, 4194304
35593, 3421, 1, 4194304
35793, 3812, 1, 4194304
36088, 3391, 1, 4194304
36364, 3400, 1, 4194304
36596, 3375, 1, 4194304
36896, 3381, 1, 4194304
37087, 3499, 1, 4194304
37218, 3513, 1, 4194304
37344, 3412, 1, 4194304
37565, 3377, 1, 4194304
37780, 4467, 1, 4194304
37973, 3380, 1, 4194304
38167, 3445, 1, 4194304
38423, 3519, 1, 4194304
38557, 3594, 1, 4194304
38786, 3435, 1, 4194304
38976, 3386, 1, 4194304
39203, 3312, 1, 4194304
39443, 3266, 1, 4194304
39620, 3357, 1, 4194304
39815, 3760, 1, 4194304
40067, 3366, 1, 4194304
40266, 3439, 1, 4194304
40491, 3545, 1, 4194304
40713, 3770, 1, 4194304
40935, 3489, 1, 4194304
41133, 3458, 1, 4194304
41340, 3563, 1, 4194304
41530, 3603, 1, 4194304
41799, 3380, 1, 4194304
42063, 4737, 1, 4194304
42269, 3666, 1, 4194304
42505, 3389, 1, 4194304
42722, 3506, 1, 4194304
42895, 3663, 1, 4194304
43163, 3419, 1, 4194304
43348, 3281, 1, 4194304
43514, 5003, 1, 4194304
43697, 3805, 1, 4194304
43904, 3361, 1, 4194304
44128, 3381, 1, 4194304
44321, 3453, 1, 4194304
44599, 3583, 1, 4194304
44763, 3420, 1, 4194304
45041, 4690, 1, 4194304
45230, 3383, 1, 4194304
45393, 3377, 1, 4194304
45557, 3344, 1, 4194304
45740, 3602, 1, 4194304
45956, 3760, 1, 4194304
46122, 4785, 1, 4194304
46303, 6461, 1, 4194304
46525, 4437, 1, 4194304
46737, 3940, 1, 4194304
47045, 3365, 1, 4194304
47251, 3515, 1, 4194304
47431, 3646, 1, 4194304
47677, 3547, 1, 4194304
47898, 3432, 1, 4194304
48085, 3471, 1, 4194304
48254, 3377, 1, 4194304
48548, 3327, 1, 4194304
48770, 3393, 1, 4194304
49090, 3489, 1, 4194304
49240, 4765, 1, 4194304
49449, 3204, 1, 4194304
49644, 3525, 1, 4194304
49820, 3522, 1, 4194304
50014, 3445, 1, 4194304
50198, 3417, 1, 4194304
50379, 3605, 1, 4194304
50736, 3430, 1, 4194304
50939, 4763, 1, 4194304
51119, 3435, 1, 4194304
51313, 4637, 1, 4194304
51510, 3386, 1, 4194304
51704, 3984, 1, 4194304
51904, 3497, 1, 4194304
52113, 4241, 1, 4194304
52329, 3448, 1, 4194304
52547, 3473, 1, 4194304
52844, 4933, 1, 4194304
53089, 3412, 1, 4194304
53324, 4302, 1, 4194304
53560, 3520, 1, 4194304
53781, 4104, 1, 4194304
54034, 3325, 1, 4194304
54249, 3364, 1, 4194304
54411, 4700, 1, 4194304
54576, 3516, 1, 4194304
54861, 4299, 1, 4194304
55088, 4337, 1, 4194304
55209, 4612, 1, 4194304
55500, 3819, 1, 4194304
55660, 3525, 1, 4194304
55927, 5684, 1, 4194304
56154, 4307, 1, 4194304
56359, 3545, 1, 4194304
56611, 4172, 1, 4194304
56901, 3485, 1, 4194304
57074, 3971, 1, 4194304
57258, 3333, 1, 4194304
57411, 3328, 1, 4194304
57566, 3308, 1, 4194304
57706, 3456, 1, 4194304
57883, 4507, 1, 4194304
58021, 3412, 1, 4194304
58181, 3369, 1, 4194304
58353, 3348, 1, 4194304
58488, 3360, 1, 4194304
58667, 3382, 1, 4194304
58856, 4481, 1, 4194304
58995, 4696, 1, 4194304
59126, 3497, 1, 4194304
59351, 3522, 1, 4194304
59451, 6085, 1, 4194304
59616, 4557, 1, 4194304
59795, 3795, 1, 4194304


[Index of Archives]     [Linux Kernel]     [Linux SCSI]     [Linux IDE]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux SCSI]

  Powered by Linux