On 6 June 2017 at 18:39, Jeff Furlong <jeff.furlong@xxxxxxx> wrote: > > When using the client/server mode, I'm having two issues. First, I seemingly randomly get an inflate error, which happens after several hours, and reproducing it is challenging: > > fio: inflate error -5 > fio: failed decompressing log > fio: failed converting IO log > > I have --write_iops_log turned on so guessing the IO log transferred across the network is not working smoothly. I don't have a reliable job file that reproduces the issue, unfortunately. Hmm -5 is going to be Z_BUF_ERROR so the suggestion is we didn't have enough space to store the decompressed data. Do you get this problem with older versions (e.g. 2.19) of fio too? You'll probably need to add debugging to trace nr_samples and where possible total (e.g. around https://github.com/axboe/fio/blob/master/client.c#L1467 and https://github.com/axboe/fio/blob/9af5a2450a555a725dd18e6845967cd7cf3aad64/server.c#L1927 ). > Second, I also get (less randomly) a timeout on SEND_ETA. Here are the details: > > # fio -version > fio-2.20-39-gc12d > > # fio --client=server1 test.job --client=server2 test.job > client <server2>: timeout on SEND_ETA > client <server1>: timeout on SEND_ETA > fio: client: unable to find matching tag (76f680) > > # cat test.job > [test_job] > ioengine=libaio > direct=1 > rw=randread > norandommap > randrepeat=0 > iodepth=256 > size=100% > numjobs=1 > bs=4k > filename=/dev/nvme0n1 > group_reporting > write_lat_log=test_job > runtime=3m Again can you reproduce this one with the previous fio release? Other things that would help is if you cut the job down to the fewest lines that still allow the problem to reproduce and reduce values (such as iodepth, runtime and size) as far as possible that again still allow the problem to occur (e.g. if size=4G still makes it happen that's useful to know). If it happens relatively quickly you may be able to use --debug=all to narrow down the last thing the client did but be aware this generates a lot of output... -- Sitsofe | http://sucs.org/~sits/ -- To unsubscribe from this list: send the line "unsubscribe fio" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
