It worked with size=249 but failed with size=250, see attached. [global] ioengine=windowsaio blocksize=64k direct=1 thread size=249m time_based runtime=10 [asdf] filename=F\:\\testfile:G\:\\testfile:H\:\\testfile:I\:\\testfile:J\:\\testfile:K\:\\testfile:L\:\\testfile:M\:\\testfile:N\:\\testfile ;:O\:\\testfile:P\:\\testfile:Q\:\\testfile -----Original Message----- From: Sitsofe Wheeler [mailto:sitsofe@xxxxxxxxx] Sent: Tuesday, October 31, 2017 3:05 PM To: David Hare <david.hare@xxxxxxxxxxxxxxx> Cc: Jens Axboe <axboe@xxxxxxxxx>; fio@xxxxxxxxxxxxxxx Subject: Re: FIO windows Yes that's right. Also previously did you mean you had set size=512m even though you wrote size=512g ? On 31 October 2017 at 22:03, David Hare <david.hare@xxxxxxxxxxxxxxx> wrote: > I assume you want me to change the size parameter with a 64k blocksize as > everything is working with 16k blocksize? > > -----Original Message----- > From: Sitsofe Wheeler [mailto:sitsofe@xxxxxxxxx] > Sent: Tuesday, October 31, 2017 2:54 PM > To: David Hare <david.hare@xxxxxxxxxxxxxxx> > Cc: Jens Axboe <axboe@xxxxxxxxx>; fio@xxxxxxxxxxxxxxx > Subject: Re: FIO windows > > Hi, > > Can you add unlink=1 and keep reducing the size parameter (e.g. down to 128m > then down to 16m then down to 4m then down to 1m then down to 512k etc)? > > Can you attach the full output that's produced it fails with this reduced > job? > > IF you are make the problem happen with very little I/O being done (i.e. the > job bombs out after doing less than 1MiBytes worth of I/O) you can try > adding --debug=all to the job and seeing if that offers any clues as to what > the last thing it was doing was? > > On 31 October 2017 at 21:46, David Hare <david.hare@xxxxxxxxxxxxxxx> wrote: >> It was ok with or without the colon, the size didn’t seem to make a >> difference, but blocksize did.. see the commented block sizes below. >> >> fio2.fio >> [global] >> >> ioengine=windowsaio >> >> ;blocksize=64k - error >> ;blocksize=32k - error >> ;blocksize=16k - no error >> >> blocksize=16k >> >> direct=1 >> >> thread >> >> size=512g >> >> >> >> time_based >> runtime=10 >> >> [asdf] >> filename=F\:\\testfile:G\:\\testfile:H\:\\testfile:I\:\\testfile:J\:\\ >> testfile:K\:\\testfile:L\:\\testfile:M\:\\testfile:P\:\\testfile >> >> Results: >> Run status group 0 (all jobs): >> READ: bw=141MiB/s (148MB/s), 141MiB/s-141MiB/s (148MB/s-148MB/s), >> io=1413MiB (1481MB), run=10001-10001msec >> >> >> -Dave -- Sitsofe | http://sucs.org/~sits/
asdf: (g=0): rw=read, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=windowsaio, iodepth=1 fio-3.1 Starting 1 thread asdf: (groupid=0, jobs=1): err= 0: pid=1268: Tue Oct 31 22:27:09 2017 read: IOPS=5887, BW=368MiB/s (386MB/s)(3680MiB/10001msec) slat (usec): min=21, max=2124, avg=23.55, stdev=27.20 clat (usec): min=113, max=1996, avg=144.40, stdev=37.03 lat (usec): min=136, max=2347, avg=167.95, stdev=46.60 clat percentiles (usec): | 1.00th=[ 116], 5.00th=[ 119], 10.00th=[ 121], 20.00th=[ 123], | 30.00th=[ 126], 40.00th=[ 130], 50.00th=[ 155], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 159], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 180], 99.50th=[ 217], 99.90th=[ 351], 99.95th=[ 371], | 99.99th=[ 1926] bw ( KiB/s): min=361133, max=379037, per=98.58%, avg=371476.79, stdev=4665.69, samples=19 iops : min= 5642, max= 5922, avg=5803.89, stdev=72.87, samples=19 lat (usec) : 250=99.69%, 500=0.28% lat (msec) : 2=0.03% cpu : usr=0.00%, sys=10.00%, ctx=0, majf=0, minf=0 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=58885,0,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): READ: bw=368MiB/s (386MB/s), 368MiB/s-368MiB/s (386MB/s-386MB/s), io=3680MiB (3859MB), run=10001-10001msec
asdf: (g=0): rw=read, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=windowsaio, iodepth=1 fio-3.1 Starting 1 thread fio: pid=3224, err=22/file:ioengines.c:333, func=td_io_queue, error=Invalid argument asdf: (groupid=0, jobs=1): err=22 (file:ioengines.c:333, func=td_io_queue, error=Invalid argument): pid=3224: Tue Oct 31 22:26:38 2017 read: IOPS=5428, BW=339MiB/s (356MB/s)(250MiB/738msec) slat (usec): min=21, max=2124, avg=27.32, stdev=100.26 clat (usec): min=117, max=424, avg=154.74, stdev=13.60 lat (usec): min=140, max=2380, avg=182.06, stdev=105.15 clat percentiles (usec): | 1.00th=[ 120], 5.00th=[ 125], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 159], 90.00th=[ 161], 95.00th=[ 163], | 99.00th=[ 182], 99.50th=[ 227], 99.90th=[ 265], 99.95th=[ 351], | 99.99th=[ 424] bw ( KiB/s): min=341996, max=341996, per=98.47%, avg=341996.00, stdev= 0.00, samples=1 iops : min= 5343, max= 5343, avg=5343.00, stdev= 0.00, samples=1 lat (usec) : 250=99.80%, 500=0.17% cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=4006,0,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): READ: bw=339MiB/s (356MB/s), 339MiB/s-339MiB/s (356MB/s-356MB/s), io=250MiB (262MB), run=738-738msec