Hi
I am trying to run fio on a raw NVMe drive using 2 jobs with QD=4.
I am not sure how to specify the offsets for each job to write to. I tried using offset_increment but that doesn't seem to work.
The first run with 1 job runs smoothly.
$ sudo fio --rw=randwrite --bs=4k --name=/dev/nvme0n1 --runtime=10 --direct=1 --ioengine=libaio --iodepth=4
/dev/nvme0n1: (g=0): rw=randwrite, bs=4k-4k/4k-4k/4k-4k, ioengine=libaio, iodepth=4
fio-2.2.8
starting 1 process
jobs: 1 (f=1): [w(1)] [100.0% done] [0kb/494.6mb/0kb /s] [0/127k/0 iops] [eta 00m:00s]
/dev/nvme0n1: (groupid=0, jobs=1): err= 0: pid=38569: thu may 25 13:02:50 2017
write: io=4835.3mb, bw=495080kb/s, iops=123770, runt= 10001msec
slat (usec): min=2, max=206, avg= 5.21, stdev= 1.70
clat (usec): min=13, max=5823, avg=25.37, stdev=52.46
lat (usec): min=16, max=5827, avg=30.93, stdev=52.43
clat percentiles (usec):
| 1.00th=[ 18], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 22],
| 30.00th=[ 22], 40.00th=[ 23], 50.00th=[ 24], 60.00th=[ 24],
| 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 27], 95.00th=[ 28],
| 99.00th=[ 34], 99.50th=[ 40], 99.90th=[ 338], 99.95th=[ 748],
| 99.99th=[ 2992]
bw (kb /s): min=386360, max=523736, per=99.74%, avg=493776.53, stdev=45433.95
lat (usec) : 20=5.37%, 50=94.17%, 100=0.15%, 250=0.17%, 500=0.07%
lat (usec) : 750=0.02%, 1000=0.01%
lat (msec) : 2=0.02%, 4=0.02%, 10=0.01%
cpu : usr=17.46%, sys=77.55%, ctx=2383, majf=0, minf=1332
io depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=0/w=1237824/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=4
run status group 0 (all jobs):
write: io=4835.3mb, aggrb=495080kb/s, minb=495080kb/s, maxb=495080kb/s, mint=10001msec, maxt=10001msec
disk stats (read/write):
nvme0n1: ios=130/1223268, merge=0/0, ticks=5/19173, in_queue=18724, util=98.98%
When I try specifying numjobs=2 with offset_increment, I get an error and only 1 process is launched.
$ sudo fio --rw=randwrite --bs=4k --name=/dev/nvme0n1 --runtime=10 --direct=1 --ioengine=libaio --iodepth=4 --numjobs=2 --offset_increment=81920m
/dev/nvme0n1: (g=0): rw=randwrite, bs=4k-4k/4k-4k/4k-4k, ioengine=libaio, iodepth=4
...
fio-2.2.8
starting 2 processes
/dev/nvme0n1: you need to specify size=
fio: pid=0, err=22/file:filesetup.c:802, func=total_file_size, error=invalid argument
^cbs: 1 (f=1): [w(1),x(1)] [54.5% done] [0kb/510.2mb/0kb /s] [0/131k/0 iops] [eta 00m:05s]
fio: terminating on signal 2
What's the best way to have multiple jobs run on a single raw drive.
Thanks
Prasun
--
To unsubscribe from this list: send the line "unsubscribe fio" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
