RE: IO mixed : 12% seqread, 8% seqwrite, 80% random (30% W, 70%R)

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Jens,

Thanks for update.

>Fio can't do a double split like that in a single job, but if you can
>tolerate mixing the 60/40 and 70/30 read/write between sequential and
>random, then you can make it work.

>Or you can split it in two jobs, one doing the sequential part and the
>other the random. The you can use the flow parameters to pace them at
>20/80 ratios.

I tried to use choice 2.
------------------------------
[global]
ioengine=posixaio
invalidate=0
norandommap
ramp_time=5
iodepth=8
runtime=10
time_based
direct=1
#numjobs=1
group_reporting
filesize=10M
blocksize=8k

[hdisk2]
stonewall
filename=/dev/rhdisk2
rw=readwrite
rwmixread=60
flow=2

[hdisk2a]
stonewall
filename=/dev/rhdisk2
rw=randrw
rwmixread=70
flow=8
------------------------------
# ./fio inftest.conf
hdisk2: (g=0): rw=rw, bs=8K-8K/8K-8K/8K-8K, ioengine=posixaio, iodepth=8
hdisk2a: (g=1): rw=randrw, bs=8K-8K/8K-8K/8K-8K, ioengine=posixaio, iodepth=8
fio-2.3
Starting 2 processes
Jobs: 1 (f=0): [/(1),P(1)] [-.-% done] [0KB/0KB/0KB /s] [0/0/0 iops] [eta 00m:30s]
..

The fio process eat a lot of cpu but no disk activity. Some output from topas. So i think i don't use correctly the flow parmeter and perhaps do some loops somewhere into fio.
------------------
CPU  User%  Kern%  Wait%  Idle%                 
ALL   46.9   53.1    0.0    0.0 

Disk    Busy%     KBPS     TPS KB-Read KB-Writ
hdisk2    0.0     0.0      0.0    0.0     0.0

Name            PID  CPU%  PgSp Owner
fio          504000  46.8   0.3 root
sshd         549094  28.6   1.0 root
fio          393304  24.0   0.2 root
topas        462868   0.1   1.9 root
--------------------------------------


If i do a ctrl+c, i have the following:

# ./fio inftest.conf
hdisk2: (g=0): rw=rw, bs=8K-8K/8K-8K/8K-8K, ioengine=posixaio, iodepth=8
hdisk2a: (g=1): rw=randrw, bs=8K-8K/8K-8K/8K-8K, ioengine=posixaio, iodepth=8
fio-2.3
Starting 2 processes
Jobs: 1 (f=0): [/(1),P(1)] [-.-% done] [0KB/0KB/0KB /s] [0/0/0 iops] [eta 00m:30s]
fio: terminating on signal 2

fio: terminating on signal 2
Jobs: 0 (f=0): [/(1),P(1)] [-.-% done] [0KB/0KB/0KB /s] [0/0/0 iops] [eta 00m:30s]
hdisk2: (groupid=0, jobs=1): err= 0: pid=504000: Fri Mar 25 21:19:52 2016
  read : io=32768B, bw=32000KB/s, iops=0, runt=     1msec
    slat (usec): min=16, max=194, avg=25.25, stdev=15.63
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[    0], 10.00th=[    0], 20.00th=[    0],
     | 30.00th=[    0], 40.00th=[    0], 50.00th=[    0], 60.00th=[    0],
     | 70.00th=[    0], 80.00th=[    0], 90.00th=[    0], 95.00th=[    0],
     | 99.00th=[    0], 99.50th=[    0], 99.90th=[    0], 99.95th=[    0],
     | 99.99th=[    0]
  write: io=16384B, bw=16000KB/s, iops=0, runt=     1msec
    slat (usec): min=16, max=105, avg=26.12, stdev=13.44
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[    0], 10.00th=[    0], 20.00th=[    0],
     | 30.00th=[    0], 40.00th=[    0], 50.00th=[    0], 60.00th=[    0],
     | 70.00th=[    0], 80.00th=[    0], 90.00th=[    0], 95.00th=[    0],
     | 99.00th=[    0], 99.50th=[    0], 99.90th=[    0], 99.95th=[    0],
     | 99.99th=[    0]
  cpu          : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=98.0%, 8=2.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=8

Run status group 0 (all jobs):
   READ: io=32KB, aggrb=32000KB/s, minb=32000KB/s, maxb=32000KB/s, mint=1msec, maxt=1msec
  WRITE: io=16KB, aggrb=16000KB/s, minb=16000KB/s, maxb=16000KB/s, mint=1msec, maxt=1msec

Run status group 1 (all jobs):
#

Regards,
Thierry


--
To unsubscribe from this list: send the line "unsubscribe fio" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [Linux Kernel]     [Linux SCSI]     [Linux IDE]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux SCSI]

  Powered by Linux