the samsung sm863. write-4k-seq: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 randwrite-4k-seq: (g=1): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 read-4k-seq: (g=2): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 randread-4k-seq: (g=3): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 rw-4k-seq: (g=4): rw=rw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 randrw-4k-seq: (g=5): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 write-128k-seq: (g=6): rw=write, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=libaio, iodepth=1 randwrite-128k-seq: (g=7): rw=randwrite, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=libaio, iodepth=1 read-128k-seq: (g=8): rw=read, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=libaio, iodepth=1 randread-128k-seq: (g=9): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=libaio, iodepth=1 rw-128k-seq: (g=10): rw=rw, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=libaio, iodepth=1 randrw-128k-seq: (g=11): rw=randrw, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=libaio, iodepth=1 write-1024k-seq: (g=12): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1 randwrite-1024k-seq: (g=13): rw=randwrite, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1 read-1024k-seq: (g=14): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1 randread-1024k-seq: (g=15): rw=randread, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1 rw-1024k-seq: (g=16): rw=rw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1 randrw-1024k-seq: (g=17): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1 fio-3.1 Starting 18 processes write-4k-seq: (groupid=0, jobs=1): err= 0: pid=522702: Thu Sep 6 21:04:12 2018 write: IOPS=18.3k, BW=71.6MiB/s (75.1MB/s)(12.6GiB/180001msec) slat (usec): min=4, max=118, avg= 9.69, stdev= 4.91 clat (nsec): min=1147, max=647409, avg=42105.25, stdev=8700.49 lat (usec): min=34, max=662, avg=52.09, stdev= 9.30 clat percentiles (usec): | 1.00th=[ 33], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 35], | 30.00th=[ 36], 40.00th=[ 36], 50.00th=[ 39], 60.00th=[ 43], | 70.00th=[ 47], 80.00th=[ 52], 90.00th=[ 56], 95.00th=[ 58], | 99.00th=[ 60], 99.50th=[ 62], 99.90th=[ 67], 99.95th=[ 69], | 99.99th=[ 155] bw ( KiB/s): min=36464, max=92829, per=84.59%, avg=62036.62, stdev=13226.37, samples=359 iops : min= 9116, max=23207, avg=15508.80, stdev=3306.62, samples=359 lat (usec) : 2=0.01%, 10=0.01%, 20=0.01%, 50=75.33%, 100=24.64% lat (usec) : 250=0.01%, 500=0.01%, 750=0.01% cpu : usr=11.41%, sys=27.84%, ctx=3300541, majf=0, minf=51 IO depths : 1=116.7%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=0,3300219,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 randwrite-4k-seq: (groupid=1, jobs=1): err= 0: pid=522903: Thu Sep 6 21:04:12 2018 write: IOPS=17.9k, BW=69.8MiB/s (73.2MB/s)(12.3GiB/180001msec) slat (usec): min=4, max=333, avg= 9.94, stdev= 5.00 clat (nsec): min=1141, max=1131.2k, avg=42560.69, stdev=9074.14 lat (usec): min=35, max=1137, avg=52.80, stdev= 9.42 clat percentiles (usec): | 1.00th=[ 33], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 35], | 30.00th=[ 36], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 43], | 70.00th=[ 49], 80.00th=[ 54], 90.00th=[ 57], 95.00th=[ 58], | 99.00th=[ 60], 99.50th=[ 62], 99.90th=[ 67], 99.95th=[ 70], | 99.99th=[ 174] bw ( KiB/s): min=34338, max=92268, per=84.26%, avg=60268.13, stdev=12283.36, samples=359 iops : min= 8584, max=23067, avg=15066.67, stdev=3070.87, samples=359 lat (usec) : 2=0.01%, 10=0.01%, 20=0.01%, 50=71.73%, 100=28.24% lat (usec) : 250=0.01%, 500=0.01%, 750=0.01% lat (msec) : 2=0.01% cpu : usr=12.96%, sys=26.87%, ctx=3218988, majf=0, minf=10962 IO depths : 1=116.8%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=0,3218724,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 read-4k-seq: (groupid=2, jobs=1): err= 0: pid=523114: Thu Sep 6 21:04:12 2018 read: IOPS=18.0k, BW=74.0MiB/s (77.6MB/s)(13.0GiB/180001msec) slat (usec): min=4, max=109, avg= 9.62, stdev= 5.26 clat (nsec): min=1167, max=598720, avg=40146.01, stdev=8734.19 lat (usec): min=33, max=613, avg=50.06, stdev= 9.48 clat percentiles (usec): | 1.00th=[ 32], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 34], | 30.00th=[ 35], 40.00th=[ 35], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 49], 90.00th=[ 55], 95.00th=[ 57], | 99.00th=[ 60], 99.50th=[ 62], 99.90th=[ 67], 99.95th=[ 69], | 99.99th=[ 182] bw ( KiB/s): min=37686, max=95524, per=84.60%, avg=64134.40, stdev=13672.89, samples=359 iops : min= 9421, max=23881, avg=16033.24, stdev=3418.22, samples=359 lat (usec) : 2=0.01%, 10=0.01%, 20=0.02%, 50=82.37%, 100=17.59% lat (usec) : 250=0.01%, 500=0.01%, 750=0.01% cpu : usr=13.04%, sys=27.51%, ctx=3411582, majf=0, minf=43 IO depths : 1=116.6%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=3411367,0,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 randread-4k-seq: (groupid=3, jobs=1): err= 0: pid=523297: Thu Sep 6 21:04:12 2018 read: IOPS=10.2k, BW=39.7MiB/s (41.6MB/s)(7146MiB/180001msec) slat (usec): min=4, max=328, avg=15.39, stdev= 8.62 clat (nsec): min=1600, max=948792, avg=78946.53, stdev=36246.91 lat (usec): min=39, max=969, avg=94.75, stdev=37.43 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 41], | 30.00th=[ 41], 40.00th=[ 52], 50.00th=[ 70], 60.00th=[ 110], | 70.00th=[ 112], 80.00th=[ 115], 90.00th=[ 125], 95.00th=[ 127], | 99.00th=[ 133], 99.50th=[ 135], 99.90th=[ 141], 99.95th=[ 147], | 99.99th=[ 243] bw ( KiB/s): min=19918, max=49336, per=84.40%, avg=34308.52, stdev=6891.67, samples=359 iops : min= 4979, max=12334, avg=8576.75, stdev=1722.92, samples=359 lat (usec) : 2=0.01%, 10=0.01%, 20=0.01%, 50=38.06%, 100=19.88% lat (usec) : 250=42.04%, 500=0.01%, 750=0.01%, 1000=0.01% cpu : usr=8.07%, sys=21.59%, ctx=1829588, majf=0, minf=10954 IO depths : 1=116.7%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=1829296,0,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 rw-4k-seq: (groupid=4, jobs=1): err= 0: pid=523467: Thu Sep 6 21:04:12 2018 read: IOPS=10.6k, BW=41.2MiB/s (43.2MB/s)(7422MiB/180001msec) slat (usec): min=4, max=175, avg= 7.62, stdev= 4.41 clat (nsec): min=999, max=386169, avg=37090.54, stdev=7531.73 lat (usec): min=34, max=402, avg=44.93, stdev= 9.37 clat percentiles (usec): | 1.00th=[ 32], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 34], | 30.00th=[ 35], 40.00th=[ 35], 50.00th=[ 35], 60.00th=[ 36], | 70.00th=[ 36], 80.00th=[ 41], 90.00th=[ 46], 95.00th=[ 51], | 99.00th=[ 58], 99.50th=[ 64], 99.90th=[ 126], 99.95th=[ 133], | 99.99th=[ 186] bw ( KiB/s): min=18346, max=47911, per=84.69%, avg=35759.35, stdev=7636.24, samples=359 iops : min= 4586, max=11977, avg=8939.47, stdev=1909.07, samples=359 write: IOPS=10.6k, BW=41.3MiB/s (43.3MB/s)(7432MiB/180001msec) slat (usec): min=4, max=124, avg= 8.03, stdev= 4.59 clat (nsec): min=930, max=415124, avg=38315.31, stdev=7714.47 lat (usec): min=34, max=420, avg=46.58, stdev= 9.63 clat percentiles (usec): | 1.00th=[ 33], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 35], | 30.00th=[ 36], 40.00th=[ 36], 50.00th=[ 36], 60.00th=[ 37], | 70.00th=[ 38], 80.00th=[ 42], 90.00th=[ 48], 95.00th=[ 52], | 99.00th=[ 59], 99.50th=[ 65], 99.90th=[ 126], 99.95th=[ 135], | 99.99th=[ 188] bw ( KiB/s): min=17621, max=48232, per=84.69%, avg=35806.86, stdev=7665.42, samples=359 iops : min= 4405, max=12058, avg=8951.34, stdev=1916.38, samples=359 lat (nsec) : 1000=0.01% lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=93.43% lat (usec) : 100=6.31%, 250=0.26%, 500=0.01% cpu : usr=8.37%, sys=23.38%, ctx=3802939, majf=0, minf=65 IO depths : 1=116.4%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=1900151,1902601,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 randrw-4k-seq: (groupid=5, jobs=1): err= 0: pid=523653: Thu Sep 6 21:04:12 2018 read: IOPS=7074, BW=27.6MiB/s (28.0MB/s)(4975MiB/180001msec) slat (usec): min=4, max=262, avg= 7.98, stdev= 4.21 clat (nsec): min=997, max=3668.1k, avg=81093.27, stdev=62746.00 lat (usec): min=40, max=3673, avg=89.31, stdev=62.95 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 39], 10.00th=[ 40], 20.00th=[ 41], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 97], 60.00th=[ 100], | 70.00th=[ 108], 80.00th=[ 114], 90.00th=[ 120], 95.00th=[ 122], | 99.00th=[ 178], 99.50th=[ 359], 99.90th=[ 963], 99.95th=[ 1139], | 99.99th=[ 1369] bw ( KiB/s): min=14378, max=31413, per=84.37%, avg=23876.82, stdev=4781.00, samples=359 iops : min= 3594, max= 7853, avg=5968.83, stdev=1195.24, samples=359 write: IOPS=7082, BW=27.7MiB/s (29.0MB/s)(4980MiB/180001msec) slat (usec): min=4, max=281, avg= 8.39, stdev= 4.44 clat (nsec): min=1008, max=1218.7k, avg=39034.41, stdev=9287.66 lat (usec): min=34, max=1244, avg=47.67, stdev=10.69 clat percentiles (usec): | 1.00th=[ 33], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 35], | 30.00th=[ 36], 40.00th=[ 36], 50.00th=[ 36], 60.00th=[ 37], | 70.00th=[ 40], 80.00th=[ 43], 90.00th=[ 49], 95.00th=[ 52], | 99.00th=[ 66], 99.50th=[ 102], 99.90th=[ 137], 99.95th=[ 159], | 99.99th=[ 204] bw ( KiB/s): min=14688, max=31674, per=84.38%, avg=23905.17, stdev=4821.29, samples=359 iops : min= 3672, max= 7918, avg=5975.94, stdev=1205.33, samples=359 lat (nsec) : 1000=0.01% lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=67.54% lat (usec) : 100=12.14%, 250=19.99%, 500=0.14%, 750=0.07%, 1000=0.07% lat (msec) : 2=0.04%, 4=0.01% cpu : usr=6.60%, sys=16.45%, ctx=2548443, majf=0, minf=10955 IO depths : 1=116.8%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=1273501,1274843,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 write-128k-seq: (groupid=6, jobs=1): err= 0: pid=523853: Thu Sep 6 21:04:12 2018 write: IOPS=3073, BW=384MiB/s (403MB/s)(67.5GiB/180001msec) slat (usec): min=11, max=189, avg=29.06, stdev=10.04 clat (usec): min=181, max=2766, avg=293.12, stdev=91.00 lat (usec): min=282, max=2787, avg=322.45, stdev=91.74 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 273], 10.00th=[ 277], 20.00th=[ 281], | 30.00th=[ 285], 40.00th=[ 285], 50.00th=[ 289], 60.00th=[ 289], | 70.00th=[ 289], 80.00th=[ 293], 90.00th=[ 297], 95.00th=[ 306], | 99.00th=[ 379], 99.50th=[ 400], 99.90th=[ 2638], 99.95th=[ 2638], | 99.99th=[ 2671] bw ( KiB/s): min=199951, max=437702, per=84.57%, avg=332742.60, stdev=65911.76, samples=359 iops : min= 1562, max= 3419, avg=2599.09, stdev=514.96, samples=359 lat (usec) : 250=0.01%, 500=99.75%, 750=0.03%, 1000=0.01% lat (msec) : 2=0.10%, 4=0.12% cpu : usr=2.91%, sys=9.85%, ctx=553363, majf=0, minf=183 IO depths : 1=116.6%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=0,553272,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 randwrite-128k-seq: (groupid=7, jobs=1): err= 0: pid=524033: Thu Sep 6 21:04:12 2018 write: IOPS=3050, BW=381MiB/s (400MB/s)(67.0GiB/180001msec) slat (usec): min=11, max=174, avg=28.81, stdev= 9.72 clat (usec): min=156, max=6333, avg=295.09, stdev=95.96 lat (usec): min=282, max=6347, avg=324.19, stdev=96.57 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 277], 10.00th=[ 277], 20.00th=[ 285], | 30.00th=[ 285], 40.00th=[ 285], 50.00th=[ 289], 60.00th=[ 289], | 70.00th=[ 289], 80.00th=[ 293], 90.00th=[ 297], 95.00th=[ 318], | 99.00th=[ 388], 99.50th=[ 404], 99.90th=[ 2442], 99.95th=[ 2638], | 99.99th=[ 2671] bw ( KiB/s): min=195258, max=418720, per=84.44%, avg=329674.49, stdev=65444.72, samples=359 iops : min= 1525, max= 3271, avg=2575.13, stdev=511.34, samples=359 lat (usec) : 250=0.01%, 500=99.72%, 750=0.02%, 1000=0.01% lat (msec) : 2=0.12%, 4=0.13%, 10=0.01% cpu : usr=3.25%, sys=9.65%, ctx=549125, majf=0, minf=478 IO depths : 1=116.9%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=0,549026,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 read-128k-seq: (groupid=8, jobs=1): err= 0: pid=524216: Thu Sep 6 21:04:12 2018 read: IOPS=3345, BW=418MiB/s (438MB/s)(73.5GiB/180001msec) slat (usec): min=10, max=130, avg=27.11, stdev=10.63 clat (usec): min=143, max=674, avg=269.13, stdev=13.62 lat (usec): min=266, max=711, avg=296.48, stdev=18.27 clat percentiles (usec): | 1.00th=[ 258], 5.00th=[ 260], 10.00th=[ 260], 20.00th=[ 262], | 30.00th=[ 265], 40.00th=[ 269], 50.00th=[ 269], 60.00th=[ 269], | 70.00th=[ 269], 80.00th=[ 273], 90.00th=[ 273], 95.00th=[ 281], | 99.00th=[ 338], 99.50th=[ 367], 99.90th=[ 388], 99.95th=[ 408], | 99.99th=[ 457] bw ( KiB/s): min=212203, max=464258, per=84.48%, avg=361732.63, stdev=72122.45, samples=359 iops : min= 1657, max= 3627, avg=2825.55, stdev=563.44, samples=359 lat (usec) : 250=0.08%, 500=99.92%, 750=0.01% cpu : usr=1.61%, sys=11.20%, ctx=602247, majf=0, minf=136 IO depths : 1=116.6%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=602159,0,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 randread-128k-seq: (groupid=9, jobs=1): err= 0: pid=524397: Thu Sep 6 21:04:12 2018 read: IOPS=2705, BW=338MiB/s (355MB/s)(59.5GiB/180001msec) slat (usec): min=9, max=196, avg=26.70, stdev= 9.83 clat (usec): min=201, max=712, avg=339.37, stdev=41.87 lat (usec): min=278, max=741, avg=366.34, stdev=43.17 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 277], 10.00th=[ 281], 20.00th=[ 285], | 30.00th=[ 306], 40.00th=[ 351], 50.00th=[ 359], 60.00th=[ 363], | 70.00th=[ 367], 80.00th=[ 367], 90.00th=[ 371], 95.00th=[ 383], | 99.00th=[ 445], 99.50th=[ 469], 99.90th=[ 537], 99.95th=[ 586], | 99.99th=[ 635] bw ( KiB/s): min=174142, max=375708, per=84.55%, avg=292834.03, stdev=57778.13, samples=359 iops : min= 1360, max= 2935, avg=2287.30, stdev=451.41, samples=359 lat (usec) : 250=0.01%, 500=99.82%, 750=0.18% cpu : usr=1.67%, sys=9.02%, ctx=487148, majf=0, minf=480 IO depths : 1=116.7%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=487063,0,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 rw-128k-seq: (groupid=10, jobs=1): err= 0: pid=524573: Thu Sep 6 21:04:12 2018 read: IOPS=1482, BW=185MiB/s (194MB/s)(32.6GiB/180001msec) slat (usec): min=9, max=147, avg=26.46, stdev=10.03 clat (usec): min=150, max=3170, avg=322.82, stdev=164.16 lat (usec): min=265, max=3202, avg=349.53, stdev=164.29 clat percentiles (usec): | 1.00th=[ 258], 5.00th=[ 260], 10.00th=[ 262], 20.00th=[ 265], | 30.00th=[ 269], 40.00th=[ 269], 50.00th=[ 269], 60.00th=[ 273], | 70.00th=[ 273], 80.00th=[ 281], 90.00th=[ 433], 95.00th=[ 685], | 99.00th=[ 1045], 99.50th=[ 1074], 99.90th=[ 1188], 99.95th=[ 1696], | 99.99th=[ 2212] bw ( KiB/s): min=94631, max=205371, per=84.41%, avg=160164.63, stdev=32069.12, samples=359 iops : min= 739, max= 1604, avg=1250.79, stdev=250.54, samples=359 write: IOPS=1483, BW=185MiB/s (194MB/s)(32.6GiB/180001msec) slat (usec): min=9, max=110, avg=29.73, stdev= 9.44 clat (usec): min=252, max=2678, avg=289.33, stdev=27.50 lat (usec): min=280, max=2710, avg=319.33, stdev=29.83 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 273], 10.00th=[ 277], 20.00th=[ 281], | 30.00th=[ 285], 40.00th=[ 285], 50.00th=[ 289], 60.00th=[ 289], | 70.00th=[ 289], 80.00th=[ 293], 90.00th=[ 297], 95.00th=[ 306], | 99.00th=[ 363], 99.50th=[ 388], 99.90th=[ 429], 99.95th=[ 490], | 99.99th=[ 1631] bw ( KiB/s): min=90981, max=211602, per=84.44%, avg=160289.47, stdev=32426.07, samples=359 iops : min= 710, max= 1653, avg=1251.79, stdev=253.36, samples=359 lat (usec) : 250=0.04%, 500=95.58%, 750=2.47%, 1000=0.78% lat (msec) : 2=1.12%, 4=0.01% cpu : usr=2.87%, sys=9.12%, ctx=533862, majf=0, minf=138 IO depths : 1=116.6%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=266845,266942,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 randrw-128k-seq: (groupid=11, jobs=1): err= 0: pid=524751: Thu Sep 6 21:04:12 2018 read: IOPS=1234, BW=154MiB/s (162MB/s)(27.1GiB/180001msec) slat (usec): min=11, max=162, avg=28.93, stdev= 9.44 clat (usec): min=165, max=4179, avg=450.08, stdev=299.63 lat (usec): min=281, max=4216, avg=479.27, stdev=299.75 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 281], 10.00th=[ 281], 20.00th=[ 289], | 30.00th=[ 334], 40.00th=[ 359], 50.00th=[ 363], 60.00th=[ 367], | 70.00th=[ 371], 80.00th=[ 392], 90.00th=[ 898], 95.00th=[ 1221], | 99.00th=[ 1516], 99.50th=[ 1565], 99.90th=[ 2245], 99.95th=[ 2966], | 99.99th=[ 3458] bw ( KiB/s): min=74558, max=174804, per=84.55%, avg=133638.98, stdev=26612.71, samples=359 iops : min= 582, max= 1365, avg=1043.58, stdev=207.92, samples=359 write: IOPS=1238, BW=155MiB/s (162MB/s)(27.2GiB/180001msec) slat (usec): min=11, max=145, avg=31.98, stdev= 8.99 clat (usec): min=260, max=2642, avg=289.81, stdev=16.90 lat (usec): min=283, max=2678, avg=322.07, stdev=19.73 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 277], 10.00th=[ 277], 20.00th=[ 285], | 30.00th=[ 285], 40.00th=[ 285], 50.00th=[ 289], 60.00th=[ 289], | 70.00th=[ 289], 80.00th=[ 293], 90.00th=[ 297], 95.00th=[ 306], | 99.00th=[ 367], 99.50th=[ 392], 99.90th=[ 412], 99.95th=[ 433], | 99.99th=[ 469] bw ( KiB/s): min=84985, max=176453, per=84.61%, avg=134145.23, stdev=26930.58, samples=359 iops : min= 663, max= 1378, avg=1047.53, stdev=210.44, samples=359 lat (usec) : 250=0.01%, 500=92.44%, 750=1.92%, 1000=1.25% lat (msec) : 2=4.32%, 4=0.07%, 10=0.01% cpu : usr=2.67%, sys=8.30%, ctx=445318, majf=0, minf=478 IO depths : 1=116.7%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=222266,222947,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 write-1024k-seq: (groupid=12, jobs=1): err= 0: pid=524941: Thu Sep 6 21:04:12 2018 write: IOPS=466, BW=467MiB/s (489MB/s)(82.0GiB/180002msec) slat (usec): min=44, max=306, avg=69.44, stdev= 9.86 clat (usec): min=1929, max=8406, avg=2069.23, stdev=384.78 lat (usec): min=2038, max=8461, avg=2138.98, stdev=384.98 clat percentiles (usec): | 1.00th=[ 2008], 5.00th=[ 2008], 10.00th=[ 2008], 20.00th=[ 2024], | 30.00th=[ 2024], 40.00th=[ 2024], 50.00th=[ 2024], 60.00th=[ 2040], | 70.00th=[ 2040], 80.00th=[ 2040], 90.00th=[ 2057], 95.00th=[ 2089], | 99.00th=[ 2147], 99.50th=[ 6259], 99.90th=[ 6456], 99.95th=[ 6652], | 99.99th=[ 8094] bw ( KiB/s): min=246093, max=492267, per=84.50%, avg=403817.85, stdev=79686.54, samples=359 iops : min= 240, max= 480, avg=393.75, stdev=77.74, samples=359 lat (msec) : 2=1.04%, 4=98.18%, 10=0.78% cpu : usr=1.65%, sys=2.31%, ctx=84063, majf=0, minf=542 IO depths : 1=116.5%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=0,84005,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 randwrite-1024k-seq: (groupid=13, jobs=1): err= 0: pid=525262: Thu Sep 6 21:04:12 2018 write: IOPS=460, BW=460MiB/s (483MB/s)(80.9GiB/180001msec) slat (usec): min=46, max=255, avg=68.20, stdev=10.60 clat (usec): min=1956, max=11413, avg=2098.95, stdev=431.64 lat (usec): min=2045, max=11471, avg=2167.50, stdev=431.48 clat percentiles (usec): | 1.00th=[ 2008], 5.00th=[ 2008], 10.00th=[ 2024], 20.00th=[ 2024], | 30.00th=[ 2024], 40.00th=[ 2040], 50.00th=[ 2040], 60.00th=[ 2057], | 70.00th=[ 2073], 80.00th=[ 2089], 90.00th=[ 2114], 95.00th=[ 2114], | 99.00th=[ 4621], 99.50th=[ 6063], 99.90th=[ 7570], 99.95th=[ 7898], | 99.99th=[ 8717] bw ( KiB/s): min=244008, max=486036, per=84.68%, avg=399187.73, stdev=79197.50, samples=359 iops : min= 238, max= 474, avg=389.27, stdev=77.29, samples=359 lat (msec) : 2=0.94%, 4=97.87%, 10=1.19%, 20=0.01% cpu : usr=1.49%, sys=2.64%, ctx=82941, majf=0, minf=1138 IO depths : 1=116.8%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=0,82868,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 read-1024k-seq: (groupid=14, jobs=1): err= 0: pid=525447: Thu Sep 6 21:04:12 2018 read: IOPS=502, BW=502MiB/s (527MB/s)(88.3GiB/180001msec) slat (usec): min=44, max=225, avg=63.51, stdev= 9.73 clat (usec): min=1796, max=3408, avg=1923.85, stdev=28.07 lat (usec): min=1927, max=3475, avg=1987.68, stdev=27.24 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 1893], 10.00th=[ 1909], 20.00th=[ 1909], | 30.00th=[ 1909], 40.00th=[ 1909], 50.00th=[ 1909], 60.00th=[ 1926], | 70.00th=[ 1926], 80.00th=[ 1926], 90.00th=[ 1975], 95.00th=[ 1975], | 99.00th=[ 2008], 99.50th=[ 2024], 99.90th=[ 2057], 99.95th=[ 2114], | 99.99th=[ 2376] bw ( KiB/s): min=260692, max=527641, per=84.53%, avg=434736.94, stdev=84455.29, samples=359 iops : min= 254, max= 515, avg=424.13, stdev=82.59, samples=359 lat (msec) : 2=98.72%, 4=1.28% cpu : usr=0.45%, sys=3.60%, ctx=90455, majf=0, minf=1340 IO depths : 1=116.5%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=90401,0,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 randread-1024k-seq: (groupid=15, jobs=1): err= 0: pid=525622: Thu Sep 6 21:04:12 2018 read: IOPS=482, BW=483MiB/s (506MB/s)(84.9GiB/180001msec) slat (usec): min=43, max=870, avg=60.31, stdev=10.55 clat (usec): min=1776, max=4142, avg=2005.86, stdev=63.27 lat (usec): min=1913, max=4198, avg=2066.52, stdev=61.58 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 1893], 10.00th=[ 1909], 20.00th=[ 1958], | 30.00th=[ 1991], 40.00th=[ 1991], 50.00th=[ 2008], 60.00th=[ 2008], | 70.00th=[ 2040], 80.00th=[ 2073], 90.00th=[ 2073], 95.00th=[ 2089], | 99.00th=[ 2147], 99.50th=[ 2180], 99.90th=[ 2311], 99.95th=[ 2376], | 99.99th=[ 2540] bw ( KiB/s): min=254435, max=514081, per=84.75%, avg=419071.96, stdev=85470.51, samples=359 iops : min= 248, max= 502, avg=408.59, stdev=83.27, samples=359 lat (msec) : 2=43.82%, 4=56.17%, 10=0.01% cpu : usr=0.42%, sys=3.59%, ctx=87006, majf=0, minf=1419 IO depths : 1=116.7%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=86918,0,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 rw-1024k-seq: (groupid=16, jobs=1): err= 0: pid=525798: Thu Sep 6 21:04:12 2018 read: IOPS=228, BW=228MiB/s (239MB/s)(40.1GiB/180001msec) slat (usec): min=47, max=176, avg=56.74, stdev= 5.21 clat (usec): min=1888, max=6881, avg=2208.50, stdev=423.25 lat (usec): min=1947, max=6939, avg=2265.64, stdev=423.33 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 1926], 10.00th=[ 1942], 20.00th=[ 1975], | 30.00th=[ 1975], 40.00th=[ 1991], 50.00th=[ 1991], 60.00th=[ 1991], | 70.00th=[ 2008], 80.00th=[ 2835], 90.00th=[ 2868], 95.00th=[ 2900], | 99.00th=[ 3130], 99.50th=[ 3851], 99.90th=[ 4752], 99.95th=[ 5276], | 99.99th=[ 6652] bw ( KiB/s): min=102191, max=275692, per=84.54%, avg=197504.69, stdev=40261.88, samples=359 iops : min= 99, max= 269, avg=192.39, stdev=39.33, samples=359 write: IOPS=222, BW=223MiB/s (234MB/s)(39.2GiB/180001msec) slat (usec): min=45, max=248, avg=57.38, stdev= 5.66 clat (usec): min=1979, max=8237, avg=2103.54, stdev=238.23 lat (usec): min=2048, max=8293, avg=2161.33, stdev=238.30 clat percentiles (usec): | 1.00th=[ 2024], 5.00th=[ 2040], 10.00th=[ 2040], 20.00th=[ 2073], | 30.00th=[ 2089], 40.00th=[ 2089], 50.00th=[ 2089], 60.00th=[ 2089], | 70.00th=[ 2114], 80.00th=[ 2114], 90.00th=[ 2114], 95.00th=[ 2147], | 99.00th=[ 2245], 99.50th=[ 2507], 99.90th=[ 6587], 99.95th=[ 6652], | 99.99th=[ 7767] bw ( KiB/s): min=131815, max=275291, per=84.70%, avg=193207.96, stdev=40845.06, samples=359 iops : min= 128, max= 268, avg=188.18, stdev=39.91, samples=359 lat (msec) : 2=32.66%, 4=67.03%, 10=0.31% cpu : usr=0.69%, sys=3.25%, ctx=81330, majf=0, minf=809 IO depths : 1=116.9%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=41068,40096,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 randrw-1024k-seq: (groupid=17, jobs=1): err= 0: pid=525981: Thu Sep 6 21:04:12 2018 read: IOPS=220, BW=220MiB/s (231MB/s)(38.7GiB/180002msec) slat (usec): min=46, max=188, avg=64.90, stdev= 9.58 clat (usec): min=1862, max=8308, avg=2318.99, stdev=543.33 lat (usec): min=1917, max=8377, avg=2384.23, stdev=543.50 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 1893], 10.00th=[ 1909], 20.00th=[ 1975], | 30.00th=[ 1991], 40.00th=[ 2008], 50.00th=[ 2008], 60.00th=[ 2024], | 70.00th=[ 2343], 80.00th=[ 2933], 90.00th=[ 3228], 95.00th=[ 3294], | 99.00th=[ 3720], 99.50th=[ 3916], 99.90th=[ 4883], 99.95th=[ 5473], | 99.99th=[ 6718] bw ( KiB/s): min=184689, max=275135, per=100.00%, avg=226709.25, stdev=15926.11, samples=360 iops : min= 180, max= 268, avg=221.14, stdev=15.52, samples=360 write: IOPS=219, BW=220MiB/s (231MB/s)(38.7GiB/180002msec) slat (usec): min=42, max=282, avg=90.68, stdev=19.48 clat (usec): min=1910, max=9777, avg=2058.24, stdev=230.25 lat (usec): min=2038, max=9851, avg=2149.26, stdev=230.19 clat percentiles (usec): | 1.00th=[ 2008], 5.00th=[ 2008], 10.00th=[ 2008], 20.00th=[ 2024], | 30.00th=[ 2024], 40.00th=[ 2024], 50.00th=[ 2040], 60.00th=[ 2040], | 70.00th=[ 2040], 80.00th=[ 2057], 90.00th=[ 2089], 95.00th=[ 2114], | 99.00th=[ 2245], 99.50th=[ 3032], 99.90th=[ 5932], 99.95th=[ 6980], | 99.99th=[ 8586] bw ( KiB/s): min=184320, max=284903, per=100.00%, avg=226310.91, stdev=15907.82, samples=360 iops : min= 180, max= 278, avg=220.76, stdev=15.47, samples=360 lat (msec) : 2=19.49%, 4=80.12%, 10=0.38% cpu : usr=1.49%, sys=2.67%, ctx=79319, majf=0, minf=574 IO depths : 1=116.9%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=39657,39588,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): WRITE: bw=71.6MiB/s (75.1MB/s), 71.6MiB/s-71.6MiB/s (75.1MB/s-75.1MB/s), io=12.6GiB (13.5GB), run=180001-180001msec Run status group 1 (all jobs): WRITE: bw=69.8MiB/s (73.2MB/s), 69.8MiB/s-69.8MiB/s (73.2MB/s-73.2MB/s), io=12.3GiB (13.2GB), run=180001-180001msec Run status group 2 (all jobs): READ: bw=74.0MiB/s (77.6MB/s), 74.0MiB/s-74.0MiB/s (77.6MB/s-77.6MB/s), io=13.0GiB (13.0GB), run=180001-180001msec Run status group 3 (all jobs): READ: bw=39.7MiB/s (41.6MB/s), 39.7MiB/s-39.7MiB/s (41.6MB/s-41.6MB/s), io=7146MiB (7493MB), run=180001-180001msec Run status group 4 (all jobs): READ: bw=41.2MiB/s (43.2MB/s), 41.2MiB/s-41.2MiB/s (43.2MB/s-43.2MB/s), io=7422MiB (7783MB), run=180001-180001msec WRITE: bw=41.3MiB/s (43.3MB/s), 41.3MiB/s-41.3MiB/s (43.3MB/s-43.3MB/s), io=7432MiB (7793MB), run=180001-180001msec Run status group 5 (all jobs): READ: bw=27.6MiB/s (28.0MB/s), 27.6MiB/s-27.6MiB/s (28.0MB/s-28.0MB/s), io=4975MiB (5216MB), run=180001-180001msec WRITE: bw=27.7MiB/s (29.0MB/s), 27.7MiB/s-27.7MiB/s (29.0MB/s-29.0MB/s), io=4980MiB (5222MB), run=180001-180001msec Run status group 6 (all jobs): WRITE: bw=384MiB/s (403MB/s), 384MiB/s-384MiB/s (403MB/s-403MB/s), io=67.5GiB (72.5GB), run=180001-180001msec Run status group 7 (all jobs): WRITE: bw=381MiB/s (400MB/s), 381MiB/s-381MiB/s (400MB/s-400MB/s), io=67.0GiB (71.0GB), run=180001-180001msec Run status group 8 (all jobs): READ: bw=418MiB/s (438MB/s), 418MiB/s-418MiB/s (438MB/s-438MB/s), io=73.5GiB (78.9GB), run=180001-180001msec Run status group 9 (all jobs): READ: bw=338MiB/s (355MB/s), 338MiB/s-338MiB/s (355MB/s-355MB/s), io=59.5GiB (63.8GB), run=180001-180001msec Run status group 10 (all jobs): READ: bw=185MiB/s (194MB/s), 185MiB/s-185MiB/s (194MB/s-194MB/s), io=32.6GiB (34.0GB), run=180001-180001msec WRITE: bw=185MiB/s (194MB/s), 185MiB/s-185MiB/s (194MB/s-194MB/s), io=32.6GiB (34.0GB), run=180001-180001msec Run status group 11 (all jobs): READ: bw=154MiB/s (162MB/s), 154MiB/s-154MiB/s (162MB/s-162MB/s), io=27.1GiB (29.1GB), run=180001-180001msec WRITE: bw=155MiB/s (162MB/s), 155MiB/s-155MiB/s (162MB/s-162MB/s), io=27.2GiB (29.2GB), run=180001-180001msec Run status group 12 (all jobs): WRITE: bw=467MiB/s (489MB/s), 467MiB/s-467MiB/s (489MB/s-489MB/s), io=82.0GiB (88.1GB), run=180002-180002msec Run status group 13 (all jobs): WRITE: bw=460MiB/s (483MB/s), 460MiB/s-460MiB/s (483MB/s-483MB/s), io=80.9GiB (86.9GB), run=180001-180001msec Run status group 14 (all jobs): READ: bw=502MiB/s (527MB/s), 502MiB/s-502MiB/s (527MB/s-527MB/s), io=88.3GiB (94.8GB), run=180001-180001msec Run status group 15 (all jobs): READ: bw=483MiB/s (506MB/s), 483MiB/s-483MiB/s (506MB/s-506MB/s), io=84.9GiB (91.1GB), run=180001-180001msec Run status group 16 (all jobs): READ: bw=228MiB/s (239MB/s), 228MiB/s-228MiB/s (239MB/s-239MB/s), io=40.1GiB (43.1GB), run=180001-180001msec WRITE: bw=223MiB/s (234MB/s), 223MiB/s-223MiB/s (234MB/s-234MB/s), io=39.2GiB (42.0GB), run=180001-180001msec Run status group 17 (all jobs): READ: bw=220MiB/s (231MB/s), 220MiB/s-220MiB/s (231MB/s-231MB/s), io=38.7GiB (41.6GB), run=180002-180002msec WRITE: bw=220MiB/s (231MB/s), 220MiB/s-220MiB/s (231MB/s-231MB/s), io=38.7GiB (41.5GB), run=180002-180002msec Disk stats (read/write): sdf: ios=12257057/13750689, merge=0/0, ticks=2104831/1913742, in_queue=3997081, util=88.83% _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com