@MarcThanks Marc,FIO is executed and the result attached to this email. But what is consuming me is: tell bench sometimes return for example 2~10 and some times return 170~200.If the disk is burned out why sometimes return higher value?Currently this OSD is weighted 0. So there are no any load of ceph replication, deep scrubbing and so on.
Thanks.
On Saturday, December 24, 2022 at 06:57:05 PM GMT+3:30, Marc <marc@xxxxxxxxxxxxxxxxx> wrote:
>
> In my cluster, there are several OSDs of type ordinary SSD with very
> slow iops.
I think there have been several posts here about ordinary ssd's becoming slow under specific conditions. Why do you think your 'ordinary ssds' do not have this?
What does fio say about these disks?
I think this issue was related to how long these disks were under load, so maybe increase the runtime in this fio script.
[global]
ioengine=libaio
#ioengine=posixaio
invalidate=1
ramp_time=30
iodepth=1
runtime=180
time_based
direct=1
filename=/dev/sdX
#filename=/mnt/disk/fio-bench.img
[write-4k-seq]
stonewall
bs=4k
rw=write
[randwrite-4k-seq]
stonewall
bs=4k
rw=randwrite
fsync=1
[read-4k-seq]
stonewall
bs=4k
rw=read
[randread-4k-seq]
stonewall
bs=4k
rw=randread
fsync=1
[rw-4k-seq]
stonewall
bs=4k
rw=rw
[randrw-4k-seq]
stonewall
bs=4k
rw=randrw
[randrw-4k-d4-seq]
stonewall
bs=4k
rw=randrw
iodepth=4
[randread-4k-d32-seq]
stonewall
bs=4k
rw=randread
iodepth=32
[randwrite-4k-d32-seq]
stonewall
bs=4k
rw=randwrite
iodepth=32
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
Starting 9 processes
Jobs: 1 (f=1): [_(8),w(1)][56.8%][r=0KiB/s,w=12.0MiB/s][r=0,w=3075 IOPS][eta 24m:00s]
write-4k-seq: (groupid=0, jobs=1): err= 0: pid=981791: Sat Dec 24 19:42:05 2022
write: IOPS=5431, BW=21.2MiB/s (22.2MB/s)(3819MiB/180009msec)
slat (usec): min=6, max=14441, avg=15.36, stdev=28.01
clat (usec): min=2, max=246796, avg=165.30, stdev=3408.86
lat (usec): min=50, max=246824, avg=181.09, stdev=3409.05
clat percentiles (usec):
| 1.00th=[ 45], 5.00th=[ 46], 10.00th=[ 47], 20.00th=[ 50],
| 30.00th=[ 50], 40.00th=[ 51], 50.00th=[ 51], 60.00th=[ 52],
| 70.00th=[ 53], 80.00th=[ 57], 90.00th=[ 60], 95.00th=[ 65],
| 99.00th=[ 289], 99.50th=[ 2835], 99.90th=[ 12780], 99.95th=[ 81265],
| 99.99th=[170918]
bw ( KiB/s): min= 5637, max=61792, per=76.94%, avg=16715.94, stdev=15267.22, samples=359
iops : min= 1409, max=15448, avg=4178.64, stdev=3816.91, samples=359
lat (usec) : 4=0.01%, 10=0.03%, 20=0.01%, 50=29.35%, 100=69.15%
lat (usec) : 250=0.33%, 500=0.41%, 750=0.06%, 1000=0.03%
lat (msec) : 2=0.07%, 4=0.15%, 10=0.27%, 20=0.07%, 50=0.02%
lat (msec) : 100=0.01%, 250=0.05%
cpu : usr=4.57%, sys=11.67%, ctx=977143, majf=0, minf=12
IO depths : 1=109.8%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,977746,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
randwrite-4k-seq: (groupid=1, jobs=1): err= 0: pid=985258: Sat Dec 24 19:42:05 2022
write: IOPS=3116, BW=12.2MiB/s (12.8MB/s)(2192MiB/180010msec)
slat (usec): min=6, max=6213, avg=14.46, stdev=20.61
clat (usec): min=2, max=227195, avg=296.83, stdev=5300.37
lat (usec): min=50, max=227219, avg=311.69, stdev=5300.42
clat percentiles (usec):
| 1.00th=[ 45], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 50],
| 30.00th=[ 51], 40.00th=[ 51], 50.00th=[ 51], 60.00th=[ 52],
| 70.00th=[ 53], 80.00th=[ 57], 90.00th=[ 61], 95.00th=[ 67],
| 99.00th=[ 3785], 99.50th=[ 6783], 99.90th=[ 33817], 99.95th=[173016],
| 99.99th=[187696]
bw ( KiB/s): min= 2368, max=16384, per=71.72%, avg=8940.89, stdev=2552.20, samples=359
iops : min= 592, max= 4096, avg=2234.91, stdev=638.11, samples=359
lat (usec) : 4=0.01%, 10=0.02%, 20=0.01%, 50=24.27%, 100=73.41%
lat (usec) : 250=0.37%, 500=0.37%, 750=0.07%, 1000=0.05%
lat (msec) : 2=0.14%, 4=0.34%, 10=0.66%, 20=0.17%, 50=0.03%
lat (msec) : 100=0.01%, 250=0.09%
fsync/fdatasync/sync_file_range:
sync (nsec): min=80, max=416886, avg=262.41, stdev=1558.40
sync percentiles (nsec):
| 1.00th=[ 109], 5.00th=[ 120], 10.00th=[ 129], 20.00th=[ 183],
| 30.00th=[ 211], 40.00th=[ 221], 50.00th=[ 231], 60.00th=[ 241],
| 70.00th=[ 251], 80.00th=[ 282], 90.00th=[ 394], 95.00th=[ 454],
| 99.00th=[ 660], 99.50th=[ 820], 99.90th=[ 1320], 99.95th=[ 2320],
| 99.99th=[20608]
cpu : usr=3.58%, sys=7.30%, ctx=560802, majf=0, minf=1043
IO depths : 1=235.4%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,561075,0,660403 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
read-4k-seq: (groupid=2, jobs=1): err= 0: pid=988741: Sat Dec 24 19:42:05 2022
read: IOPS=11.3k, BW=44.1MiB/s (46.2MB/s)(7933MiB/180001msec)
slat (usec): min=6, max=12710, avg=14.54, stdev=22.87
clat (nsec): min=1846, max=22023k, avg=70878.94, stdev=73155.95
lat (usec): min=43, max=22034, avg=85.83, stdev=77.61
clat percentiles (usec):
| 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 41], 20.00th=[ 44],
| 30.00th=[ 44], 40.00th=[ 44], 50.00th=[ 45], 60.00th=[ 47],
| 70.00th=[ 52], 80.00th=[ 149], 90.00th=[ 157], 95.00th=[ 163],
| 99.00th=[ 200], 99.50th=[ 322], 99.90th=[ 603], 99.95th=[ 832],
| 99.99th=[ 1565]
bw ( KiB/s): min=10928, max=74890, per=71.18%, avg=32123.88, stdev=12871.90, samples=359
iops : min= 2732, max=18722, avg=8030.63, stdev=3218.00, samples=359
lat (usec) : 2=0.01%, 4=0.01%, 10=0.03%, 20=0.01%, 50=66.43%
lat (usec) : 100=13.10%, 250=19.63%, 500=0.63%, 750=0.11%, 1000=0.04%
lat (msec) : 2=0.02%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
cpu : usr=9.13%, sys=23.49%, ctx=2029327, majf=0, minf=86
IO depths : 1=116.5%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=2030925,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
randread-4k-seq: (groupid=3, jobs=1): err= 0: pid=992044: Sat Dec 24 19:42:05 2022
read: IOPS=3499, BW=13.7MiB/s (14.3MB/s)(2461MiB/180001msec)
slat (usec): min=6, max=3869, avg=19.59, stdev=20.12
clat (usec): min=2, max=11172, avg=260.40, stdev=83.45
lat (usec): min=47, max=11885, avg=280.48, stdev=87.32
clat percentiles (usec):
| 1.00th=[ 49], 5.00th=[ 157], 10.00th=[ 210], 20.00th=[ 241],
| 30.00th=[ 255], 40.00th=[ 265], 50.00th=[ 269], 60.00th=[ 273],
| 70.00th=[ 281], 80.00th=[ 285], 90.00th=[ 289], 95.00th=[ 293],
| 99.00th=[ 482], 99.50th=[ 578], 99.90th=[ 914], 99.95th=[ 1123],
| 99.99th=[ 2540]
bw ( KiB/s): min= 6800, max=15192, per=71.13%, avg=9957.11, stdev=1692.62, samples=359
iops : min= 1700, max= 3798, avg=2488.99, stdev=423.22, samples=359
lat (usec) : 4=0.01%, 10=0.02%, 20=0.01%, 50=1.81%, 100=1.73%
lat (usec) : 250=20.83%, 500=74.74%, 750=0.69%, 1000=0.11%
lat (msec) : 2=0.06%, 4=0.01%, 10=0.01%, 20=0.01%
cpu : usr=4.30%, sys=10.28%, ctx=629749, majf=0, minf=144
IO depths : 1=116.5%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=629975,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
rw-4k-seq: (groupid=4, jobs=1): err= 0: pid=995259: Sat Dec 24 19:42:05 2022
read: IOPS=5249, BW=20.5MiB/s (21.5MB/s)(3691MiB/180001msec)
slat (usec): min=6, max=13688, avg=14.52, stdev=27.14
clat (usec): min=2, max=15923, avg=96.71, stdev=363.13
lat (usec): min=44, max=22292, avg=111.62, stdev=364.83
clat percentiles (usec):
| 1.00th=[ 39], 5.00th=[ 40], 10.00th=[ 44], 20.00th=[ 44],
| 30.00th=[ 45], 40.00th=[ 49], 50.00th=[ 53], 60.00th=[ 55],
| 70.00th=[ 63], 80.00th=[ 69], 90.00th=[ 165], 95.00th=[ 221],
| 99.00th=[ 388], 99.50th=[ 1614], 99.90th=[ 6063], 99.95th=[ 7046],
| 99.99th=[ 8225]
bw ( KiB/s): min= 5504, max=34707, per=72.42%, avg=15205.35, stdev=5871.19, samples=359
iops : min= 1376, max= 8676, avg=3801.02, stdev=1467.86, samples=359
write: IOPS=5263, BW=20.6MiB/s (21.6MB/s)(3701MiB/180001msec)
slat (usec): min=6, max=5582, avg=14.99, stdev=20.68
clat (nsec): min=1998, max=10063k, avg=57470.87, stdev=45235.85
lat (usec): min=50, max=10082, avg=72.86, stdev=50.38
clat percentiles (usec):
| 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 46], 20.00th=[ 50],
| 30.00th=[ 50], 40.00th=[ 51], 50.00th=[ 51], 60.00th=[ 51],
| 70.00th=[ 52], 80.00th=[ 57], 90.00th=[ 61], 95.00th=[ 72],
| 99.00th=[ 174], 99.50th=[ 269], 99.90th=[ 510], 99.95th=[ 693],
| 99.99th=[ 1369]
bw ( KiB/s): min= 5736, max=34611, per=72.43%, avg=15250.28, stdev=5872.93, samples=359
iops : min= 1434, max= 8652, avg=3812.23, stdev=1468.31, samples=359
lat (usec) : 2=0.01%, 4=0.01%, 10=0.03%, 20=0.01%, 50=37.15%
lat (usec) : 100=54.64%, 250=7.02%, 500=0.72%, 750=0.11%, 1000=0.04%
lat (msec) : 2=0.04%, 4=0.06%, 10=0.19%, 20=0.01%
cpu : usr=8.65%, sys=21.76%, ctx=1891161, majf=0, minf=60
IO depths : 1=110.3%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=944838,947505,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
randrw-4k-seq: (groupid=5, jobs=1): err= 0: pid=998747: Sat Dec 24 19:42:05 2022
read: IOPS=1446, BW=5787KiB/s (5926kB/s)(1017MiB/180001msec)
slat (usec): min=6, max=5542, avg=16.78, stdev=22.26
clat (usec): min=2, max=14524, avg=592.32, stdev=1252.92
lat (usec): min=47, max=14541, avg=609.53, stdev=1253.52
clat percentiles (usec):
| 1.00th=[ 48], 5.00th=[ 157], 10.00th=[ 227], 20.00th=[ 243],
| 30.00th=[ 260], 40.00th=[ 265], 50.00th=[ 269], 60.00th=[ 277],
| 70.00th=[ 281], 80.00th=[ 293], 90.00th=[ 594], 95.00th=[ 4228],
| 99.00th=[ 6718], 99.50th=[ 7635], 99.90th=[ 8586], 99.95th=[ 8848],
| 99.99th=[ 9765]
bw ( KiB/s): min= 2640, max= 7072, per=71.15%, avg=4116.75, stdev=706.08, samples=359
iops : min= 660, max= 1768, avg=1028.89, stdev=176.60, samples=359
write: IOPS=1446, BW=5787KiB/s (5926kB/s)(1017MiB/180001msec)
slat (usec): min=6, max=6296, avg=17.34, stdev=26.36
clat (usec): min=2, max=4887, avg=54.86, stdev=39.06
lat (usec): min=50, max=6358, avg=72.63, stdev=48.17
clat percentiles (usec):
| 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 46], 20.00th=[ 47],
| 30.00th=[ 50], 40.00th=[ 51], 50.00th=[ 52], 60.00th=[ 53],
| 70.00th=[ 54], 80.00th=[ 57], 90.00th=[ 62], 95.00th=[ 65],
| 99.00th=[ 98], 99.50th=[ 243], 99.90th=[ 502], 99.95th=[ 775],
| 99.99th=[ 1565]
bw ( KiB/s): min= 2864, max= 7240, per=71.13%, avg=4115.72, stdev=703.91, samples=359
iops : min= 716, max= 1810, avg=1028.59, stdev=176.08, samples=359
lat (usec) : 4=0.01%, 10=0.02%, 20=0.01%, 50=18.12%, 100=32.97%
lat (usec) : 250=9.95%, 500=32.92%, 750=1.76%, 1000=0.69%
lat (msec) : 2=0.64%, 4=0.33%, 10=2.59%, 20=0.01%
cpu : usr=3.03%, sys=7.14%, ctx=520580, majf=0, minf=1448
IO depths : 1=126.6%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=260414,260401,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
randrw-4k-d4-seq: (groupid=6, jobs=1): err= 0: pid=1003099: Sat Dec 24 19:42:05 2022
read: IOPS=2396, BW=9586KiB/s (9816kB/s)(1685MiB/180001msec)
slat (usec): min=5, max=5991, avg=14.88, stdev=22.34
clat (usec): min=5, max=20675, avg=1543.95, stdev=2144.29
lat (usec): min=46, max=20702, avg=1559.26, stdev=2144.83
clat percentiles (usec):
| 1.00th=[ 55], 5.00th=[ 229], 10.00th=[ 262], 20.00th=[ 285],
| 30.00th=[ 330], 40.00th=[ 383], 50.00th=[ 461], 60.00th=[ 594],
| 70.00th=[ 873], 80.00th=[ 3228], 90.00th=[ 5342], 95.00th=[ 6259],
| 99.00th=[ 8094], 99.50th=[ 8455], 99.90th=[ 8979], 99.95th=[ 9241],
| 99.99th=[12256]
bw ( KiB/s): min= 4432, max=11912, per=71.96%, avg=6896.99, stdev=1293.62, samples=359
iops : min= 1108, max= 2978, avg=1723.93, stdev=323.50, samples=359
write: IOPS=2398, BW=9593KiB/s (9823kB/s)(1686MiB/180001msec)
slat (usec): min=5, max=6880, avg=15.30, stdev=24.48
clat (usec): min=2, max=13822, avg=86.55, stdev=89.93
lat (usec): min=49, max=13855, avg=102.26, stdev=92.96
clat percentiles (usec):
| 1.00th=[ 45], 5.00th=[ 46], 10.00th=[ 47], 20.00th=[ 50],
| 30.00th=[ 52], 40.00th=[ 53], 50.00th=[ 58], 60.00th=[ 63],
| 70.00th=[ 77], 80.00th=[ 108], 90.00th=[ 184], 95.00th=[ 227],
| 99.00th=[ 297], 99.50th=[ 392], 99.90th=[ 750], 99.95th=[ 988],
| 99.99th=[ 1958]
bw ( KiB/s): min= 4472, max=11456, per=71.96%, avg=6902.73, stdev=1276.97, samples=359
iops : min= 1116, max= 2864, avg=1725.37, stdev=319.36, samples=359
lat (usec) : 4=0.01%, 10=0.01%, 20=0.01%, 50=9.92%, 100=30.02%
lat (usec) : 250=12.14%, 500=24.54%, 750=6.72%, 1000=2.76%
lat (msec) : 2=3.15%, 4=1.32%, 10=9.42%, 20=0.01%, 50=0.01%
cpu : usr=4.03%, sys=9.65%, ctx=654084, majf=0, minf=1803
IO depths : 1=0.1%, 2=0.1%, 4=116.7%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=431352,431669,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=4
randread-4k-d32-seq: (groupid=7, jobs=1): err= 0: pid=1006606: Sat Dec 24 19:42:05 2022
read: IOPS=18.2k, BW=71.2MiB/s (74.7MB/s)(12.5GiB/180003msec)
slat (usec): min=3, max=6499, avg= 9.63, stdev=16.81
clat (usec): min=89, max=23721, avg=1741.68, stdev=698.64
lat (usec): min=128, max=23729, avg=1751.67, stdev=698.51
clat percentiles (usec):
| 1.00th=[ 603], 5.00th=[ 840], 10.00th=[ 988], 20.00th=[ 1188],
| 30.00th=[ 1352], 40.00th=[ 1500], 50.00th=[ 1663], 60.00th=[ 1827],
| 70.00th=[ 2008], 80.00th=[ 2212], 90.00th=[ 2507], 95.00th=[ 2835],
| 99.00th=[ 4228], 99.50th=[ 4817], 99.90th=[ 6063], 99.95th=[ 6521],
| 99.99th=[ 7832]
bw ( KiB/s): min=35656, max=74243, per=71.41%, avg=52087.47, stdev=8964.94, samples=359
iops : min= 8914, max=18560, avg=13021.55, stdev=2241.31, samples=359
lat (usec) : 100=0.01%, 250=0.01%, 500=0.36%, 750=2.58%, 1000=7.57%
lat (msec) : 2=59.45%, 4=28.74%, 10=1.28%, 20=0.01%, 50=0.01%
cpu : usr=11.16%, sys=19.92%, ctx=1273217, majf=0, minf=8331
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=116.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=3282623,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
randwrite-4k-d32-seq: (groupid=8, jobs=1): err= 0: pid=1009955: Sat Dec 24 19:42:05 2022
write: IOPS=3042, BW=11.9MiB/s (12.5MB/s)(2140MiB/180073msec)
slat (usec): min=3, max=4215, avg=11.84, stdev=21.76
clat (usec): min=123, max=289636, avg=10511.40, stdev=30650.22
lat (usec): min=153, max=289642, avg=10523.66, stdev=30650.30
clat percentiles (usec):
| 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1500], 20.00th=[ 1860],
| 30.00th=[ 2245], 40.00th=[ 2573], 50.00th=[ 2966], 60.00th=[ 3523],
| 70.00th=[ 5735], 80.00th=[ 8586], 90.00th=[ 14484], 95.00th=[ 23987],
| 99.00th=[189793], 99.50th=[196084], 99.90th=[214959], 99.95th=[223347],
| 99.99th=[248513]
bw ( KiB/s): min= 8175, max=16384, per=100.00%, avg=12172.69, stdev=2490.51, samples=360
iops : min= 2043, max= 4096, avg=3043.15, stdev=622.63, samples=360
lat (usec) : 250=0.01%, 500=0.01%, 750=0.06%, 1000=0.11%
lat (msec) : 2=23.48%, 4=40.03%, 10=19.57%, 20=10.37%, 50=3.38%
lat (msec) : 100=0.08%, 250=2.91%, 500=0.01%
cpu : usr=2.37%, sys=4.58%, ctx=491104, majf=0, minf=1056
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=117.2%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=0,547840,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=21.2MiB/s (22.2MB/s), 21.2MiB/s-21.2MiB/s (22.2MB/s-22.2MB/s), io=3819MiB (4005MB), run=180009-180009msec
Run status group 1 (all jobs):
WRITE: bw=12.2MiB/s (12.8MB/s), 12.2MiB/s-12.2MiB/s (12.8MB/s-12.8MB/s), io=2192MiB (2298MB), run=180010-180010msec
Run status group 2 (all jobs):
READ: bw=44.1MiB/s (46.2MB/s), 44.1MiB/s-44.1MiB/s (46.2MB/s-46.2MB/s), io=7933MiB (8319MB), run=180001-180001msec
Run status group 3 (all jobs):
READ: bw=13.7MiB/s (14.3MB/s), 13.7MiB/s-13.7MiB/s (14.3MB/s-14.3MB/s), io=2461MiB (2580MB), run=180001-180001msec
Run status group 4 (all jobs):
READ: bw=20.5MiB/s (21.5MB/s), 20.5MiB/s-20.5MiB/s (21.5MB/s-21.5MB/s), io=3691MiB (3870MB), run=180001-180001msec
WRITE: bw=20.6MiB/s (21.6MB/s), 20.6MiB/s-20.6MiB/s (21.6MB/s-21.6MB/s), io=3701MiB (3881MB), run=180001-180001msec
Run status group 5 (all jobs):
READ: bw=5787KiB/s (5926kB/s), 5787KiB/s-5787KiB/s (5926kB/s-5926kB/s), io=1017MiB (1067MB), run=180001-180001msec
WRITE: bw=5787KiB/s (5926kB/s), 5787KiB/s-5787KiB/s (5926kB/s-5926kB/s), io=1017MiB (1067MB), run=180001-180001msec
Run status group 6 (all jobs):
READ: bw=9586KiB/s (9816kB/s), 9586KiB/s-9586KiB/s (9816kB/s-9816kB/s), io=1685MiB (1767MB), run=180001-180001msec
WRITE: bw=9593KiB/s (9823kB/s), 9593KiB/s-9593KiB/s (9823kB/s-9823kB/s), io=1686MiB (1768MB), run=180001-180001msec
Run status group 7 (all jobs):
READ: bw=71.2MiB/s (74.7MB/s), 71.2MiB/s-71.2MiB/s (74.7MB/s-74.7MB/s), io=12.5GiB (13.4GB), run=180003-180003msec
Run status group 8 (all jobs):
WRITE: bw=11.9MiB/s (12.5MB/s), 11.9MiB/s-11.9MiB/s (12.5MB/s-12.5MB/s), io=2140MiB (2244MB), run=180073-180073msec
Disk stats (read/write):
sdf: ios=8803953/4254346, merge=0/0, ticks=7911899/7201905, in_queue=11941808, util=99.87%
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
