Hi, guys.
I made a few tests and i see that performance is better if osd_journal_aio=false for LV-journals.
Setup:
2 servers x 4 OSD (SATA HDD + journal on SSD LV)
12.2.5, filestore
cluster:
id: ce305aae-4c56-41ec-be54-529b05eb45ed
health: HEALTH_OK
services:
mon: 2 daemons, quorum a,b
mgr: a(active), standbys: b
osd: 8 osds: 8 up, 8 in
data:
pools: 1 pools, 512 pgs
objects: 0 objects, 0 bytes
usage: 904 MB used, 11440 GB / 11441 GB avail
pgs: 512 active+clean
0 objects before each test.
I used rados bench from two servers in parralel:
2x of:
rados bench -p test 30 write -b 1M -t 32
I ran each test four times.
file-journal on XFS FS, dio=1, aio=0:
Average IOPS: 102.5
Average Latency(s): 0.30
LV-journal, dio=1, aio=1:
Average IOPS: 96.5
Average Latency(s): 32.5
LV-journal, dio=1, aio=0:
Average IOPS: 104
Average Latency(s): 0.30
Is It safe to disable aio on LV journals? Is it make sence?
|
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com