On 29/08/14 14:06, Mark Kirkwood wrote: > > ... mounting (xfs) with nobarrier seems to get > much better results. The run below is for a single osd on an xfs > partition from an Intel 520. I'm using another 520 as a journal: > ...and adding filestore_queue_max_ops = 20000 improved IOPS a bit more: write: io=1024.0MB, bw=30647KB/s, iops=7661, runt= 34215msec I neglected to include my ceph.conf: [global] fsid = 7814a4ce-09d9-47bb-9e68-d914750395cc mon_initial_members = vedavec mon_host = 192.168.2.63 debug_lockdep = 0/0 debug_context = 0/0 debug_crush = 0/0 debug_buffer = 0/0 debug_timer = 0/0 debug_filer = 0/0 debug_objecter = 0/0 debug_rados = 0/0 debug_rbd = 0/0 debug_journaler = 0/0 debug_objectcatcher = 0/0 debug_client = 0/0 debug_osd = 0/0 debug_optracker = 0/0 debug_objclass = 0/0 debug_filestore = 0/0 debug_journal = 0/0 debug_ms = 0/0 debug_monc = 0/0 debug_tp = 0/0 debug_auth = 0/0 debug_finisher = 0/0 debug_heartbeatmap = 0/0 debug_perfcounter = 0/0 debug_asok = 0/0 debug_throttle = 0/0 debug_mon = 0/0 debug_paxos = 0/0 debug_rgw = 0/0 filestore_xattr_use_omap = true filestore max sync interval = 20 filestore_queue_max_ops = 20000 osd pool default size = 1 [osd] osd journal size = 14336 ;osd_op_complatint_time = 10 ;osd_op_threads = 4