On Thu, Jun 26, 2014 at 11:49 PM, Stefan Priebe - Profihost AG <s.priebe at profihost.ag> wrote: > Hi Greg, > > Am 26.06.2014 02:17, schrieb Gregory Farnum: >> Sorry we let this drop; we've all been busy traveling and things. >> >> There have been a lot of changes to librados between Dumpling and >> Firefly, but we have no idea what would have made it slower. Can you >> provide more details about how you were running these tests? > > it's just a normal fio run: > fio --ioengine=rbd --bs=4k --name=foo --invalidate=0 > --readwrite=randwrite --iodepth=32 --rbdname=fio_test2 --pool=teststor > --runtime=90 --numjobs=32 --direct=1 --group > > Running one time with firefly libs and one time with dumpling libs. > Traget is always the same pool on a firefly ceph storage. What's the backing cluster you're running against? What kind of CPU usage do you see with both? 25k IOPS is definitely getting up there, but I'd like some guidance about whether we're looking for a reduction in parallelism, or an increase in per-op costs, or something else. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com