Oh, Forget What I say,I think I speak too fast, seem to be a bug in git, as I don't see any network traffic coming from ceph cluster with I reach 20.000 iops :( After some new image creation, I have sometime 20.000iops (with no real traffic) and sometimes 5000 iops like before (and I see traffic coming from ceph cluster). I'll for next 0.54 stable before redoing tests. Regards, Alexandre ----- Mail original ----- De: "Alexandre DERUMIER" <aderumier@xxxxxxxxx> À: "ceph-devel" <ceph-devel@xxxxxxxxxxxxxxx> Cc: "Dietmar Maurer" <dietmar@xxxxxxxxxxx>, "Josh Durgin" <josh.durgin@xxxxxxxxxxx>, "Marcus Sorensen" <shadowsor@xxxxxxxxx>, "Sage Weil" <sage@xxxxxxxxxxx>, "Gregory Farnum" <greg@xxxxxxxxxxx>, "Stefan Priebe - Profihost AG" <s.priebe@xxxxxxxxxxxx> Envoyé: Samedi 3 Novembre 2012 11:01:39 Objet: slow fio random read benchmark: last librbd git : 20000iops ! Hi Everybody, I have just recompiled my qemu-kvm package with last librbd git, my iops have jumped from 5000 to 20000iops for a single fio randread benchmark ! cpu of the client seem to be the bottleneck,I'll test on a bigger cpu this week. Qemu-kvm was previously compiled with librbd 0.53. I don't know what have change ? (I don't have used stripping feature, and I have same result for image format 1 or 2). Regards, Alexandre ----- Mail original ----- De: "Alexandre DERUMIER" <aderumier@xxxxxxxxx> À: "Stefan Priebe - Profihost AG" <s.priebe@xxxxxxxxxxxx> Cc: "Dietmar Maurer" <dietmar@xxxxxxxxxxx>, "Josh Durgin" <josh.durgin@xxxxxxxxxxx>, "Marcus Sorensen" <shadowsor@xxxxxxxxx>, "Sage Weil" <sage@xxxxxxxxxxx>, "ceph-devel" <ceph-devel@xxxxxxxxxxxxxxx>, "Gregory Farnum" <greg@xxxxxxxxxxx> Envoyé: Vendredi 2 Novembre 2012 10:38:42 Objet: Re: slow fio random read benchmark, need help >>Same results with rbd kernel driver without QEMU involved. I confirm , I have same result wirh rbd kernel driver,so it not a qemu problem. ----- Mail original ----- De: "Stefan Priebe - Profihost AG" <s.priebe@xxxxxxxxxxxx> À: "Gregory Farnum" <greg@xxxxxxxxxxx> Cc: "Dietmar Maurer" <dietmar@xxxxxxxxxxx>, "Josh Durgin" <josh.durgin@xxxxxxxxxxx>, "Alexandre DERUMIER" <aderumier@xxxxxxxxx>, "Marcus Sorensen" <shadowsor@xxxxxxxxx>, "Sage Weil" <sage@xxxxxxxxxxx>, "ceph-devel" <ceph-devel@xxxxxxxxxxxxxxx> Envoyé: Jeudi 1 Novembre 2012 11:54:03 Objet: Re: slow fio random read benchmark, need help Am 01.11.2012 11:40, schrieb Gregory Farnum: > I'm not sure that latency addition is quite correct. Most use cases > cases do multiple IOs at the same time, and good benchmarks tend to > reflect that. > > I suspect the IO limitations here are a result of QEMU's storage > handling (or possibly our client layer) more than anything else — Josh > can talk about that more than I can, though! > -Greg Same results with rbd kernel driver without QEMU involved. Stefan -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html