On Thu, 28 Jun 2012, Alexandre DERUMIER wrote: > Hi, > maybe it can help, I'm doing same tests that stefan, > random write with 4K with 3 nodes with 5 osds (with 15K drives) > fio --filename=[disk] --direct=1 --rw=randwrite --bs=4k --size=100M --numjobs=50 --runtime=30 --group_reporting --name=file1 > > I can achieve 5500io/s (disks are not at 100%) > > cpu is around 30%idle ( 8 cores E5420 @ 2.50GHz) Have you tried adjusting 'osd op threads'? The default is 2, but bumping that to, say, 8, might give you better concurrency and throughput. "Mark Nelson" <mark.nelson@xxxxxxxxxxx> wrote: > It would be interesting to see where all your CPU time is being spent. > What benchmark are you using to do the random writes? Definitely. Seeing perf/oprofile/whatever results for the osd under that workload would be very interesting! We need to get perf going in our testing environment... sage -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html