Re: Ceph Hackathon: More Memory Allocator Testing

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Nope!  So in this case it's just server side.

On 08/19/2015 01:33 AM, Stefan Priebe - Profihost AG wrote:

Thanks for sharing. Do those tests use jemalloc for fio too? Otherwise
librbd on client side is running with tcmalloc again.

Stefan

Am 19.08.2015 um 06:45 schrieb Mark Nelson:
Hi Everyone,

One of the goals at the Ceph Hackathon last week was to examine how to
improve Ceph Small IO performance.  Jian Zhang presented findings
showing a dramatic improvement in small random IO performance when Ceph
is used with jemalloc.  His results build upon Sandisk's original
findings that the default thread cache values are a major bottleneck in
TCMalloc 2.1.  To further verify these results, we sat down at the
Hackathon and configured the new performance test cluster that Intel
generously donated to the Ceph community laboratory to run through a
variety of tests with different memory allocator configurations.  I've
since written the results of those tests up in pdf form for folks who
are interested.

The results are located here:

http://nhm.ceph.com/hackathon/Ceph_Hackathon_Memory_Allocator_Testing.pdf

I want to be clear that many other folks have done the heavy lifting
here.  These results are simply a validation of the many tests that
other folks have already done.  Many thanks to Sandisk and others for
figuring this out as it's a pretty big deal!

Side note:  Very little tuning other than swapping the memory allocator
and a couple of quick and dirty ceph tunables were set during these
tests. It's quite possible that higher IOPS will be achieved as we
really start digging into the cluster and learning what the bottlenecks
are.

Thanks,
Mark
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux