Re: Initial performance cluster SimpleMessenger vs AsyncMessenger results

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Mark,

Thanks for this data. This means probably simple messenger (not OSD core) is not doing optimal job of handling memory.

 

Haomai,

I am not that familiar with Async messenger code base, do you have an explanation of the behavior (like good performance with default tcmalloc) Mark reported ? Is it using lot less thread overall than Simple ?

Also, it seems Async messenger has some inefficiencies in the io path and that’s why it is not performing as well as simple if the memory allocation stuff is optimally handled.

Could you please send out any documentation around Async messenger ? I tried to google it , but, not even blueprint is popping up.

 

 

Thanks & Regards

Somnath

From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Haomai Wang
Sent: Monday, October 12, 2015 7:57 PM
To: Mark Nelson
Cc: ceph-devel; ceph-users@xxxxxxxxxxxxxx
Subject: Re: [ceph-users] Initial performance cluster SimpleMessenger vs AsyncMessenger results

 

COOL

 

Interesting that async messenger will consume more memory than simple, in my mind I always think async should use less memory. I will give a look at this

 

On Tue, Oct 13, 2015 at 12:50 AM, Mark Nelson <mnelson@xxxxxxxxxx> wrote:

Hi Guy,

Given all of the recent data on how different memory allocator configurations improve SimpleMessenger performance (and the effect of memory allocators and transparent hugepages on RSS memory usage), I thought I'd run some tests looking how AsyncMessenger does in comparison.  We spoke about these a bit at the last performance meeting but here's the full write up.  The rough conclusion as of right now appears to be:

1) AsyncMessenger performance is not dependent on the memory allocator like with SimpleMessenger.

2) AsyncMessenger is faster than SimpleMessenger with TCMalloc + 32MB (ie default) thread cache.

3) AsyncMessenger is consistently faster than SimpleMessenger for 128K random reads.

4) AsyncMessenger is sometimes slower than SimpleMessenger when memory allocator optimizations are used.

5) AsyncMessenger currently uses far more RSS memory than SimpleMessenger.

Here's a link to the paper:

https://drive.google.com/file/d/0B2gTBZrkrnpZS1Q4VktjZkhrNHc/view

Mark
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



 

--

Best Regards,

Wheat




PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies).

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux