Re: Initial performance cluster SimpleMessenger vs AsyncMessenger results

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, 13 Oct 2015, Haomai Wang wrote:
> resend
> 
> On Tue, Oct 13, 2015 at 10:56 AM, Haomai Wang <haomaiwang@xxxxxxxxx> wrote:
> > COOL
> >
> > Interesting that async messenger will consume more memory than simple, in my
> > mind I always think async should use less memory. I will give a look at this

Yeah.. I was surprised to see this as well.  The other conclusions 
are quite promising, though!

Note that we still have a few outstanding issues with async msgr that 
cropped up during the infernalis testing, so for now we're doing 
just simplemessenger to get infernalis out the door.  That gives us the 
balance of this next cycle until Jewel to shake out the remaining issues 
so that hopefully we can make this the default for Jewel!

sage


> >
> > On Tue, Oct 13, 2015 at 12:50 AM, Mark Nelson <mnelson@xxxxxxxxxx> wrote:
> >>
> >> Hi Guy,
> >>
> >> Given all of the recent data on how different memory allocator
> >> configurations improve SimpleMessenger performance (and the effect of memory
> >> allocators and transparent hugepages on RSS memory usage), I thought I'd run
> >> some tests looking how AsyncMessenger does in comparison.  We spoke about
> >> these a bit at the last performance meeting but here's the full write up.
> >> The rough conclusion as of right now appears to be:
> >>
> >> 1) AsyncMessenger performance is not dependent on the memory allocator
> >> like with SimpleMessenger.
> >>
> >> 2) AsyncMessenger is faster than SimpleMessenger with TCMalloc + 32MB (ie
> >> default) thread cache.
> >>
> >> 3) AsyncMessenger is consistently faster than SimpleMessenger for 128K
> >> random reads.
> >>
> >> 4) AsyncMessenger is sometimes slower than SimpleMessenger when memory
> >> allocator optimizations are used.
> >>
> >> 5) AsyncMessenger currently uses far more RSS memory than SimpleMessenger.
> >>
> >> Here's a link to the paper:
> >>
> >> https://drive.google.com/file/d/0B2gTBZrkrnpZS1Q4VktjZkhrNHc/view
> >>
> >> Mark
> >> _______________________________________________
> >> ceph-users mailing list
> >> ceph-users@xxxxxxxxxxxxxx
> >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
> >
> >
> >
> > --
> >
> > Best Regards,
> >
> > Wheat
> 
> 
> 
> -- 
> Best Regards,
> 
> Wheat
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@xxxxxxxxxxxxxxx
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> 
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux