On Wed, 9 Nov 2016, LIU, Fei wrote: > Hi Sage， > Yes, Totally understood. 25G RDMA network for Ceph cluster is built for > interal test. Xio messenger and Async messenger(But it can only support > infiniband,right) are going to be two options. We are carefully evaluate > both of these two options. But the most important goal in the end is to see > how bluestore works with rdma to bring down the total latency for workload > like OLTP. > > Hi Haomai, > Would you mind let us know when the async messenger is going to support > ethernet if not support yet? The default async backend is PosixStack which is all TCP-based. (And async is now the default messenger in kraken.) sage > > Regards, > James > ------------------------------------------------------------------ > From:Sage Weil <sweil@xxxxxxxxxx> > Time:2016 Nov 8 (Tue) 13:19 > To:James <james.liu@xxxxxxxxxxxxxxx> > Subject:Re: 25G RDMA networking thoughts??? > > [adding ceph-devel] > > On Wed, 9 Nov 2016, LIU, Fei wrote: > > Hi Sage, > > I was wondering do you have any thoughts of 25G RDMA networking > > construction besides of xio-messenger/async? Is there any guidance to bu > ild > > 25G RDMA netowrk to better control the whole Ceph cluster latency? > > The only RDMA options right now are XioMessenger and AsyncMessenger's new > RDMA backend. Both are experimental, but we'd be very interested in > hearing about your experience. > > I wouldn't assume that latency is network-related, though. More often > than not we're finding it's the OSD backend or the OSD request internals > (e.g., request scheduling or peering) that's the culprit... > > sage > > > >
