On Thu, Oct 24, 2013 at 9:48 AM, Mark Nelson <mark.nelson@xxxxxxxxxxx> wrote: > Ceph does work with IPoIB, We've got some people working on rsocket support, > and Mellanox just opensourced VMA, so there are some options on the > infiniband side if you want to go that route. With QDR and IPoIB we have > been able to push about 2.4GB/s per node. No idea how SDR would do though. That is great news! > Honestly I wouldn't worry about it too much. We have bigger latency dragons > to slay. :) Ok, this is what I thought, but wanted to make sure. > Just FYI, we haven't done a whole lot of optimization work on SSDs yet, so > if you are shooting for really high IOPS be prepared as its still kind of > wild west. :) We've got a couple of people working on different projects > that we hope will help here, but there's a lot of tuning work to be done > still. :) Understood, we don't need huge amounts of space, so the 240 Gig SSDs were just a bit more the SAS drives. Tho depending on the code, I guess I could run into wear issues of SSDs over SAS/SATA because of frequent writes. -- ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com