Hi Neo, On our formerly-internal firefly-based branch, what we did was create additional Messenger instances ad infinitum, which at least let you do this, but it's not what anybody wanted for upstream or long-term. What's upstream now doesn't let you IIRC describe that. The rdma_local parameter like you say is insufficient (and actually a hack). What we plan to do (and have in progress) is extending work Sage started on wip-address, which will enable multi-homing and identify instances by their transport type(s). We might put more information there to help with future topologies. Improved configuration language to let you describe your desired network setup would be packaged with that. The plan is that an improved situation might arrive as early as J. If we need an interim method, now would be a good time to start discussion. Matt ----- Original Message ----- From: "kernel neophyte" <neophyte.hacker001@xxxxxxxxx> To: vu@xxxxxxxxxxxx, "raju kurunkad" <raju.kurunkad@xxxxxxxxxxx>, ceph-devel@xxxxxxxxxxxxxxx Sent: Thursday, July 30, 2015 11:21:06 PM Subject: Cluster Network & Public Network w.r.t XIO ? Hi Vu, Raju, I am trying to bring up ceph cluster on a powerful dell server with two 40Gbe ROCEv2 NIC. I have assigned one as my cluster network (would prefer all osd communications happen on that) and have assigned one as my public n/w. this works fine for simple messenger case. (ofcourse no rdma) but when I try to bring this up on XIO, this gets very complicated, as in how do I specify two RDMA_LOCAL ? one for cluster n/w and other for public ? can choose XIO for client to osd communication and simple for cluster n/w ? any thoughts ? Thanks, Neo -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
