Somnath, Yes, that's correct. You must compile and run with rdma kernel stack & libraries provided by distributions (Ubuntu, RH...) OR compile and run with rdma kernel stack + libraries provided by OFED packages. You CANNOT mix and match them. Thanks, -vu -----Original Message----- From: Somnath Roy [mailto:Somnath.Roy@xxxxxxxxxxx] Sent: Monday, March 16, 2015 11:59 AM To: Vu Pham; Matt W. Benjamin Cc: ceph-devel@xxxxxxxxxxxxxxx; Sage Weil; Ken Dreyer Subject: RE: xio messenger is not building by default Vu, Yes, that means we can't use the apt-get version of libibverbs etc as installing the OFED packages later will overwrite those. I am talking about installing to system path not to any customized location as that will not be a solution to the user. So, it seems we need to fix the Ubuntu repo to get the proper library version that OFED packages are installing (?) or always install OFED packages before building accelio, isn't it ? Thanks & Regards Somnath -----Original Message----- From: Vu Pham [mailto:vuhuong@xxxxxxxxxxxx] Sent: Monday, March 16, 2015 11:51 AM To: Somnath Roy; Matt W. Benjamin Cc: ceph-devel@xxxxxxxxxxxxxxx; Sage Weil; Ken Dreyer Subject: Re: xio messenger is not building by default Hi Somnath, It's possible to build Accelio without OFED packages (download from open fabric website or MLNX_OFED is Mellanox version of the opensource package) installed; however, you need to install the libibverbs-dev, librdmacm-dev from the distribution you are running. If you compile against original libibverbs-dev, librdmacm-dev from distributions, you must run with RDMA kernel stack and RDMA libraries from the distribution as well. You must not mix these with RDMA kernel stack and RDMA libraries provided by OFED packages -vu On 3/16/2015 11:25:44 AM, "Somnath Roy" <Somnath.Roy@xxxxxxxxxxx> wrote: >Matt, >It is possible to build accelio without OFED packages installed. >But, my suspicion is , it may not work properly as I have mentioned >below. > >Thanks & Regards >Somnath > >-----Original Message----- >From: Matt W. Benjamin [mailto:matt@xxxxxxxxxxxx] >Sent: Monday, March 16, 2015 11:22 AM >To: Somnath Roy >Cc: ceph-devel@xxxxxxxxxxxxxxx; Sage Weil; Ken Dreyer >Subject: Re: xio messenger is not building by default > >Hi, > >----- "Somnath Roy" <Somnath.Roy@xxxxxxxxxxx> wrote: > >> I think installing the MLNX_OFED driver package will install most of >> the stuff(including libibverbs-dev). We need the following extra >> packages for building accelio. >> numactl libnuma-dev > >Ah, that's also true. > >> >> But, what if user is building it without OFED driver package >>installed >> ? > >Should it be possible? I mean, to both build Xio and not have the >header interface? > >> BTW, I saw accelio was giving assert if I manually install >> libibverbs-dev from Ubuntu repo and upgrade this OFED driver later. >> Cleaning the repo and rebuilding solved the issue. Seems it was >> linking wrong libraries. > >I think I've seen this. > >> >> Thanks & Regards >> Somnath >> >> >> -----Original Message----- >> From: Matt W. Benjamin [mailto:matt@xxxxxxxxxxxx] >> Sent: Monday, March 16, 2015 9:34 AM >> To: Ken Dreyer >> Cc: ceph-devel@xxxxxxxxxxxxxxx; Sage Weil; Somnath Roy >> Subject: Re: xio messenger is not building by default >> >> Hi, >> >> Yes, agree. We do depend on librdmacm! >> >> Matt >> >> ----- "Ken Dreyer" <kdreyer@xxxxxxxxxx> wrote: >> >> > On 03/16/2015 10:20 AM, Matt W. Benjamin wrote: >> > > Hi, >> > > >> > > Arent OFED dependencies already packaged? I assumed that only > >> Accelio would > > be a submodule. >> > > >> > >> > Thanks for pointing that out. It's in Fedora as libibverbs-devel, >> and > it's in Debian as libibverbs-dev. So you're right, Accelio is >> the only > one to be packaged. >> > >> > Looking at configure.ac, does README.xio need to be updated to >> mention > librdmacm? >> > >> > - Ken >> >> -- >> Matt Benjamin >> CohortFS, LLC. >> 315 West Huron Street, Suite 140A >> Ann Arbor, Michigan 48103 >> >> http://cohortfs.com >> >> tel. 734-761-4689 >> fax. 734-769-8938 >> cel. 734-216-5309 >> >> ________________________________ >> >> PLEASE NOTE: The information contained in this electronic mail >>message >> is intended only for the use of the designated recipient(s) named >> above. If the reader of this message is not the intended recipient, >> you are hereby notified that you have received this message in error >> and that any review, dissemination, distribution, or copying of this >> message is strictly prohibited. If you have received this >> communication in error, please notify the sender by telephone or >> e-mail (as shown above) immediately and destroy any and all copies >>of >> this message in your possession (whether hard copies or >>electronically >> stored copies). > >-- >Matt Benjamin >CohortFS, LLC. >315 West Huron Street, Suite 140A >Ann Arbor, Michigan 48103 > >http://cohortfs.com > >tel. 734-761-4689 >fax. 734-769-8938 >cel. 734-216-5309 > >________________________________ > >PLEASE NOTE: The information contained in this electronic mail message >is intended only for the use of the designated recipient(s) named >above. If the reader of this message is not the intended recipient, you >are hereby notified that you have received this message in error and >that any review, dissemination, distribution, or copying of this >message is strictly prohibited. If you have received this communication >in error, please notify the sender by telephone or e-mail (as shown >above) immediately and destroy any and all copies of this message in >your possession (whether hard copies or electronically stored copies). > > 칻 & ~ & +- ݶ w ˛ m ^ b ^n r z h & G h ( > 階 ݢj" m z ޖ f h ~ m ________________________________ PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies). ��.n��������+%������w��{.n����z��u���ܨ}���Ơz�j:+v�����w����ޙ��&�)ߡ�a����z�ޗ���ݢj��w�f
