On Thu, Dec 19, 2019 at 12:34 PM Xiaoli Feng <xifeng@xxxxxxxxxx> wrote: > > Thanks Ronnie for the information. Last question: Is it supported that mount the windows file > server(has rdma hardware) with SMB Direct in linux client(has rdma hardware)? Yeah, that should definitely work. I think Steve, or a colleague, has run through the same set of the tests in our buildbot (manually?) in that configuration. If you can please test the work-in-progress cifsd kernel server. It should supposedly work with soft-rdma and if it does then that could be a way where we could integrate SMBDirect testing in the buildbot. I haven't had any time to research cifsd or set it up and test unfortunately :-( regards ronnie sahlberg > > ----- Original Message ----- > > From: "ronnie sahlberg" <ronniesahlberg@xxxxxxxxx> > > To: "Xiaoli Feng" <xifeng@xxxxxxxxxx> > > Cc: "Tom Talpey" <ttalpey@xxxxxxxxxxxxx>, "linux-cifs" <linux-cifs@xxxxxxxxxxxxxxx> > > Sent: Wednesday, December 18, 2019 4:12:32 PM > > Subject: Re: How to use SMB Direct > > > > I don't think samba supports SMB Direct. > > Metze used to have a private repo with some experimental patches but I > > don't think it > > has landed in official samba yet. > > > > For a linux server, there is an experimental kernel based server > > called cifsd which should support SMBDirect > > but is incomplete in other areas. It is not part of linus tree yet > > (but soon I hope). > > > > Windows servers support SMBDirect but I am not aware of any soft-rdma > > support so you might be > > limited to just using real hw for any tests. > > > > Linux serverside SMBD support is not ready afaik. > > > > On Wed, Dec 18, 2019 at 12:49 PM Xiaoli Feng <xifeng@xxxxxxxxxx> wrote: > > > > > > Hello Tom, > > > > > > Then I try to use IP to mount, it show this error: > > > [79912.177783] CIFS VFS: _smbd_get_connection:1740 rdma_connect failed > > > port=5445 > > > [79912.220723] CIFS VFS: _smbd_get_connection:1740 rdma_connect failed > > > port=445 > > > > > > Client: > > > $ mount //172.31.0.250/cifs cifs -o user=root,password=redhat,rdma > > > mount error(2): No such file or directory > > > Refer to the mount.cifs(8) manual page (e.g. man mount.cifs) > > > > > > Server: > > > $ ib addr |grep 172.31.0.250/ > > > mlx4_ib0: Link UP, Interface UP 172.31.0.250/24 > > > > > > Samba version is 4.11.2. And firewalld is stopped. > > > > > > ----- Original Message ----- > > > > From: "Tom Talpey" <ttalpey@xxxxxxxxxxxxx> > > > > To: "Xiaoli Feng" <xifeng@xxxxxxxxxx>, linux-cifs@xxxxxxxxxxxxxxx > > > > Sent: Tuesday, December 17, 2019 1:11:24 AM > > > > Subject: RE: How to use SMB Direct > > > > > > > > > -----Original Message----- > > > > > From: linux-cifs-owner@xxxxxxxxxxxxxxx > > > > > <linux-cifs-owner@xxxxxxxxxxxxxxx> > > > > > On > > > > > Behalf Of Xiaoli Feng > > > > > Sent: Monday, December 16, 2019 10:30 AM > > > > > To: linux-cifs@xxxxxxxxxxxxxxx > > > > > Subject: [EXTERNAL] How to use SMB Direct > > > > > > > > > > Hello guys, > > > > > > > > > > I'd like to test SMB Direct. But it's failed. I'm not sure if it works > > > > > in > > > > > upstream. > > > > > I setup samba server on one rdma machine with 5.5.0-rc1+ kernel. The > > > > > smb.conf is: > > > > > [cifs] > > > > > path=/mnt/cifs > > > > > writeable=yes > > > > > > > > > > Then I try to mount the share on another rdma machine with 5.5.0-rc1+ > > > > > kernel. > > > > > mount //$RDMA/cifs cifs -o user=root,password=$password,rdma > > > > > > > > > > It's failed because of "CIFS VFS: smbd_create_id:614 > > > > > rdma_resolve_addr() > > > > > completed -113" > > > > > > > > Errno 113 is "no route to host". Sounds like a network or address issue. > > > > > > > > Tom. > > > > > > > > > Does SMB Direct work fine in upstream? > > > > > > > > > > Thanks. > > > > > > > > > > $ cat /boot/config-5.5.0-rc1+ |grep SMB_DIRECT > > > > > CONFIG_CIFS_SMB_DIRECT=y > > > > > $ ibstat > > > > > CA 'mlx4_0' > > > > > CA type: MT4099 > > > > > Number of ports: 2 > > > > > Firmware version: 2.42.5000 > > > > > Hardware version: 1 > > > > > Node GUID: 0xf4521403007be0e0 > > > > > System image GUID: 0xf4521403007be0e3 > > > > > Port 1: > > > > > State: Active > > > > > Physical state: LinkUp > > > > > Rate: 56 > > > > > Base lid: 29 > > > > > LMC: 0 > > > > > SM lid: 1 > > > > > Capability mask: 0x0259486a > > > > > Port GUID: 0xf4521403007be0e1 > > > > > Link layer: InfiniBand > > > > > Port 2: > > > > > State: Active > > > > > Physical state: LinkUp > > > > > Rate: 40 > > > > > Base lid: 44 > > > > > LMC: 1 > > > > > SM lid: 36 > > > > > Capability mask: 0x02594868 > > > > > Port GUID: 0xf4521403007be0e2 > > > > > Link layer: InfiniBand > > > > > > > > > > > > > > > -- > > > > > Best regards! > > > > > XiaoLi Feng 冯小丽 > > > > > > > > > > Red Hat Software (Beijing) Co.,Ltd > > > > > filesystem-qe Team > > > > > IRC:xifeng，#channel: fs-qe > > > > > Tel:+86-10-8388112 > > > > > 9/F, Raycom > > > > > > > > > > > > > > > >
