Hello Ronnie, 2019년 12월 19일 (목) 오후 3:57, ronnie sahlberg <ronniesahlberg@xxxxxxxxx>님이 작성: > > On Thu, Dec 19, 2019 at 4:47 PM Hyeoncheol Lee <hyc.lee@xxxxxxxxx> wrote: > > > > Hello Xiaoli, > > > > cifsd is an in-kernel SMB server which supports SMB Direct. > > If you want to test SMB Direct with cifs, you can use cifsd. > > > > Currently we have tested SMB Direct between two old fashioned > > Mellanox ConnectX devices which are connected directly, > > and between two soft RoCE devices in kernel. > > Thanks Hyeoncheol, > > This is very interesting! > > We have a buildbot upstream for the cifs client where we test every > set of patches before they go to linus : > http://smb3-test-rhel-75.southcentralus.cloudapp.azure.com/#/builders/2/builds/302 > > I havent had time to test with your cifsd yet but as you say you can > use soft-RoCE > you are saying it will work doing soft-RoCE between one VM running > cifs.ko and a basic virtio NIC > to another VM running your cifsd and also using a basic virtio NIC? Yes, I had tested SMB Direct between the two VMs that are configured as you said. > > I would really want to set up so we can do RDMA tests for cifs.ko, and > by accident cifsd, in our buildbot. > We will help you. but before that, our cifsd's xfstests test-cases are a different with your cifs' test-cases. your some test-cases may be failed for cifsd. our test-cases were suggested by Steve in the past. So we want to know the list of your test-cases and check that the cases will succeed for cifsd. And while we check the test-cases, the common test-cases between cifs and cifsd can be tested in the buildbot. Thank you. > > regards > ronnie sahlberg > > > > > > You can get cifsd's code from the following url, and > > If you have any questions, we will help you. > > > > https://github.com/cifsd-team/cifsd.git > > > > Thank you. > > > > > > 2019년 12월 19일 (목) 오전 11:35, Xiaoli Feng <xifeng@xxxxxxxxxx>님이 작성: > > > > > > Thanks Ronnie for the information. Last question: Is it supported that mount the windows file > > > server(has rdma hardware) with SMB Direct in linux client(has rdma hardware)? > > > > > > ----- Original Message ----- > > > > From: "ronnie sahlberg" <ronniesahlberg@xxxxxxxxx> > > > > To: "Xiaoli Feng" <xifeng@xxxxxxxxxx> > > > > Cc: "Tom Talpey" <ttalpey@xxxxxxxxxxxxx>, "linux-cifs" <linux-cifs@xxxxxxxxxxxxxxx> > > > > Sent: Wednesday, December 18, 2019 4:12:32 PM > > > > Subject: Re: How to use SMB Direct > > > > > > > > I don't think samba supports SMB Direct. > > > > Metze used to have a private repo with some experimental patches but I > > > > don't think it > > > > has landed in official samba yet. > > > > > > > > For a linux server, there is an experimental kernel based server > > > > called cifsd which should support SMBDirect > > > > but is incomplete in other areas. It is not part of linus tree yet > > > > (but soon I hope). > > > > > > > > Windows servers support SMBDirect but I am not aware of any soft-rdma > > > > support so you might be > > > > limited to just using real hw for any tests. > > > > > > > > Linux serverside SMBD support is not ready afaik. > > > > > > > > On Wed, Dec 18, 2019 at 12:49 PM Xiaoli Feng <xifeng@xxxxxxxxxx> wrote: > > > > > > > > > > Hello Tom, > > > > > > > > > > Then I try to use IP to mount, it show this error: > > > > > [79912.177783] CIFS VFS: _smbd_get_connection:1740 rdma_connect failed > > > > > port=5445 > > > > > [79912.220723] CIFS VFS: _smbd_get_connection:1740 rdma_connect failed > > > > > port=445 > > > > > > > > > > Client: > > > > > $ mount //172.31.0.250/cifs cifs -o user=root,password=redhat,rdma > > > > > mount error(2): No such file or directory > > > > > Refer to the mount.cifs(8) manual page (e.g. man mount.cifs) > > > > > > > > > > Server: > > > > > $ ib addr |grep 172.31.0.250/ > > > > > mlx4_ib0: Link UP, Interface UP 172.31.0.250/24 > > > > > > > > > > Samba version is 4.11.2. And firewalld is stopped. > > > > > > > > > > ----- Original Message ----- > > > > > > From: "Tom Talpey" <ttalpey@xxxxxxxxxxxxx> > > > > > > To: "Xiaoli Feng" <xifeng@xxxxxxxxxx>, linux-cifs@xxxxxxxxxxxxxxx > > > > > > Sent: Tuesday, December 17, 2019 1:11:24 AM > > > > > > Subject: RE: How to use SMB Direct > > > > > > > > > > > > > -----Original Message----- > > > > > > > From: linux-cifs-owner@xxxxxxxxxxxxxxx > > > > > > > <linux-cifs-owner@xxxxxxxxxxxxxxx> > > > > > > > On > > > > > > > Behalf Of Xiaoli Feng > > > > > > > Sent: Monday, December 16, 2019 10:30 AM > > > > > > > To: linux-cifs@xxxxxxxxxxxxxxx > > > > > > > Subject: [EXTERNAL] How to use SMB Direct > > > > > > > > > > > > > > Hello guys, > > > > > > > > > > > > > > I'd like to test SMB Direct. But it's failed. I'm not sure if it works > > > > > > > in > > > > > > > upstream. > > > > > > > I setup samba server on one rdma machine with 5.5.0-rc1+ kernel. The > > > > > > > smb.conf is: > > > > > > > [cifs] > > > > > > > path=/mnt/cifs > > > > > > > writeable=yes > > > > > > > > > > > > > > Then I try to mount the share on another rdma machine with 5.5.0-rc1+ > > > > > > > kernel. > > > > > > > mount //$RDMA/cifs cifs -o user=root,password=$password,rdma > > > > > > > > > > > > > > It's failed because of "CIFS VFS: smbd_create_id:614 > > > > > > > rdma_resolve_addr() > > > > > > > completed -113" > > > > > > > > > > > > Errno 113 is "no route to host". Sounds like a network or address issue. > > > > > > > > > > > > Tom. > > > > > > > > > > > > > Does SMB Direct work fine in upstream? > > > > > > > > > > > > > > Thanks. > > > > > > > > > > > > > > $ cat /boot/config-5.5.0-rc1+ |grep SMB_DIRECT > > > > > > > CONFIG_CIFS_SMB_DIRECT=y > > > > > > > $ ibstat > > > > > > > CA 'mlx4_0' > > > > > > > CA type: MT4099 > > > > > > > Number of ports: 2 > > > > > > > Firmware version: 2.42.5000 > > > > > > > Hardware version: 1 > > > > > > > Node GUID: 0xf4521403007be0e0 > > > > > > > System image GUID: 0xf4521403007be0e3 > > > > > > > Port 1: > > > > > > > State: Active > > > > > > > Physical state: LinkUp > > > > > > > Rate: 56 > > > > > > > Base lid: 29 > > > > > > > LMC: 0 > > > > > > > SM lid: 1 > > > > > > > Capability mask: 0x0259486a > > > > > > > Port GUID: 0xf4521403007be0e1 > > > > > > > Link layer: InfiniBand > > > > > > > Port 2: > > > > > > > State: Active > > > > > > > Physical state: LinkUp > > > > > > > Rate: 40 > > > > > > > Base lid: 44 > > > > > > > LMC: 1 > > > > > > > SM lid: 36 > > > > > > > Capability mask: 0x02594868 > > > > > > > Port GUID: 0xf4521403007be0e2 > > > > > > > Link layer: InfiniBand > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > Best regards! > > > > > > > XiaoLi Feng 冯小丽 > > > > > > > > > > > > > > Red Hat Software (Beijing) Co.,Ltd > > > > > > > filesystem-qe Team > > > > > > > IRC:xifeng，#channel: fs-qe > > > > > > > Tel:+86-10-8388112 > > > > > > > 9/F, Raycom > > > > > > > > > > > > > > > > > > > > > > > > > > > >
