Re: How to use SMB Direct

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello Ronnie,

2019년 12월 19일 (목) 오후 3:57, ronnie sahlberg <ronniesahlberg@xxxxxxxxx>님이 작성:
>
> On Thu, Dec 19, 2019 at 4:47 PM Hyeoncheol Lee <hyc.lee@xxxxxxxxx> wrote:
> >
> > Hello Xiaoli,
> >
> > cifsd is an in-kernel SMB server which supports SMB Direct.
> > If you want to test SMB Direct with cifs, you can use cifsd.
> >
> > Currently we have tested SMB Direct between two old fashioned
> > Mellanox ConnectX devices which are connected directly,
> > and between two soft RoCE devices in kernel.
>
> Thanks Hyeoncheol,
>
> This is very interesting!
>
> We have a buildbot upstream for the cifs client where we test every
> set of patches before they go to linus :
> http://smb3-test-rhel-75.southcentralus.cloudapp.azure.com/#/builders/2/builds/302
>
> I havent had time to test with your cifsd yet but as you say you can
> use soft-RoCE
> you are saying it will work doing soft-RoCE between one VM running
> cifs.ko and a basic virtio NIC
> to another VM running your cifsd and also using a basic virtio NIC?

Yes, I had tested SMB Direct between the two VMs that are configured
as you said.

>
> I would really want to set up so we can do RDMA tests for cifs.ko, and
> by accident cifsd, in our buildbot.
>

We will help you. but before that, our cifsd's xfstests test-cases are
a different
with your cifs' test-cases. your some test-cases may be failed for cifsd.
our test-cases were suggested by Steve in the past.

So we want to know the list of your test-cases and check that the cases will
succeed for cifsd.
And while we check the test-cases, the common test-cases between cifs and cifsd
can be tested in the buildbot.

Thank you.
>
> regards
> ronnie sahlberg
>
>
> >
> > You can get cifsd's code from the following url, and
> > If you have any questions, we will help you.
> >
> > https://github.com/cifsd-team/cifsd.git
> >
> > Thank you.
> >
> >
> > 2019년 12월 19일 (목) 오전 11:35, Xiaoli Feng <xifeng@xxxxxxxxxx>님이 작성:
> > >
> > > Thanks Ronnie for the information. Last question: Is it supported that mount the windows file
> > > server(has rdma hardware) with SMB Direct in linux client(has rdma hardware)?
> > >
> > > ----- Original Message -----
> > > > From: "ronnie sahlberg" <ronniesahlberg@xxxxxxxxx>
> > > > To: "Xiaoli Feng" <xifeng@xxxxxxxxxx>
> > > > Cc: "Tom Talpey" <ttalpey@xxxxxxxxxxxxx>, "linux-cifs" <linux-cifs@xxxxxxxxxxxxxxx>
> > > > Sent: Wednesday, December 18, 2019 4:12:32 PM
> > > > Subject: Re: How to use SMB Direct
> > > >
> > > > I don't think samba supports SMB Direct.
> > > > Metze used to have a private repo with some experimental patches but I
> > > > don't think it
> > > > has landed in official samba yet.
> > > >
> > > > For a linux server, there is an experimental kernel based server
> > > > called cifsd which should support SMBDirect
> > > > but is incomplete in other areas. It is not part of linus tree yet
> > > > (but soon I hope).
> > > >
> > > > Windows servers support SMBDirect but I am not aware of any soft-rdma
> > > > support so you might be
> > > > limited to just using real hw for any tests.
> > > >
> > > > Linux serverside SMBD support is not ready afaik.
> > > >
> > > > On Wed, Dec 18, 2019 at 12:49 PM Xiaoli Feng <xifeng@xxxxxxxxxx> wrote:
> > > > >
> > > > > Hello Tom,
> > > > >
> > > > > Then I try to use IP to mount, it show this error:
> > > > > [79912.177783] CIFS VFS: _smbd_get_connection:1740 rdma_connect failed
> > > > > port=5445
> > > > > [79912.220723] CIFS VFS: _smbd_get_connection:1740 rdma_connect failed
> > > > > port=445
> > > > >
> > > > > Client:
> > > > > $ mount //172.31.0.250/cifs cifs -o user=root,password=redhat,rdma
> > > > > mount error(2): No such file or directory
> > > > > Refer to the mount.cifs(8) manual page (e.g. man mount.cifs)
> > > > >
> > > > > Server:
> > > > > $ ib addr |grep 172.31.0.250/
> > > > > mlx4_ib0:               Link UP, Interface UP   172.31.0.250/24
> > > > >
> > > > > Samba version is 4.11.2. And firewalld is stopped.
> > > > >
> > > > > ----- Original Message -----
> > > > > > From: "Tom Talpey" <ttalpey@xxxxxxxxxxxxx>
> > > > > > To: "Xiaoli Feng" <xifeng@xxxxxxxxxx>, linux-cifs@xxxxxxxxxxxxxxx
> > > > > > Sent: Tuesday, December 17, 2019 1:11:24 AM
> > > > > > Subject: RE: How to use SMB Direct
> > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: linux-cifs-owner@xxxxxxxxxxxxxxx
> > > > > > > <linux-cifs-owner@xxxxxxxxxxxxxxx>
> > > > > > > On
> > > > > > > Behalf Of Xiaoli Feng
> > > > > > > Sent: Monday, December 16, 2019 10:30 AM
> > > > > > > To: linux-cifs@xxxxxxxxxxxxxxx
> > > > > > > Subject: [EXTERNAL] How to use SMB Direct
> > > > > > >
> > > > > > > Hello guys,
> > > > > > >
> > > > > > > I'd like to test SMB Direct. But it's failed. I'm not sure if it works
> > > > > > > in
> > > > > > > upstream.
> > > > > > > I setup samba server on one rdma machine with 5.5.0-rc1+ kernel. The
> > > > > > > smb.conf is:
> > > > > > > [cifs]
> > > > > > > path=/mnt/cifs
> > > > > > > writeable=yes
> > > > > > >
> > > > > > > Then I try to mount the share on another rdma machine with 5.5.0-rc1+
> > > > > > > kernel.
> > > > > > >    mount //$RDMA/cifs cifs -o user=root,password=$password,rdma
> > > > > > >
> > > > > > > It's failed because of "CIFS VFS: smbd_create_id:614
> > > > > > > rdma_resolve_addr()
> > > > > > > completed -113"
> > > > > >
> > > > > > Errno 113 is "no route to host". Sounds like a network or address issue.
> > > > > >
> > > > > > Tom.
> > > > > >
> > > > > > > Does SMB Direct work fine in upstream?
> > > > > > >
> > > > > > > Thanks.
> > > > > > >
> > > > > > > $ cat /boot/config-5.5.0-rc1+ |grep SMB_DIRECT
> > > > > > > CONFIG_CIFS_SMB_DIRECT=y
> > > > > > > $ ibstat
> > > > > > > CA 'mlx4_0'
> > > > > > >     CA type: MT4099
> > > > > > >     Number of ports: 2
> > > > > > >     Firmware version: 2.42.5000
> > > > > > >     Hardware version: 1
> > > > > > >     Node GUID: 0xf4521403007be0e0
> > > > > > >     System image GUID: 0xf4521403007be0e3
> > > > > > >     Port 1:
> > > > > > >             State: Active
> > > > > > >             Physical state: LinkUp
> > > > > > >             Rate: 56
> > > > > > >             Base lid: 29
> > > > > > >             LMC: 0
> > > > > > >             SM lid: 1
> > > > > > >             Capability mask: 0x0259486a
> > > > > > >             Port GUID: 0xf4521403007be0e1
> > > > > > >             Link layer: InfiniBand
> > > > > > >     Port 2:
> > > > > > >             State: Active
> > > > > > >             Physical state: LinkUp
> > > > > > >             Rate: 40
> > > > > > >             Base lid: 44
> > > > > > >             LMC: 1
> > > > > > >             SM lid: 36
> > > > > > >             Capability mask: 0x02594868
> > > > > > >             Port GUID: 0xf4521403007be0e2
> > > > > > >             Link layer: InfiniBand
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Best regards!
> > > > > > > XiaoLi Feng 冯小丽
> > > > > > >
> > > > > > > Red Hat Software (Beijing) Co.,Ltd
> > > > > > > filesystem-qe Team
> > > > > > > IRC:xifeng,#channel: fs-qe
> > > > > > > Tel:+86-10-8388112
> > > > > > > 9/F, Raycom
> > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > >




[Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]

  Powered by Linux