Hi Bruce, -- Matt Benjamin Red Hat, Inc. 315 West Huron Street, Suite 140A Ann Arbor, Michigan 48103 http://www.redhat.com/en/technologies/storage tel. 734-707-0660 fax. 734-769-8938 cel. 734-216-5309 ----- Original Message ----- > From: "J. Bruce Fields" <bfields@xxxxxxxxxx> > To: "Matt Benjamin" <mbenjamin@xxxxxxxxxx> > Cc: "Ceph Development" <ceph-devel@xxxxxxxxxxxxxxx>, "Stefan Hajnoczi" <stefanha@xxxxxxxxxx>, "Sage Weil" > <sweil@xxxxxxxxxx> > Sent: Monday, October 19, 2015 11:13:52 AM > Subject: Re: nfsv41 over AF_VSOCK (nfs-ganesha) > > On Fri, Oct 16, 2015 at 05:08:17PM -0400, Matt Benjamin wrote: > > Hi devs (CC Bruce--here is a use case for vmci sockets transport) > > > > One of Sage's possible plans for Manilla integration would use nfs over the > > new Linux vmci sockets transport integration in qemu (below) to access > > Cephfs via an nfs-ganesha server running in the host vm. > > What does "the host vm" mean, and why is this a particularly useful > configuration? Sorry, I should say, "the vm host." I think the claimed utility here is (at least) three-fold: 1. simplified configuration on host and guests 2. some claim to improved security through isolation 3. some expectation of improved latency/performance wrt TCP Stefan sent a link to a set of slides with his original patches. Did you get a chance to read through those? [1] http://events.linuxfoundation.org/sites/events/files/slides/stefanha-kvm-forum-2015.pdf Regards, Matt > > --b. > > > > > This now experimentally works. > > > > some notes on running nfs-ganesha over AF_VSOCK: > > > > 1. need stefan hajnoczi's patches for > > * linux kernel (and build w/vhost-vsock support > > * qemu (and build w/vhost-vsock support) > > * nfs-utils (in vm guest) > > > > all linked from https://github.com/stefanha?tab=repositories > > > > 2. host and vm guest kernels must include vhost-vsock > > * host kernel should load vhost-vsock.ko > > > > 3. start a qemu(-kvm) guest (w/patched kernel) with a vhost-vsock-pci > > device, e.g > > > > /opt/qemu-vsock/bin/qemu-system-x86_64 -m 2048 -usb -name vsock1 > > --enable-kvm -drive > > file=/opt/images/vsock.qcow,if=virtio,index=0,format=qcow2 -drive > > file=/opt/isos/f22.iso,media=cdrom -net > > nic,model=virtio,macaddr=02:36:3e:41:1b:78 -net bridge,br=br0 > > -parallel none -serial mon:stdio -device > > vhost-vsock-pci,id=vhost-vsock-pci0,addr=4.0,guest-cid=4 -boot c > > > > 4. nfs-gansha (in host) > > * need nfs-ganesha and its ntirpc rpc provider with vsock support > > https://github.com/linuxbox2/nfs-ganesha (vsock branch) > > https://github.com/linuxbox2/ntirpc (vsock branch) > > > > * configure ganesha w/vsock support > > cmake -DCMAKE_INSTALL_PREFIX=/cache/nfs-vsock -DUSE_FSAL_VFS=ON -DUSE_VSOCK > > -DCMAKE_C_FLAGS="-O0 -g3 -gdwarf-4" ../src > > > > in ganesha.conf, add "nfsvsock" to Protocols list in EXPORT block > > > > 5. mount in guest w/nfs41: > > (e.g., in fstab) > > 2:// /vsock41 nfs > > noauto,soft,nfsvers=4.1,sec=sys,proto=vsock,clientaddr=4,rsize=1048576,wsize=1048576 > > 0 0 > > > > If you try this, send feedback. > > > > Thanks! > > > > Matt > > > > -- > > Matt Benjamin > > Red Hat, Inc. > > 315 West Huron Street, Suite 140A > > Ann Arbor, Michigan 48103 > > > > http://www.redhat.com/en/technologies/storage > > > > tel. 734-707-0660 > > fax. 734-769-8938 > > cel. 734-216-5309 > > > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
