On Mon, Oct 19, 2015 at 11:49:15AM -0400, Matt Benjamin wrote: > ----- Original Message ----- > > From: "J. Bruce Fields" <bfields@xxxxxxxxxx> ... > > > > On Fri, Oct 16, 2015 at 05:08:17PM -0400, Matt Benjamin wrote: > > > Hi devs (CC Bruce--here is a use case for vmci sockets transport) > > > > > > One of Sage's possible plans for Manilla integration would use nfs over the > > > new Linux vmci sockets transport integration in qemu (below) to access > > > Cephfs via an nfs-ganesha server running in the host vm. > > > > What does "the host vm" mean, and why is this a particularly useful > > configuration? > > Sorry, I should say, "the vm host." Got it, thanks! > I think the claimed utility here is (at least) three-fold: > > 1. simplified configuration on host and guests > 2. some claim to improved security through isolation So why is it especially interesting to put Ceph inside the VM and Ganesha outside? > 3. some expectation of improved latency/performance wrt TCP > > Stefan sent a link to a set of slides with his original patches. Did you get a chance to read through those? > > [1] http://events.linuxfoundation.org/sites/events/files/slides/stefanha-kvm-forum-2015.pdf Yep, thanks.--b. > > Regards, > > Matt > > > > > --b. > > > > > > > > This now experimentally works. > > > > > > some notes on running nfs-ganesha over AF_VSOCK: > > > > > > 1. need stefan hajnoczi's patches for > > > * linux kernel (and build w/vhost-vsock support > > > * qemu (and build w/vhost-vsock support) > > > * nfs-utils (in vm guest) > > > > > > all linked from https://github.com/stefanha?tab=repositories > > > > > > 2. host and vm guest kernels must include vhost-vsock > > > * host kernel should load vhost-vsock.ko > > > > > > 3. start a qemu(-kvm) guest (w/patched kernel) with a vhost-vsock-pci > > > device, e.g > > > > > > /opt/qemu-vsock/bin/qemu-system-x86_64 -m 2048 -usb -name vsock1 > > > --enable-kvm -drive > > > file=/opt/images/vsock.qcow,if=virtio,index=0,format=qcow2 -drive > > > file=/opt/isos/f22.iso,media=cdrom -net > > > nic,model=virtio,macaddr=02:36:3e:41:1b:78 -net bridge,br=br0 > > > -parallel none -serial mon:stdio -device > > > vhost-vsock-pci,id=vhost-vsock-pci0,addr=4.0,guest-cid=4 -boot c > > > > > > 4. nfs-gansha (in host) > > > * need nfs-ganesha and its ntirpc rpc provider with vsock support > > > https://github.com/linuxbox2/nfs-ganesha (vsock branch) > > > https://github.com/linuxbox2/ntirpc (vsock branch) > > > > > > * configure ganesha w/vsock support > > > cmake -DCMAKE_INSTALL_PREFIX=/cache/nfs-vsock -DUSE_FSAL_VFS=ON -DUSE_VSOCK > > > -DCMAKE_C_FLAGS="-O0 -g3 -gdwarf-4" ../src > > > > > > in ganesha.conf, add "nfsvsock" to Protocols list in EXPORT block > > > > > > 5. mount in guest w/nfs41: > > > (e.g., in fstab) > > > 2:// /vsock41 nfs > > > noauto,soft,nfsvers=4.1,sec=sys,proto=vsock,clientaddr=4,rsize=1048576,wsize=1048576 > > > 0 0 > > > > > > If you try this, send feedback. > > > > > > Thanks! > > > > > > Matt > > > > > > -- > > > Matt Benjamin > > > Red Hat, Inc. > > > 315 West Huron Street, Suite 140A > > > Ann Arbor, Michigan 48103 > > > > > > http://www.redhat.com/en/technologies/storage > > > > > > tel. 734-707-0660 > > > fax. 734-769-8938 > > > cel. 734-216-5309 > > > > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > > the body of a message to majordomo@xxxxxxxxxxxxxxx > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
