On Sep 3, 2012, at 1:35 AM, Myklebust, Trond wrote: > On Sun, 2012-09-02 at 12:46 +0200, Andrew Holway wrote: >> Hi, >> >> I am trying to host KVM machines on an NFSoRDMA mount. >> >> This works: >> >> -drive file=/mnt/vm001.img,if=none,id=drive-virtio-disk0,format=raw -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0 >> >> This Doesn't! >> >> -drive file=/mnt/vm001.img,if=none,id=drive-virtio-disk0,format=raw,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=2 >> >> Any ideas why this could be? I have tried various kernel / ofed combinations. > > I'm guessing that the NFSoRDMA code is broken for the case of O_DIRECT, > and has been for a while. Unfortunately the RDMA code gets little > testing these days. > > Do all the other 'cache=' options work? Yes, Writeback cache also works. When I test writethrough and do lots of heavy DIRECT_IO with iozone this seems to work correctly. ta Andrew > > -- > Trond Myklebust > Linux NFS client maintainer > > NetApp > Trond.Myklebust@xxxxxxxxxx > www.netapp.com > -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html