Hi, I want to export rbd over nfs in a 10Gb network. Server and Client are DELL R620 with 10Gb nics. rbd cache is disabled ont the server. NFS server write bandwith on his rbd is 1196MB/s NFS client write bandwith on the rbd export is only 233MB/s. NFS client write bandwith on a "local-server-disk" export is 839MB/s my bench is: fio --time_based --name=benchmark --size=20G --runtime=30 --filename=/video1/fiobench --ioengine=libaio --randrepeat=0 --iodepth=128 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=4 --rw=write --blocksize=256k --group_reporting my export: /video1 X.X.X.X(rw,sync,no_root_squash) mount : type nfs (rw,noatime,nodiratime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=X.X.X.X,mountvers=3,mountport=20048,mountproto=tcp,local_lock=none,addr=X.X.X.X) rbd: rbd image 'video1': size 5120 GB in 1310720 objects order 22 (4096 kB objects) block_name_prefix: rbd_data.1c9dc674b0dc51 format: 2 features: layering flags: My conclusion: - rbd write performance is good - nfs write permormance is good - nfs write on rbd performance is bad do you encounter the same problem ? Marc _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |