we have seen fuse show much worse perofermance compared to kernel, would you mind to test via kernel cephfs client( ubuntu 16.04 with 4.4 or rhel 7.2/7.3 should be good enough) 2017-07-18 13:27 GMT+08:00 sheng qiu <herbert1984106@xxxxxxxxx>: > hi, > > I am evaluating the cephfs performance and see unreasonable > performance when multiple threads accessing same mount point. > > there are 10k files (300MB each) in the fuse mount point, when > increase multiple fio threads accessing those 10k files, the > performance is not scaled and bounded to ~40MB/s. > > the ceph cluster has 36 OSDs on three high end servers, each OSD > backed by a NVMe drive. Theres's another servers running one MDS > process and monitors. > > if pushing IO via fio rbd engine to the cluster directly, it has > pretty reasonable performance. Is there any special configuration i > should pay attention when setup cephfs or fuse client is the problem? > or i should use more MDS? > > any suggestions would be appreciated. > > Thanks, > Sheng > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html