On Sun, Apr 9, 2017 at 12:48 AM, Kyle Drake <kyle@xxxxxxxxxxxxx> wrote: > Pretty much says it all. 1GB test file copy to local: > > $ time cp /mnt/ceph-kernel-driver-test/test.img . > > real 2m50.063s > user 0m0.000s > sys 0m9.000s > > $ time cp /mnt/ceph-fuse-test/test.img . > > real 0m3.648s > user 0m0.000s > sys 0m1.872s > > Yikes. The kernel driver averages ~5MB and the fuse driver averages > ~150MBish? Something crazy is happening here. It's not caching, I ran both > tests fresh. What does "fresh" mean in this context? i.e. what did you do in between runs to reset it? Have you tried running your procedure in the reverse order (i.e. is the kernel client still slow when you're running it after the fuse client)? > Ubuntu 16.04.2, 4.4.0-72-generic, ceph-fuse 10.2.6-1xenial, ceph-fs-common > 10.2.6-0ubuntu0.16.04.1 (I also tried the 16.04.2 one, same issue). I don't know of any issues in the older kernel that you're running, but you should be aware that 4.4 is over a year old and as far as I know there is no backporting of cephfs stuff to the Ubuntu kernel, so you're not getting the latest fixes. John > > Anyone run into this? Did a lot of digging on the ML and didn't see > anything. I'm was going to use FUSE for production, but it tends to lag more > on a lot of small requests so I had to fall back the kernel driver. > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com