Re: CephFS kernel driver is 10-15x slower than FUSE driver

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Sun, Apr 9, 2017 at 12:48 AM, Kyle Drake <kyle@xxxxxxxxxxxxx> wrote:
> Pretty much says it all. 1GB test file copy to local:
>
> $ time cp /mnt/ceph-kernel-driver-test/test.img .
>
> real 2m50.063s
> user 0m0.000s
> sys 0m9.000s
>
> $ time cp /mnt/ceph-fuse-test/test.img .
>
> real 0m3.648s
> user 0m0.000s
> sys 0m1.872s
>
> Yikes. The kernel driver averages ~5MB and the fuse driver averages
> ~150MBish? Something crazy is happening here. It's not caching, I ran both
> tests fresh.

What does "fresh" mean in this context?  i.e. what did you do in
between runs to reset it?  Have you tried running your procedure in
the reverse order (i.e. is the kernel client still slow when you're
running it after the fuse client)?

> Ubuntu 16.04.2, 4.4.0-72-generic, ceph-fuse 10.2.6-1xenial, ceph-fs-common
> 10.2.6-0ubuntu0.16.04.1 (I also tried the 16.04.2 one, same issue).

I don't know of any issues in the older kernel that you're running,
but you should be aware that 4.4 is over a year old and as far as I
know there is no backporting of cephfs stuff to the Ubuntu kernel, so
you're not getting the latest fixes.

John

>
> Anyone run into this? Did a lot of digging on the ML and didn't see
> anything. I'm was going to use FUSE for production, but it tends to lag more
> on a lot of small requests so I had to fall back the kernel driver.
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux