Hmm pretty odd. When I ran test on ceph kernel vs ceph fuse , FUSE has always been slower for both read and writes.
Try using tools like fio to run IO test with directIO(bypass system cache)
--
Deepak
Pretty much says it all. 1GB test file copy to local:
$ time cp /mnt/ceph-kernel-driver-test/test.img .
real
2m50.063s
user
0m0.000s
sys
0m9.000s
$ time cp /mnt/ceph-fuse-test/test.img .
real
0m3.648s
user
0m0.000s
sys
0m1.872s
Yikes. The kernel driver averages ~5MB and the fuse driver averages ~150MBish? Something crazy is happening here. It's not caching, I ran both tests fresh.
Ubuntu 16.04.2, 4.4.0-72-generic, ceph-fuse 10.2.6-1xenial, ceph-fs-common 10.2.6-0ubuntu0.16.04.1 (I also tried the 16.04.2 one, same issue).
Anyone run into this? Did a lot of digging on the ML and didn't see anything. I'm was going to use FUSE for production, but it tends to lag more on a lot of small requests so I had to fall back the kernel driver.
This email message is for the sole use of the intended recipient(s) and may
contain confidential information. Any unauthorized review, use, disclosure
or distribution is prohibited. If you are not the intended recipient,
please contact the sender by reply email and destroy all copies of the original
message.
|
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com