On Tue, Aug 16, 2016 at 6:32 AM, Wido den Hollander <wido@xxxxxxxx> wrote: > >> Op 15 augustus 2016 om 23:36 schreef Milosz Tanski <milosz@xxxxxxxxx>: >> >> >> On Mon, Aug 15, 2016 at 9:58 AM, Wido den Hollander <wido@xxxxxxxx> wrote: >> > >> >> Op 15 augustus 2016 om 15:43 schreef Ira Cooper <ira@xxxxxxxxxxx>: >> >> >> >> >> >> On Mon, Aug 15, 2016 at 9:35 AM, Wido den Hollander <wido@xxxxxxxx> wrote: >> >> > >> >> >> Op 15 augustus 2016 om 15:27 schreef Ira Cooper <ira@xxxxxxxxxxx>: >> >> >> >> >> >> >> >> >> Have you tried the ceph VFS module in Samba yet? >> >> >> >> >> > >> >> > Yes. That works, but the performance is a lot lower. So for that we are testing/using the CephFS kernel client. >> >> > >> >> > I would also like to see the VFS module upstream in Samba, you still need to manually patch it in. >> >> >> >> It is in upstream Samba. >> >> >> >> https://git.samba.org/?p=samba.git;a=blob;f=source3/modules/vfs_ceph.c;h=59e9b9cf9b3e8e5313a20823994fcacf9e4b4168;hb=f1b42ec778e08875e076df7fdf67dd69bf9b2757 >> >> >> >> It's been there a while now. >> >> >> >> I'm curious what you are patching in, and what the performance numbers are. :) >> > >> > No, sorry for that confusion. I meant DEB and/or RPM packages. You have to compile manually which not all companies like. >> > >> > With the kernel client we see about 200MB/sec and with VFS about 50MB/sec. >> >> I'm willing to bet that at lest some of it is page cache & read ahead. >> > > Probably indeed. Tested with Jewel and VFS and we see a much higher throughput right now. > > We had to disable sendfile in Samba though. > > Still, it's not good that Samba locked up and stayed in status D. That should not happen. Sendfile doesn't make much sense with a userspace filesystem like vfs_ceph. You said performance improved, how much? Also are you using copy, robocopy, the windows explorer? And which version of Windows? Thanks, -Ira -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html