Re: CephFS and Samba hang on copy of large file

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



> Op 15 augustus 2016 om 23:36 schreef Milosz Tanski <milosz@xxxxxxxxx>:
> 
> 
> On Mon, Aug 15, 2016 at 9:58 AM, Wido den Hollander <wido@xxxxxxxx> wrote:
> >
> >> Op 15 augustus 2016 om 15:43 schreef Ira Cooper <ira@xxxxxxxxxxx>:
> >>
> >>
> >> On Mon, Aug 15, 2016 at 9:35 AM, Wido den Hollander <wido@xxxxxxxx> wrote:
> >> >
> >> >> Op 15 augustus 2016 om 15:27 schreef Ira Cooper <ira@xxxxxxxxxxx>:
> >> >>
> >> >>
> >> >> Have you tried the ceph VFS module in Samba yet?
> >> >>
> >> >
> >> > Yes. That works, but the performance is a lot lower. So for that we are testing/using the CephFS kernel client.
> >> >
> >> > I would also like to see the VFS module upstream in Samba, you still need to manually patch it in.
> >>
> >> It is in upstream Samba.
> >>
> >> https://git.samba.org/?p=samba.git;a=blob;f=source3/modules/vfs_ceph.c;h=59e9b9cf9b3e8e5313a20823994fcacf9e4b4168;hb=f1b42ec778e08875e076df7fdf67dd69bf9b2757
> >>
> >> It's been there a while now.
> >>
> >> I'm curious what you are patching in, and what the performance numbers are. :)
> >
> > No, sorry for that confusion. I meant DEB and/or RPM packages. You have to compile manually which not all companies like.
> >
> > With the kernel client we see about 200MB/sec and with VFS about 50MB/sec.
> 
> I'm willing to bet that at lest some of it is page cache & read ahead.
> 

Probably indeed. Tested with Jewel and VFS and we see a much higher throughput right now.

We had to disable sendfile in Samba though.

Still, it's not good that Samba locked up and stayed in status D. That should not happen.

Wido

> >
> > However, I still wonder why samba went in status D. That should not happen.
> >
> > Wido
> >
> 
> 
> 
> -- 
> Milosz Tanski
> CTO
> 16 East 34th Street, 15th floor
> New York, NY 10016
> 
> p: 646-253-9055
> e: milosz@xxxxxxxxx
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@xxxxxxxxxxxxxxx
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]

  Powered by Linux