> Op 16 augustus 2016 om 12:32 schreef Wido den Hollander <wido@xxxxxxxx>: > > > > > Op 15 augustus 2016 om 23:36 schreef Milosz Tanski <milosz@xxxxxxxxx>: > > > > > > On Mon, Aug 15, 2016 at 9:58 AM, Wido den Hollander <wido@xxxxxxxx> wrote: > > > > > >> Op 15 augustus 2016 om 15:43 schreef Ira Cooper <ira@xxxxxxxxxxx>: > > >> > > >> > > >> On Mon, Aug 15, 2016 at 9:35 AM, Wido den Hollander <wido@xxxxxxxx> wrote: > > >> > > > >> >> Op 15 augustus 2016 om 15:27 schreef Ira Cooper <ira@xxxxxxxxxxx>: > > >> >> > > >> >> > > >> >> Have you tried the ceph VFS module in Samba yet? > > >> >> > > >> > > > >> > Yes. That works, but the performance is a lot lower. So for that we are testing/using the CephFS kernel client. > > >> > > > >> > I would also like to see the VFS module upstream in Samba, you still need to manually patch it in. > > >> > > >> It is in upstream Samba. > > >> > > >> https://git.samba.org/?p=samba.git;a=blob;f=source3/modules/vfs_ceph.c;h=59e9b9cf9b3e8e5313a20823994fcacf9e4b4168;hb=f1b42ec778e08875e076df7fdf67dd69bf9b2757 > > >> > > >> It's been there a while now. > > >> > > >> I'm curious what you are patching in, and what the performance numbers are. :) > > > > > > No, sorry for that confusion. I meant DEB and/or RPM packages. You have to compile manually which not all companies like. > > > > > > With the kernel client we see about 200MB/sec and with VFS about 50MB/sec. > > > > I'm willing to bet that at lest some of it is page cache & read ahead. > > > > Probably indeed. Tested with Jewel and VFS and we see a much higher throughput right now. > > We had to disable sendfile in Samba though. > > Still, it's not good that Samba locked up and stayed in status D. That should not happen. > Forgot to add. This is a 864 OSD cluster (24 OSDs, 36 nodes). All 10GbE connected. Write spreed through Samba is about 200MB/sec, heavy drops at the end of the copy though. Probably 150MB/sec on average with a 15GB file. Wido > Wido > > > > > > > However, I still wonder why samba went in status D. That should not happen. > > > > > > Wido > > > > > > > > > > > -- > > Milosz Tanski > > CTO > > 16 East 34th Street, 15th floor > > New York, NY 10016 > > > > p: 646-253-9055 > > e: milosz@xxxxxxxxx > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > > the body of a message to majordomo@xxxxxxxxxxxxxxx > > More majordomo info at http://vger.kernel.org/majordomo-info.html > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
