Hi Daniel and Jake, On Mon, 21 May 2018 22:46:01 +0200, Daniel Baumann wrote: > Hi > > On 05/21/2018 05:38 PM, Jake Grimmett wrote: > > Unfortunately we have a large number (~200) of Windows and Macs clients > > which need CIFS/SMB access to cephfs. > > we too, which is why we're (partially) exporting cephfs over samba too, > 1.5y in production now. > > for us, cephfs-over-samba is significantly slower than cephfs directly > too, but it's not really an issue here (basically, if people use a > windows client here, they're already on the slow track anyway). > > we had to do two things to get it working reliably though: > > a) disable all locking on samba (otherwise "opportunistic locking" on > windows clients killed within hours all mds (kraken at that time)) Have you seen this on more recent versions? Please raise a bug if so - client induced MDS outages would be a pretty serious issue. If your share path is isolated from non-samba clients (as you mention below), then allowing clients to cache reads / writes locally via oplocks / SMB2+ leases should offer a significant performance improvements. > b) only allow writes to a specific space on cephfs, reserved to samba > (with luminous; otherwise, we'd have problems with data consistency on > cephfs with people writing the same files from linux->cephfs and > samba->cephfs concurrently). my hunch is that samba caches writes and > doesn't give them back appropriatly. If you're sharing a kernel CephFS mount, then the Linux page cache will be used for Samba share I/O, but Samba will fully abide by client sync requests if "strict sync = yes" (default in Samba 4.7+). > > Finally, is the vfs_ceph module for Samba useful? It doesn't seem to be > > widely available pre-complied for for RHEL derivatives. Can anyone > > comment on their experiences using vfs_ceph, or point me to a Centos 7.x > > repo that has it? > > we use debian, with backported kernel and backported samba, which has > vfs_ceph pre-compiled. however, we couldn't make vfs_ceph work at all - > the snapshot patters just don't seem to match/align (and nothing we > tried seem to work). vfs_ceph doesn't support snapshots at this stage. I hope to work on this feature in the near future, so that it's fully integrated with the Explorer previous versions UI. Cheers, David _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |