Dear All, Excited to see snapshots finally becoming a stable feature in cephfs :) Unfortunately we have a large number (~200) of Windows and Macs clients which need CIFS/SMB access to cephfs. None-the-less, snapshots have prompted us to start testing ceph to see if we can use it as a scale-out NAS... cephfs native performance on our test setup appears good, however tests accessing via samba have been slightly disappointing, especially with small file I/O. Large file I/O is fair, but could still be improved. Using Helios LanTest 6.0.0 on Osx. Create 300 Files Cephfs (kernel) > samba. average 5100 ms Isilon > CIFS average 2600 ms ZFS > samba average 121 ms Remove 300 files Cephfs (kernel) > samba. average 2100 ms Isilon > CIFS average 900 ms ZFS > samba average 421 ms Write 300MB to file Cephfs (kernel) > samba. average 25 MB/s Isilon > CIFS average 17.9 MB/s ZFS > samba average 64.4 MB/s Hardware Used: CephFS: five node dual Xeon cluster (120 bluestore OSD, 4 x nvme metadata for Cephfs, bulk data EC 4+1), Scientific Linux 7.5, ceph 12.2.5, kernel client (fuse significantly slower). Isilon: 6 year old, 8 x NL108 ZFS: SL 6.4 on a Dell R730XD, 24 x 1.8TB drives Ceph Samba gateway is a separate machine: dual Xeon, 40Gb ethernet, 128GB RAM, also running SL 7.5. Finally, is the vfs_ceph module for Samba useful? It doesn't seem to be widely available pre-complied for for RHEL derivatives. Can anyone comment on their experiences using vfs_ceph, or point me to a Centos 7.x repo that has it? many thanks for all and any advice, Jake _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |