I appreciate CephFS is not a high priority, but this is a user-experience test-case that can be a source of stability bugs for Ceph developers to investigate (and hopefully resolve): CephFS test-case 1. Create two clusters, each 3 nodes with 4 OSDs each 2. I used Ubuntu 13.04 followed by update/upgrade 3. Install Ceph version 0.61 on Cluster A 4. Install release on Cluster B with ceph-deploy 5. Fill Cluster A (version 0.61) with about one million files (all sizes) 6. rsync ClusterA ClusterB 7. In about 12-hours one or two OSDs on ClusterB will crash, restart OSDs, restart rsync 8. At around 75% full OSDs on ClusterB will become out of balance (some more full than others), one or more OSD will then crash. For (4) it is possible to use freely available .ISOs of old user-group CDROMs that are floating around the web, they are a good source of varied content size, directory size and filename lengths. My impression is that 0.61 was relatively stable but subsequent version such as 0.67.2 are less stable in this particular scenario with CephFS. _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |