I have been testing CephFS on our computational cluster of about 30 computers. I've got 4 machines, 4 disks, 4 osd, 4 mon and 1 mds at the moment for testing. The testing has been going very well apart from one problem that needs to be resolved before we can use Ceph in place of our existing 'system' of NFS exports. Our users run simulations that are easily capable of writing out data at a rate limited only by the storage device. These jobs also often run for days or weeks unattended. This unfortunately means that using CephFS, if a user doesn't setup their simulation carefully enough or if their code has some bug, they are able to fill the entire filesystem (shared by aroud 10 other users) in around a day leaving no room for any other users and potentially crashing the entire cluster. I've read the FAQ entry about quotas but I'm not sure what to make of it. Is it correct that you can only have one "CephFS" per cluster? I guess I was imagining creating a separate file-system of known size for each user. Any help would be greatly appreciated and since this is my first message, thanks to Sage and everyone else involved for creating this excellent project! _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |