Re: Best practices for use ceph cluster and directories with many! Entries

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Nov 15, 2016 at 8:40 AM, Hauke Homburg <hhomburg@xxxxxxxxxxxxxx> wrote:
> In the last weeks we enabled for testing the dir fragmentation. The Resultat
> is that we have sometimes error messages with rsync with unlink and no-space
> left on device.

Enabling directory fragmentation would not cause the unlink and ENOSPC
errors. Failure to unlink is caused by the stray directories on the
MDS growing too large. The only current solution is to wait for the
MDS to eventually purge the stray directory entries. Retry the unlink
as necessary. [The other workaround is to increase
mds_bal_fragment_size_max [1] which is not recommended.]

Directory fragmentation is not yet considered stable so beware
potential issues including data loss. However, fragmentation will
allow your directories to grow to unbounded size. This includes the
stray directories which would permit unlink to avoid this issue.

>  Does anyone have a timeline for the testing dir frag mds?

Directory fragmentation is on track to be stable for the Luminous release.

[1] https://github.com/ceph/ceph/pull/9789

-- 
Patrick Donnelly
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux