Re: cephfs rm -rf on directory of 160TB /40M files

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Apr 5, 2016 at 12:55 AM, Gregory Farnum <gfarnum@xxxxxxxxxx> wrote:
> Deletes are just slow right now. You can look at the ops in flight on you
> client or MDS admin socket to see how far along it is and watch them to see
> how long stuff is taking -- I think it's a sync disk commit for each unlink
> though so at 40M it's going to be a good looong while. :/
> -Greg
>
>
> On Monday, April 4, 2016, Kenneth Waegeman <kenneth.waegeman@xxxxxxxx>
> wrote:
>>
>> Hi all,
>>
>> I want to remove a large directory containing +- 40M files /160TB of data
>> in CephFS by running rm -rf on the directory via the ceph kernel client.
>> After 7h , the rm command is still running. I checked the rados df output,
>> and saw that only about  2TB and 2M files are gone.
>> I know this output of rados df can be confusing because ceph should delete
>> objects asyncroniously, but then I don't know why the rm command still
>> hangs.
>> Is there some way to speed this up? And is there a way to check how far
>> the marked for deletion has progressed ?

Check /sys/kernel/debug/ceph/xxx/mdsc, you can roughly get how fast
unlink requests are handled.  If MDS's CPU usage is less than 100%.
you can try running multiple instance of 'rm -rf' (each one removes
different sub-directory)


Regards
Yan, Zheng

>>
>> Thank you very much!
>>
>> Kenneth
>>
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@xxxxxxxxxxxxxx
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux