Re: cephfs rm -rf on directory of 160TB /40M files

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Mon, Apr 4, 2016 at 9:55 AM, Gregory Farnum <gfarnum@xxxxxxxxxx> wrote:
> Deletes are just slow right now. You can look at the ops in flight on you
> client or MDS admin socket to see how far along it is and watch them to see
> how long stuff is taking -- I think it's a sync disk commit for each unlink
> though so at 40M it's going to be a good looong while. :/
> -Greg

Oh good, I misremembered — it's a synchronous request to the MDS, but
it's not a synchronous disk commit. They get batched up normally in
the metadata log. :)
Still, a sync MDS request can take a little bit of time. Someday we
will make the client able to respond to these more quickly locally and
batch up MDS requests or something, but it'll be tricky. Faster file
creates will probably come first. (If we're lucky they can use some of
the same client-side machinery.)
-Greg

>
>
> On Monday, April 4, 2016, Kenneth Waegeman <kenneth.waegeman@xxxxxxxx>
> wrote:
>>
>> Hi all,
>>
>> I want to remove a large directory containing +- 40M files /160TB of data
>> in CephFS by running rm -rf on the directory via the ceph kernel client.
>> After 7h , the rm command is still running. I checked the rados df output,
>> and saw that only about  2TB and 2M files are gone.
>> I know this output of rados df can be confusing because ceph should delete
>> objects asyncroniously, but then I don't know why the rm command still
>> hangs.
>> Is there some way to speed this up? And is there a way to check how far
>> the marked for deletion has progressed ?
>>
>> Thank you very much!
>>
>> Kenneth
>>
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@xxxxxxxxxxxxxx
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux