Hi,
this is an old thing I remember of and it may not be exactly related but just in case, let’s try it out.
Just verify the value of the following parameter rgw_gc_max_objs in the RGW configuration via the admin socket (cep daemon {row.id} config get rgw_gc_max_objs
.
If the value is 32, update the ceph.conf file for your RGW and set it to 37 or any higher prime number such as 997 and restart your RGW. Make sure you do the restart before your next big batch of object removal. It will take some time to clear the overloaded buckets, may be, but it should at least distribute the new ones evenly onto all gc buckets after this and make the removal of the newly deleted objects way quicker.
Keep us posted to tell us if it has improved anything.
JC
> On Nov 14, 2014, at 01:20, Daniel Hoffman <daniel@xxxxxxxxxx> wrote:
>
> Hi All.
>
> Running a Ceph Cluster (firefly) ceph version 0.80.5
>
> We use ceph mainly for backups via the radosGW at the moment.
>
> There had to be an account deleted/bucket removed which had a very large number of objects and was about 60TB in space.
>
> We have been monitoring it for days now, and the data is purging but very very slowly. We are actually putting new backups in much faster than the old data is being removed.
>
> As we are doing a lot of work with backups and aging out data we need to find a way to improve the cleanup process.
>
> Is there a way to improve the purge/clean performance?
> Is the clean/purge performance impacted by disk thread ioprio class setting?
>
> Any advice or tunables to improve the removal of data is appreciated.
>
> Thanks
>
> Daniel
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
