Hi, the following parameters can be used to have more GC processing and more efficient - rgw_gc_max_objs defaults to 32 - rgw_gc_obj_min_wait defaults to 2 * 3600 - rgw_gc_processor_max_time defaults to 3600 - rgw_gc_processor_period defaults to 3600 It is recommended to set rgw_gc_max_objs with a prime number rather than the default value of 32 to have a better dispersion on the objects across the GC buckets. The minimum action here is to set this value to either 31 or to a higher prime number such as 97 for example. You can then play with the other parameters so that objects are picked up faster by the GC process and let the GC process run for longer period of time rather than the default values. This way you can adjust to your particular environment JC > On 8 Apr 2015, at 07:12, ceph@xxxxxxxxxxxxxx wrote: > > Hi, > > I have a Ceph cluster, used through radosgw. > In that cluster, I write files each seconds: input files are known, > predictible and stable, there is always the same number of new > fiexd-size files, each second. > > Theses files are kept a few days, then remove after a fixed duration. > And thus, I want to remove the same stable number of files each second > (I want to remove them faster than store them, or my cluster will grow > to death) > > On a daily-basis, I look at my files, remove the useless ones, and force > the gc process. > The first part of the process is quite fast (couple of minutes). > The last part (gc process) is, however, a bit slow. > > Is there a way to speed up the garbage collection ? > Is the GC dedicated to a radosgw (meaning : if I remove & gc process > from multiple radosgw, will the process be faster ?) > From my experiment, multithreading the gc process using some stuff like > parallel is not efficient (I guess gc processes are locking each others > or something): is that true ? > > Thanks for advises! > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |