On Fri, 5 Apr 2019 at 17:42, Casey Bodley <cbodley@xxxxxxxxxx> wrote: > > Hi Iain, > > Resharding is not supported in multisite. The issue is that the master zone needs to be authoritative for all metadata. If bucket reshard commands run on the secondary zone, they create new bucket instance metadata that the master zone never sees, so replication can't reconcile those changes. > > The 'stale-instances rm' command is not safe to run in multisite because it can misidentify as 'stale' some bucket instances that were deleted on the master zone, where data sync on the secondary zone hasn't yet finished deleting all of the objects it contained. Deleting these bucket instances and their associated bucket index objects would leave any remaining objects behind as orphans and leak storage capacity. > So that documentation should be removed then? Currently the master is receiving dozens of replication requests every second, most of which are 404s. I can't see anywhere on the secondaries where it is getting information on non-existent buckets from other than the thousands of stale index objects as already pointed out. The number of buckets is fixed in my cluster, there's no chance of misidentifying anything. They're dead index objects, and they have been causing large omap problems, it looks like the corrective action is to hand delete these and restart radosgw, but no one else who has done investigations into this has confirmed otherwise. -- Iain Buclaw *(p < e ? p++ : p) = (c & 0x0f) + '0'; _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |