This only works if you reshard on the primary zone. Like Yixin, we've tried resharding on the primary zone where data is held on a secondary zone and all that results in is a complete loss of all index data for the reshardd bucket on the secondary zone. The only way to use multisite resharding pre-reef that I know of where the data is going to sit in the secondary zone is to pre-reshard the bucket before any data is put in.
________________________________
From: Richard Bade <hitrich@xxxxxxxxx>
Sent: 09 October 2023 01:05
To: Yixin Jin <yjin77@xxxxxxxx>
Cc: Ceph-users <ceph-users@xxxxxxx>
Subject: Re: Manual resharding with multisite
CAUTION: This email originates from outside THG
Hi Yixin,
I am interested in the answers to your questions also but I think I
can provide some useful information for you.
We have a multisite setup also where we need to reshard sometimes as
the bucket have grown. However we have bucket sync turned off for
these buckets as they only reside on one gateway and not the other.
For these buckets I have been able to manually reshard using this command:
radosgw-admin bucket reshard --rgw-zone={zone_name}
--bucket={bucket_name} --num-shards {new_shard_number}
--yes-i-really-mean-it
I have not seen any issues with this, but like I said I only have data
on that one zone and not the other. This may not be useful for your
situation but I thought I'd mention it anyway.
I would really like to know what the correct procedure is for buckets
that have more than 100k objects per shard in a multisite environment.
Regards,
Rich
On Thu, 5 Oct 2023 at 06:51, Yixin Jin <yjin77@xxxxxxxx> wrote:
>
> Hi folks,
>
> I am aware that dynamic resharding isn't supported before Reef with multisite. However, does manual resharding work? It doesn't seem to be so, either. First of all, running "bucket reshard" has to be in the master zone. But if the objects of that bucket isn't in the master zone, resharding in the master zone seems to render those objects inaccessible in the zone that actually has them. So, what is recommended practice of resharding with multiste? No resharding at all?
>
> Thanks,
> Yixin
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
