multisite test suite: first, we need a way to issue continuous object writes/deletes *during* a bucket reshard. python makes this hard bucket reshard: * continuous stream of writes/deletes to a bucket in zone A, with one or more racing 'bucket reshard's on zone A, stop workload and verify that zone B's checkpoint succeeds * continuous stream of writes/deletes to a bucket in zone A, with one or more racing 'bucket reshard's on zone B, stop workload and verify that zone B's checkpoint succeeds * as above, but with *failed* bucket reshards using fault injection similar to https://github.com/ceph/ceph/blob/wip-rgw-multisite-reshard/qa/workunits/rgw/test_rgw_reshard.py#L240 bucket full sync: * test races into bucket full sync, activated from data sync on two different bucket shards: stop rgws on destination zone, create a bucket and upload objects to different shards, restart rgws on destination zone and wait for checkpoint metadata sync: * basic test that 'bucket reshard' on one zone does not change the 'bucket layout' on any peer zones (other zonegroups included) bucket sync init: * start some initial bucket sync, stop rgws on the destination zone, write some more data to the source zone, run 'bucket sync init' on the destination zone, then restart rgws and wait for bucket checkpoint * as above, but with one or more reshards somewhere in the middle of 'write some more data to the source zone' data sync init: * create several buckets and upload some objects, let destination zone catch up, stop rgws on destination, create more buckets and write more objects to source zone, run 'data sync init' on destination zone, restart rgws and wait for data checkpoint and all bucket checkpoints outside of the multisite tests, add new probabilistic sync error injection similar to rgw_sync_data_inject_err_probability which injects EIO errors on per-object sync. for example, inject ECANCELED errors into RGWBucketShardIsDoneCR to test races around transitions between bilog generations _______________________________________________ Dev mailing list -- dev@xxxxxxx To unsubscribe send an email to dev-leave@xxxxxxx
