For some reason your bucket list seem to be returning some non-bucket metadata info. Sounds like there's a mixup in the pools. What does radosgw-admin zone get (for the us-west zone) return? What's your 'rgw zone root pool' and 'rgw region root pool'? Yehuda On Sun, Dec 15, 2013 at 9:03 PM, <hnuzhoulin@xxxxxxxxx> wrote: > Hi,guys. > > I am using the character of geo-replication in ceph. > > I have two ceph clusters,so my plan is one region,in which two zones. > > Ceph version is ceph version 0.72.1 > (4d923861868f6a15dcb33fef7f50f674997322de) > > > > > > Now I can sync users and buckets from master zone to slave zone. > > But the object in bucket can not be synced.the error about object is: > > ERROR:radosgw_agent.worker:failed to sync object > gci-replication-copytest1/628.png: state is error > > > > The following is the output when I run “radosgw-agent -c > /etc/ceph/region-data-sync.conf --sync-scope full”: > > > > region map is: {u'us': [u'us-west', u'us-east']} > > INFO:root:syncing all metadata > > INFO:radosgw_agent.sync:Starting sync > > INFO:radosgw_agent.worker:finished syncing shard 33 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:1/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 5 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:2/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 6 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:3/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 1 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:4/19 items processed > > WARNING:radosgw_agent.worker:error getting metadata for bucket > "zone_info.us-west": Http error code 500 content {"Code":"UnknownError"} > > Traceback (most recent call last): > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/worker.py", line 400, > in sync_meta > > metadata = client.get_metadata(self.src_conn, section, name) > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line 163, > in get_metadata > > params=dict(key=name)) > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line 155, > in request > > check_result_status(result) > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line 116, > in check_result_status > > HttpError)(result.status_code, result.content) > > HttpError: Http error code 500 content {"Code":"UnknownError"} > > INFO:radosgw_agent.sync:5/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 28 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:6/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 42 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > WARNING:radosgw_agent.worker:error getting metadata for bucket > "zone_info.us-east": Http error code 500 content {"Code":"UnknownError"} > > Traceback (most recent call last): > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/worker.py", line 400, > in sync_meta > > metadata = client.get_metadata(self.src_conn, section, name) > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line 163, > in get_metadata > > params=dict(key=name)) > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line 155, > in request > > check_result_status(result) > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line 116, > in check_result_status > > HttpError)(result.status_code, result.content) > > HttpError: Http error code 500 content {"Code":"UnknownError"} > > INFO:radosgw_agent.sync:7/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 11 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.worker:finished syncing shard 44 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:8/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 14 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:9/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 48 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:10/19 items processed > > INFO:radosgw_agent.sync:11/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 9 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.worker:finished syncing shard 22 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:12/19 items processed > > INFO:radosgw_agent.sync:13/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 23 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:14/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 26 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.worker:finished syncing shard 27 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.For some reason you have some non-bucket entries appear in your bucket list. What does radosgw-admin zone get --rgw-zone=us-west return?sync:15/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 60 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:16/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 61 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.sync:17/19 items processed > > WARNING:radosgw_agent.worker:error getting metadata for bucket "region_map": > Http error code 500 content {"Code":"UnknownError"} > > Traceback (most recent call last): > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/worker.py", line 400, > in sync_meta > > metadata = client.get_metadata(self.src_conn, section, name) > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line 163, > in get_metadata > > params=dict(key=name)) > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line 155, > in request > > check_result_status(result) > > File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line 116, > in check_result_status > > HttpError)(result.status_code, result.content) > > HttpError: Http error code 500 content {"Code":"UnknownError"} > > INFO:radosgw_agent.sync:18/19 items processed > > INFO:radosgw_agent.worker:finished syncing shard 62 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.worker:finished syncing shard 16 > > INFO:radosgw_agent.worker:incremental sync will need to retry items: [] > > INFO:radosgw_agent.worker:No more entries in queue, exiting > > INFO:radosgw_agent.sync:19/19 items processed > > INFO:root:syncing all data > > INFO:radosgw_agent.sync:waiting to make sure bucket log is consistent > > INFO:radosgw_agent.sync:Starting sync > > INFO:radosgw_agent.worker:finished syncing shard 34 > > INFO:radosgw_agent.worker:incremental sync will need to retry buckets: [] > > INFO:radosgw_agent.sync:1/7 items processed > > INFO:radosgw_agent.sync:2/7 items processed > > INFO:radosgw_agent.worker:finished syncing shard 35 > > INFO:radosgw_agent.worker:incremental sync will need to retry buckets: [] > > INFO:radosgw_agent.sync:3/7 items processed > > INFO:radosgw_agent.worker:finished syncing shard 42 > > INFO:radosgw_agent.worker:incremental sync will need to retry buckets: [] > > ERROR:radosgw_agent.worker:error preparing for full sync of bucket > "zone_info.us-east": Http error code 500 content {"Code":"UnknownError"} > > INFO:radosgw_agent.sync:4/7 items processed > > INFO:radosgw_agent.worker:finished syncing shard 98 > > INFO:radosgw_agent.worker:incremental sync will need to retry buckets: > [u'zone_info.us-east'] > > INFO:radosgw_agent.sync:5/7 items processed > > INFO:radosgw_agent.worker:finished syncing shard 82 > > INFO:radosgw_agent.worker:incremental sync will need to retry buckets: [] > > ERROR:radosgw_agent.worker:error preparing for full sync of bucket > "zone_info.us-west": Http error code 500 content {"Code":"UnknownError"} > > INFO:radosgw_agent.worker:finished syncing shard 115 > > INFO:radosgw_agent.worker:incremental sync will need to retry buckets: > [u'zone_info.us-west'] > > INFO:radosgw_agent.sync:6/7 items processed > > ERROR:radosgw_agent.worker:error preparing for full sync of bucket > "region_map": Http error code 500 content {"Code":"UnknownError"} > > INFO:radosgw_agent.sync:7/7 items processed > > ERROR:radosgw_agent.sync:Encountered errors syncing these 1 shards: > [u'region_map'] > > INFO:root:Finished full sync. Check logs to see any issues that incremental > sync will retry. _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com