Re: radosgw-agent, sync "zone_info.us-east": Http error code 500 content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Mon, Dec 16, 2013 at 8:22 PM, lin zhou 周林 <hnuzhoulin@xxxxxxxxx> wrote:
> Thanks for your reply.
> root@rceph0:~# radosgw-admin zone get --name client.radosgw.us-west-1
> { "domain_root": ".us-west.rgw.root",
>   "control_pool": ".us-west.rgw.control",
>   "gc_pool": ".us-west.rgw.gc",
>   "log_pool": ".us-west.log",
>   "intent_log_pool": ".us-west.intent-log",
>   "usage_log_pool": ".us-west.usage",
>   "user_keys_pool": ".us-west.users",
>   "user_email_pool": ".us-west.users.email",
>   "user_swift_pool": ".us-west.users.swift",
>   "user_uid_pool": ".us-west.users.uid",
>   "system_key": { "access_key": "G5DLUXD2HA07LDT10DRU",
>       "secret_key": "IPgisy2fW7WOX1xFqjtdPFR6fXPfupfDHEM4n4+H"},
>   "placement_pools": [
>         { "key": "default-placement",
>           "val": { "index_pool": ".us-west.rgw.buckets.index",
>               "data_pool": ".us-west.rgw.buckets"}}]}
>
> root pool setting in ceph.conf is below:
> [client.radosgw.us-west-1]
> rgw region = us
> rgw region root pool = .us.rgw.root
> rgw zone = us-west
> rgw zone root pool = .us-west.rgw.root
>
> or,can I delete this non-bucket metadata info ??

If you delete it you'd lose your zone and region configuration. Note
that you can use the region root pool for that purpose. So first copy
the relevant objects, e.g.,:

$ rados -p .us-west.rgw.root --target-pool=.us.rgw.root cp zone_info.us-west

and then you can remove them. But please make sure everything else
works before you remove them (e.g., you can still acess the zone).

Yehuda

>
> 2013/12/16 Yehuda Sadeh <yehuda@xxxxxxxxxxx>
>>
>> For some reason your bucket list seem to be returning some non-bucket
>> metadata info. Sounds like there's a mixup in the pools. What does
>> radosgw-admin zone get (for the us-west zone) return? What's your 'rgw
>> zone root pool' and 'rgw region root pool'?
>>
>> Yehuda
>>
>> On Sun, Dec 15, 2013 at 9:03 PM,  <hnuzhoulin@xxxxxxxxx> wrote:
>> > Hi,guys.
>> >
>> > I am using the character of geo-replication in ceph.
>> >
>> > I have two ceph clusters,so my plan is one region,in which two zones.
>> >
>> > Ceph version is ceph version 0.72.1
>> > (4d923861868f6a15dcb33fef7f50f674997322de)
>> >
>> >
>> >
>> >
>> >
>> > Now I can sync users and buckets from master zone to slave zone.
>> >
>> > But the object in bucket can not be synced.the error about object is:
>> >
>> > ERROR:radosgw_agent.worker:failed to sync object
>> > gci-replication-copytest1/628.png: state is error
>> >
>> >
>> >
>> > The following is the output when I run “radosgw-agent -c
>> > /etc/ceph/region-data-sync.conf --sync-scope full”:
>> >
>> >
>> >
>> > region map is: {u'us': [u'us-west', u'us-east']}
>> >
>> > INFO:root:syncing all metadata
>> >
>> > INFO:radosgw_agent.sync:Starting sync
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 33
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:1/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 5
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:2/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 6
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:3/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 1
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:4/19 items processed
>> >
>> > WARNING:radosgw_agent.worker:error getting metadata for bucket
>> > "zone_info.us-west": Http error code 500 content {"Code":"UnknownError"}
>> >
>> > Traceback (most recent call last):
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/worker.py", line
>> > 400,
>> > in sync_meta
>> >
>> >     metadata = client.get_metadata(self.src_conn, section, name)
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line
>> > 163,
>> > in get_metadata
>> >
>> >     params=dict(key=name))
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line
>> > 155,
>> > in request
>> >
>> >     check_result_status(result)
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line
>> > 116,
>> > in check_result_status
>> >
>> >     HttpError)(result.status_code, result.content)
>> >
>> > HttpError: Http error code 500 content {"Code":"UnknownError"}
>> >
>> > INFO:radosgw_agent.sync:5/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 28
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:6/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 42
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > WARNING:radosgw_agent.worker:error getting metadata for bucket
>> > "zone_info.us-east": Http error code 500 content {"Code":"UnknownError"}
>> >
>> > Traceback (most recent call last):
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/worker.py", line
>> > 400,
>> > in sync_meta
>> >
>> >     metadata = client.get_metadata(self.src_conn, section, name)
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line
>> > 163,
>> > in get_metadata
>> >
>> >     params=dict(key=name))
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line
>> > 155,
>> > in request
>> >
>> >     check_result_status(result)
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line
>> > 116,
>> > in check_result_status
>> >
>> >     HttpError)(result.status_code, result.content)
>> >
>> > HttpError: Http error code 500 content {"Code":"UnknownError"}
>> >
>> > INFO:radosgw_agent.sync:7/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 11
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 44
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:8/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 14
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:9/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 48
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:10/19 items processed
>> >
>> > INFO:radosgw_agent.sync:11/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 9
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 22
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:12/19 items processed
>> >
>> > INFO:radosgw_agent.sync:13/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 23
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:14/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 26
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 27
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.For some reason you have some non-bucket entries
>> > appear in your bucket list. What does radosgw-admin zone get
>> > --rgw-zone=us-west return?sync:15/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 60
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:16/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 61
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.sync:17/19 items processed
>> >
>> > WARNING:radosgw_agent.worker:error getting metadata for bucket
>> > "region_map":
>> > Http error code 500 content {"Code":"UnknownError"}
>> >
>> > Traceback (most recent call last):
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/worker.py", line
>> > 400,
>> > in sync_meta
>> >
>> >     metadata = client.get_metadata(self.src_conn, section, name)
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line
>> > 163,
>> > in get_metadata
>> >
>> >     params=dict(key=name))
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line
>> > 155,
>> > in request
>> >
>> >     check_result_status(result)
>> >
>> >   File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", line
>> > 116,
>> > in check_result_status
>> >
>> >     HttpError)(result.status_code, result.content)
>> >
>> > HttpError: Http error code 500 content {"Code":"UnknownError"}
>> >
>> > INFO:radosgw_agent.sync:18/19 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 62
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 16
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry items: []
>> >
>> > INFO:radosgw_agent.worker:No more entries in queue, exiting
>> >
>> > INFO:radosgw_agent.sync:19/19 items processed
>> >
>> > INFO:root:syncing all data
>> >
>> > INFO:radosgw_agent.sync:waiting to make sure bucket log is consistent
>> >
>> > INFO:radosgw_agent.sync:Starting sync
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 34
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry buckets:
>> > []
>> >
>> > INFO:radosgw_agent.sync:1/7 items processed
>> >
>> > INFO:radosgw_agent.sync:2/7 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 35
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry buckets:
>> > []
>> >
>> > INFO:radosgw_agent.sync:3/7 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 42
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry buckets:
>> > []
>> >
>> > ERROR:radosgw_agent.worker:error preparing for full sync of bucket
>> > "zone_info.us-east": Http error code 500 content {"Code":"UnknownError"}
>> >
>> > INFO:radosgw_agent.sync:4/7 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 98
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry buckets:
>> > [u'zone_info.us-east']
>> >
>> > INFO:radosgw_agent.sync:5/7 items processed
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 82
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry buckets:
>> > []
>> >
>> > ERROR:radosgw_agent.worker:error preparing for full sync of bucket
>> > "zone_info.us-west": Http error code 500 content {"Code":"UnknownError"}
>> >
>> > INFO:radosgw_agent.worker:finished syncing shard 115
>> >
>> > INFO:radosgw_agent.worker:incremental sync will need to retry buckets:
>> > [u'zone_info.us-west']
>> >
>> > INFO:radosgw_agent.sync:6/7 items processed
>> >
>> > ERROR:radosgw_agent.worker:error preparing for full sync of bucket
>> > "region_map": Http error code 500 content {"Code":"UnknownError"}
>> >
>> > INFO:radosgw_agent.sync:7/7 items processed
>> >
>> > ERROR:radosgw_agent.sync:Encountered errors syncing these 1 shards:
>> > [u'region_map']
>> >
>> > INFO:root:Finished full sync. Check logs to see any issues that
>> > incremental
>> > sync will retry.
>
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux