2015-04-29T16:17:55.090 32311:DEBUG:radosgw_agent.worker:syncing object "my-container/us.json"
2015-04-29T16:17:55.090 32311:DEBUG:radosgw_agent.worker:sync_object my-container/us.json
2015-04-29T16:17:55.091 32311:DEBUG:boto:StringToSign:
PUT
Wed, 29 Apr 2015 08:17:55 GMT
x-amz-copy-source:my-container/us.json
/my-container/us.json
2015-04-29T16:17:55.092 32311:DEBUG:boto:Signature:
AWS XNK0ST8WXTMWZGN29NF9:/OtskqtLZBV7zyUMo4/35hVu0k0=
2015-04-29T16:17:55.092 32311:DEBUG:boto:url = ''
params={'rgwx-op-id': 'CEPH-GATEWAY11.MATRIX.CTRIPCORP.COM:32225:1', 'rgwx-source-zone': u'us-east', 'rgwx-client-id': 'radosgw-agent'}
headers={'Content-Length': 0, 'User-Agent': 'Boto/2.34.0 Python/2.6.6 Linux/2.6.32-358.el6.x86_64', 'x-amz-copy-source': 'my-container/us.json', 'Date': 'Wed, 29 Apr 2015 08:17:55 GMT', 'Content-Type': 'application/json; charset=UTF-8', 'Authorization': u'AWS XNK0ST8WXTMWZGN29NF9:/OtskqtLZBV7zyUMo4/35hVu0k0='}
data="">2015-04-29T16:17:55.094 32311:INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): ceph-gateway12.matrix.ctripcorp.com
2015-04-29T16:17:55.109 32311:DEBUG:requests.packages.urllib3.connectionpool:"PUT /my-container/us.json?rgwx-op-id=CEPH-GATEWAY11.MATRIX.CTRIPCORP.COM%3A32225%3A1&rgwx-source-zone=us-east&rgwx-client-id=radosgw-agent HTTP/1.1" 400 81
2015-04-29T16:17:55.110 32311:DEBUG:radosgw_agent.worker:exception during sync: Http error code 400 content <?xml version="1.0" encoding="UTF-8"?><Error><Code>InvalidArgument</Code></Error>
2015-04-29T16:17:55.111 32311:DEBUG:boto:StringToSign:
GET
Wed, 29 Apr 2015 08:17:55 GMT
/admin/opstate
2015-04-29T16:17:55.111 32311:DEBUG:boto:Signature:
AWS XNK0ST8WXTMWZGN29NF9:knSr607RXpSM6nHGHPm+gPfHo5M=
2015-04-29T16:17:55.111 32311:DEBUG:boto:url = ''
params={'client-id': 'radosgw-agent', 'object': u'my-container/us.json', 'op-id': 'CEPH-GATEWAY11.MATRIX.CTRIPCORP.COM:32225:1'}
headers={'Date': 'Wed, 29 Apr 2015 08:17:55 GMT', 'Content-Length': 0, 'Authorization': u'AWS XNK0ST8WXTMWZGN29NF9:knSr607RXpSM6nHGHPm+gPfHo5M=', 'User-Agent': 'Boto/2.34.0 Python/2.6.6 Linux/2.6.32-358.el6.x86_64'}
data="">2015-04-29T16:17:55.113 32311:INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): ceph-gateway12.matrix.ctripcorp.com
2015-04-29T16:17:55.118 32311:DEBUG:requests.packages.urllib3.connectionpool:"GET /admin/opstate?client-id=radosgw-agent&object=my-container%2Fus.json&op-id=CEPH-GATEWAY11.MATRIX.CTRIPCORP.COM%3A32225%3A1 HTTP/1.1" 200 None
2015-04-29T16:17:55.119 32311:DEBUG:radosgw_agent.worker:op state is [{u'timestamp': u'2015-04-29 08:17:57.054600Z', u'op_id': u'CEPH-GATEWAY11.MATRIX.CTRIPCORP.COM:32225:1', u'object': u'my-container/us.json', u'state': u'error', u'client_id': u'radosgw-agent'}]
2015-04-29T16:17:55.120 32311:ERROR:radosgw_agent.worker:failed to sync object my-container/us.json: state is error
2015-04-29T16:17:55.120 32311:DEBUG:radosgw_agent.worker:bucket my-container has 1 object
2015-04-29T16:17:55.120 32311:DEBUG:radosgw_agent.worker:these objects failed to be synced and will be during the next incremental sync: [u'us.json']
2015-04-29T16:17:55.120 32311:DEBUG:boto:set_worker_bound: data = "" u'us.json', 'time': '1970-01-01 00:00:00'}]
2015-04-29T16:17:55.121 32311:DEBUG:boto:path=/admin/replica_log?work_bound
2015-04-29T16:17:55.121 32311:DEBUG:boto:auth_path=/admin/replica_log?work_bound
2015-04-29T16:17:55.121 32311:DEBUG:boto:StringToSign:
POST
Wed, 29 Apr 2015 08:17:55 GMT
/admin/replica_log
2015-04-29T16:17:55.122 32311:DEBUG:boto:Signature:
AWS XNK0ST8WXTMWZGN29NF9:s5gpfNb4kFE97CDYUkJ+AttAx1E=
set -e
set -x
#1 create pools
sudo ./create_pools.sh
sudo ceph-authtool --create-keyring /etc/ceph/ceph.client.radosgw.keyring
sudo chmod +r /etc/ceph/ceph.client.radosgw.keyring
sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.us-east-1 --gen-key
sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.us-west-1 --gen-key
sudo ceph-authtool -n client.radosgw.us-west-1 --cap osd 'allow rwx' --cap mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring
sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth del client.radosgw.us-west-1
sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-east-1 -i /etc/ceph/ceph.client.radosgw.keyring
sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-west-1 -i /etc/ceph/ceph.client.radosgw.keyring
sudo radosgw-admin region set --infile us.json --name client.radosgw.us-east-1
set +e
sudo rados -p .us.rgw.root rm region_info.default
set -e
sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-east-1
sudo radosgw-admin regionmap update --name client.radosgw.us-east-1
sudo radosgw-admin region set --infile us.json --name client.radosgw.us-west-1
set +e
sudo rados -p .us.rgw.root rm region_info.default
set -e
sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-west-1
sudo radosgw-admin regionmap update --name client.radosgw.us-west-1
# try chanege us-east-no-secert.json file contents
sudo radosgw-admin zone set --rgw-zone=us-east --infile us-east-no-secert.json --name client.radosgw.us-east-1
sudo radosgw-admin zone set --rgw-zone=us-east --infile us-east-no-secert.json --name client.radosgw.us-west-1
sudo radosgw-admin zone set --rgw-zone=us-west --infile us-west-no-secert.json --name client.radosgw.us-west-1
sudo rados -p .rgw.root rm zone_info.default
set -e
sudo radosgw-admin regionmap update --name client.radosgw.us-east-1
# try don't do it
sudo radosgw-admin regionmap update --name client.radosgw.us-west-1
sudo radosgw-admin user create --uid="us-east" --display-name="Region-US Zone-East" --name client.radosgw.us-east-1 --access_key="XNK0ST8WXTMWZGN29NF9" --secret="7VJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5" --system
sudo radosgw-admin user create --uid="us-west" --display-name="Region-US Zone-West" --name client.radosgw.us-west-1 --access_key="AAK0ST8WXTMWZGN29NF9" --secret="AAJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5" --system
sudo radosgw-admin user create --uid="us-west" --display-name="Region-US Zone-West" --name client.radosgw.us-east-1 --access_key="AAK0ST8WXTMWZGN29NF9" --secret="AAJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5" --system
#may create a user without --system?
sudo radosgw-admin subuser create --uid="us-east" --subuser="us-east:swift" --access=full --name client.radosgw.us-east-1 --key-type swift --secret="7VJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
#5.5 creat zone users not system user
sudo radosgw-admin user create --uid="us-test-east" --display-name="Region-US Zone-East-test" --name client.radosgw.us-east-1 --access_key="DDK0ST8WXTMWZGN29NF9" --secret="DDJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin user create --uid="us-test-west" --display-name="Region-US Zone-West-test" --name client.radosgw.us-west-1 --access_key="CCK0ST8WXTMWZGN29NF9" --secret="CCJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin user create --uid="us-test-west" --display-name="Region-US Zone-West-test" --name client.radosgw.us-east-1 --access_key="CCK0ST8WXTMWZGN29NF9" --secret="CCJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
#6 subuser create
#may create a user without --system?
sudo radosgw-admin subuser create --uid="us-test-east" --subuser="us-test-east:swift" --access=full --name client.radosgw.us-east-1 --key-type swift --secret="ffJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
export ST_KEY=ffJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5
export ST_USER=us-test-east:swift
INFO:radosgw_agent.worker:32078 is processing shard number 0
INFO:radosgw_agent.worker:finished processing shard 0
INFO:radosgw_agent.worker:32078 is processing shard number 1
INFO:radosgw_agent.sync:1/64 items processed
INFO:radosgw_agent.sync:2/64 items processed
INFO:radosgw_agent.worker:finished processing shard 1
INFO:radosgw_agent.worker:32078 is processing shard number 2
INFO:radosgw_agent.sync:3/64 items processed
INFO:radosgw_agent.worker:finished processing shard 2
INFO:radosgw_agent.worker:32078 is processing shard number 3
INFO:radosgw_agent.sync:4/64 items processed
INFO:radosgw_agent.worker:finished processing shard 3
INFO:radosgw_agent.worker:32078 is processing shard number 4
INFO:radosgw_agent.sync:5/64 items processed
INFO:radosgw_agent.worker:finished processing shard 4
INFO:radosgw_agent.worker:32078 is processing shard number 5
INFO:radosgw_agent.sync:6/64 items processed
INFO:radosgw_agent.worker:finished processing shard 5
INFO:radosgw_agent.worker:32078 is processing shard number 6
INFO:radosgw_agent.sync:7/64 items processed
INFO:radosgw_agent.worker:finished processing shard 6
INFO:radosgw_agent.worker:32078 is processing shard number 7
INFO:radosgw_agent.sync:8/64 items processed
INFO:radosgw_agent.worker:finished processing shard 7
INFO:radosgw_agent.worker:32078 is processing shard number 8
INFO:radosgw_agent.sync:9/64 items processed
INFO:radosgw_agent.worker:finished processing shard 8
INFO:radosgw_agent.worker:32078 is processing shard number 9
INFO:radosgw_agent.sync:10/64 items processed
INFO:radosgw_agent.worker:finished processing shard 9
INFO:radosgw_agent.worker:32078 is processing shard number 10
INFO:radosgw_agent.sync:11/64 items processed
INFO:radosgw_agent.worker:finished processing shard 10
INFO:radosgw_agent.worker:32078 is processing shard number 11
INFO:radosgw_agent.sync:12/64 items processed
INFO:radosgw_agent.worker:finished processing shard 11
INFO:radosgw_agent.worker:32078 is processing shard number 12
INFO:radosgw_agent.sync:13/64 items processed
INFO:radosgw_agent.worker:finished processing shard 12
INFO:radosgw_agent.worker:32078 is processing shard number 13
INFO:radosgw_agent.sync:14/64 items processed
INFO:radosgw_agent.worker:finished processing shard 13
INFO:radosgw_agent.worker:32078 is processing shard number 14
INFO:radosgw_agent.sync:15/64 items processed
INFO:radosgw_agent.worker:finished processing shard 14
INFO:radosgw_agent.worker:32078 is processing shard number 15
INFO:radosgw_agent.sync:16/64 items processed
INFO:radosgw_agent.worker:finished processing shard 15
INFO:radosgw_agent.worker:32078 is processing shard number 16
INFO:radosgw_agent.sync:17/64 items processed
INFO:radosgw_agent.worker:finished processing shard 16
INFO:radosgw_agent.worker:32078 is processing shard number 17
INFO:radosgw_agent.sync:18/64 items processed
INFO:radosgw_agent.worker:finished processing shard 17
INFO:radosgw_agent.worker:32078 is processing shard number 18
INFO:radosgw_agent.sync:19/64 items processed
INFO:radosgw_agent.worker:finished processing shard 18
INFO:radosgw_agent.worker:32078 is processing shard number 19
INFO:radosgw_agent.sync:20/64 items processed
INFO:radosgw_agent.worker:finished processing shard 19
INFO:radosgw_agent.worker:32078 is processing shard number 20
INFO:radosgw_agent.sync:21/64 items processed
INFO:radosgw_agent.worker:finished processing shard 20
INFO:radosgw_agent.worker:32078 is processing shard number 21
INFO:radosgw_agent.sync:22/64 items processed
INFO:radosgw_agent.worker:finished processing shard 21
INFO:radosgw_agent.worker:32078 is processing shard number 22
INFO:radosgw_agent.sync:23/64 items processed
INFO:radosgw_agent.worker:finished processing shard 22
INFO:radosgw_agent.worker:32078 is processing shard number 23
INFO:radosgw_agent.sync:24/64 items processed
INFO:radosgw_agent.worker:finished processing shard 23
INFO:radosgw_agent.worker:32078 is processing shard number 24
INFO:radosgw_agent.sync:25/64 items processed
INFO:radosgw_agent.worker:finished processing shard 24
INFO:radosgw_agent.worker:32078 is processing shard number 25
INFO:radosgw_agent.sync:26/64 items processed
INFO:radosgw_agent.worker:finished processing shard 25
INFO:radosgw_agent.worker:32078 is processing shard number 26
INFO:radosgw_agent.sync:27/64 items processed
INFO:radosgw_agent.worker:finished processing shard 26
INFO:radosgw_agent.worker:32078 is processing shard number 27
INFO:radosgw_agent.sync:28/64 items processed
INFO:radosgw_agent.worker:finished processing shard 27
INFO:radosgw_agent.worker:32078 is processing shard number 28
INFO:radosgw_agent.sync:29/64 items processed
INFO:radosgw_agent.worker:finished processing shard 28
INFO:radosgw_agent.worker:32078 is processing shard number 29
INFO:radosgw_agent.sync:30/64 items processed
INFO:radosgw_agent.worker:finished processing shard 29
INFO:radosgw_agent.worker:32078 is processing shard number 30
INFO:radosgw_agent.sync:31/64 items processed
INFO:radosgw_agent.worker:finished processing shard 30
INFO:radosgw_agent.worker:32078 is processing shard number 31
****************************************************************
mobile: +358 503 812758
tel. +358 9 4572001
fax +358 9 4572302
http://www.csc.fi/
On 28 Apr 2015, at 21:22, Karan Singh <karan.singh@xxxxxx> wrote:
You should try to create a new user without —system option so basically create a normal user , then create some bucket and object and finally try to resync cluster.
-Karan-
On 28 Apr 2015, at 10:32, TERRY <316828252@xxxxxx> wrote:
Hi:
karan, singh. First of all thank you so much for replying and giving your precious time to this problem!
I tried repeat steps 2, 4 and 5 in by executing them with --nameclient.radosgw-us-west-1. and the case has progressed a lot。(below are some the logs)
I am now getting
sudo radosgw-agent -c ceph-data-sync2.conf
region map is: {u'us': [u'us-west', u'us-east']}
INFO:radosgw_agent.sync:Starting sync
INFO:radosgw_agent.worker:20585 is processing shard number 0
INFO:radosgw_agent.worker:finished processing shard 0
INFO:radosgw_agent.worker:20585 is processing shard number 1
INFO:radosgw_agent.sync:1/64 items processed
INFO:radosgw_agent.sync:2/64 items processed
INFO:radosgw_agent.worker:finished processing shard 1
INFO:radosgw_agent.worker:20585 is processing shard number 2
INFO:radosgw_agent.sync:3/64 items processed
INFO:radosgw_agent.worker:finished processing shard 2
INFO:radosgw_agent.worker:20585 is processing shard number 3
INFO:radosgw_agent.sync:4/64 items processed
INFO:radosgw_agent.worker:finished processing shard 3
INFO:radosgw_agent.worker:20585 is processing shard number 4
INFO:radosgw_agent.sync:5/64 items processed
INFO:radosgw_agent.worker:finished processing shard 4
INFO:radosgw_agent.worker:20585 is processing shard number 5
INFO:radosgw_agent.sync:6/64 items processed
INFO:radosgw_agent.worker:finished processing shard 5
INFO:radosgw_agent.worker:20585 is processing shard number 6
INFO:radosgw_agent.sync:7/64 items processed
INFO:radosgw_agent.worker:finished processing shard 6
INFO:radosgw_agent.worker:20585 is processing shard number 7
INFO:radosgw_agent.sync:8/64 items processed
INFO:radosgw_agent.worker:finished processing shard 7
INFO:radosgw_agent.worker:20585 is processing shard number 8
INFO:radosgw_agent.sync:9/64 items processed
INFO:radosgw_agent.worker:finished processing shard 8
INFO:radosgw_agent.worker:20585 is processing shard number 9
INFO:radosgw_agent.sync:10/64 items processed
INFO:radosgw_agent.worker:finished processing shard 9
INFO:radosgw_agent.worker:20585 is processing shard number 10
INFO:radosgw_agent.sync:11/64 items processed
INFO:radosgw_agent.worker:finished processing shard 10
INFO:radosgw_agent.worker:20585 is processing shard number 11
INFO:radosgw_agent.sync:12/64 items processed
INFO:radosgw_agent.worker:finished processing shard 11
INFO:radosgw_agent.worker:20585 is processing shard number 12
INFO:radosgw_agent.sync:13/64 items processed
INFO:radosgw_agent.worker:finished processing shard 12
INFO:radosgw_agent.worker:20585 is processing shard number 13
INFO:radosgw_agent.sync:14/64 items processed
INFO:radosgw_agent.worker:finished processing shard 13
INFO:radosgw_agent.worker:20585 is processing shard number 14
INFO:radosgw_agent.sync:15/64 items processed
INFO:radosgw_agent.worker:finished processing shard 14
INFO:radosgw_agent.worker:20585 is processing shard number 15
INFO:radosgw_agent.sync:16/64 items processed
INFO:radosgw_agent.worker:finished processing shard 15
INFO:radosgw_agent.worker:20585 is processing shard number 16
INFO:radosgw_agent.sync:17/64 items processed
INFO:radosgw_agent.worker:finished processing shard 16
INFO:radosgw_agent.worker:20585 is processing shard number 17......
......
......
INFO:radosgw_agent.worker:syncing bucket "my_container"
ERROR:radosgw_agent.worker:failed to sync object my_container/us.json: state is errorfyi: my_container is created by me in master zone, us.json is a object in my_container.
i want to sync the object us.json to zone us-west zone.
------------------ 原始邮件 ------------------发件人: "Karan Singh";<karan.singh@xxxxxx>;发送时间: 2015年4月28日(星期二) 下午3:02收件人: "TERRY"<316828252@xxxxxx>;抄送: "ceph-users"<ceph-users@xxxxxxxxxxxxxx>;主题: Re: [ceph-users] about rgw region and zoneHi
On 28 Apr 2015, at 07:12, TERRY <316828252@xxxxxx> wrote:
Hi: allwhen I Configuring Federated Gateways, I got the error as below:sudo radosgw-agent -c /etc/ceph/ceph-data-sync.conf
ERROR:root:Could not retrieve region map from destinationYou should check that the region map is correct , especially the endpoints. Make sure firewall is not blocking the way between RGW instances.
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/radosgw_agent/cli.py", line 269, in main
region_map = client.get_region_map(dest_conn)
File "/usr/lib/python2.6/site-packages/radosgw_agent/client.py", line 391, in get_region_map
region_map = request(connection, 'get', 'admin/config')
File "/usr/lib/python2.6/site-packages/radosgw_agent/client.py", line 155, in request
check_result_status(result)
File "/usr/lib/python2.6/site-packages/radosgw_agent/client.py", line 116, in check_result_status
HttpError)(result.status_code, result.content)
NotFound: Http error code 404 content {"Code":"NoSuchKey”}Cross verify the key
I have some quesions when I execute the command1、radosgw-admin zone set --rgw-zone=us-west --infile us-west.json --name client.radosgw.us-west-1i have no idea about the option --name , what's the difference if i do it without --name config;—name us used to supply ceph user name that should be used to run radosgw-admin command against. Default is client.admin , if client.admin keyring are not present you need to supply another user with —name option to run Ceph commands.
2、Create a Regionthere is a conversation near the end of doc :If you use different Ceph Storage Cluster instances for regions, you should repeat steps 2, 4 and 5 in by executing them with --nameclient.radosgw-us-west-1. You may also export the region map from the initial gateway instance and import it followed by updating the region map.I has one cluster named ceph, one region named us, and two zones: us-east、 us-west, us-east is the master zone. I has two gateway instances:client.radosgw.us-east-1、client.radosgw.us-west-1. Do i need repeat steps 2,4,and 5? do i need export the region map from the initial gateway instance and import itIf you have 2 Different Ceph Cluster then only you should do this. I assume you have only 1 Ceph cluster with 1 region and 2 zones and 2 gateway instances , then you need not to repeat those steps.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com