typo, should read: { "name": "us-secondary", "endpoints": [ "http:\/\/us-secondary.example.com:80\/"], "log_meta": "true", "log_data": "true"} in region config below On 21/07/14 15:13, Peter wrote: > hello again, > > i couldn't find > 'http://us-secondary.example.comhttp://us-secondary.example.com/ > <http://us-secondary.example.com/>' in any zone or regions config > files. How could it be getting the URL from someplace else if i am > specifying as command line option after radosgw-agent ? > > > Here is region config: > >> { "name": "us", >> "api_name": "us", >> "is_master": "True", >> "endpoints": [ >> "http:\/\/us-master.example.com:80\/"], >> "master_zone": "us-master", >> "zones": [ >> { "name": "us-master", >> "endpoints": [ >> "http:\/\/us-master.example.com:80\/"], >> "log_meta": "true", >> "log_data": "true"}, >> { "name": "us-secondary", >> "endpoints": [ >> "http:\/\/us-master.example.com:80\/"], >> "log_meta": "true", >> "log_data": "true"} >> ], >> "placement_targets": [ >> { >> "name": "default-placement", >> "tags": [] >> } >> ], >> "default_placement": "default-placement"} > > I also get the above when i navigate to > http://us-master.example.com/admin/config and > http://us-secondary.example.com/admin/config . > > us-master zone looks like this: > >> { "domain_root": ".us-master.domain.rgw", >> "control_pool": ".us-master.rgw.control", >> "gc_pool": ".us-master.rgw.gc", >> "log_pool": ".us-master.log", >> "intent_log_pool": ".us-master.intent-log", >> "usage_log_pool": ".us-master.usage", >> "user_keys_pool": ".us-master.users", >> "user_email_pool": ".us-master.users.email", >> "user_swift_pool": ".us-master.users.swift", >> "user_uid_pool": ".us-master.users.uid", >> "system_key": { "access_key": "EA02UO07DA8JJJX7ZIPJ", "secret_key": >> "InmPlbQhsj7dqYYYYjdNabqkZaqR8ShWC6fS0XVo"}, >> "placement_pools": [ >> { "key": "default-placement", >> "val": { "index_pool": ".us-master.rgw.buckets.index", >> "data_pool": ".us-master.rgw.buckets"} >> } >> ] >> } > > us-secondary zone: > >> { "domain_root": ".us-secondary.domain.rgw", >> "control_pool": ".us-secondary.rgw.control", >> "gc_pool": ".us-secondary.rgw.gc", >> "log_pool": ".us-secondary.log", >> "intent_log_pool": ".us-secondary.intent-log", >> "usage_log_pool": ".us-secondary.usage", >> "user_keys_pool": ".us-secondary.users", >> "user_email_pool": ".us-secondary.users.email", >> "user_swift_pool": ".us-secondary.users.swift", >> "user_uid_pool": ".us-secondary.users.uid", >> "system_key": { "access_key": "EA02UO07DA8JJJX7ZIPJ", "secret_key": >> "InmPlbQhsj7dqYYYYjdNabqkZaqR8ShWC6fS0XVo"}, >> "placement_pools": [ >> { "key": "default-placement", >> "val": { "index_pool": ".us-secondary.rgw.buckets.index", >> "data_pool": ".us-secondary.rgw.buckets"} >> } >> ] >> } > > us-master user exists on us-master cluster gateway, us-secondary user > exists on us-secondary cluster gateway. both us-master and > us-secondary gateway users have same access and secret key. should > us-master and us-secondary users exist on both clusters? > > i can resolve us-master.example.com and us-secondary.example.com from > both gateways. > > > Thanks > > On 09/07/14 22:20, Craig Lewis wrote: >> Just to ask a couple obvious questions... >> >> You didn't accidentally >> put 'http://us-secondary.example.comhttp://us-secondary.example.com/ >> <http://us-secondary.example.com/>' in any of your region or zone >> configuration files? The fact that it's missing the :80 makes me >> think it's getting that URL from someplace that isn't the command line. >> >> You do have both system users on both clusters, with the same access >> and secret keys? >> >> You can resolve us-secondary.example.com >> <http://us-secondary.example.com>. from this host? >> >> >> I tested URLs of the form http://us-secondary.example.com/ and >> http://us-secondary.example.com:80 in my setup, and both work fine. >> >> >> >> On Wed, Jul 9, 2014 at 3:56 AM, Peter <ptiernan at tchpc.tcd.ie >> <mailto:ptiernan at tchpc.tcd.ie>> wrote: >> >> thank you for your reply. I am running ceph 0.80.1, radosgw-agent >> 1.2 on Ubuntu 14.04 LTS (GNU/Linux 3.13.0-24-generic x86_64) . I >> also ran into this same issue with ubuntu 12.04 previously. >> There are no special characters in the access or secret key (ive >> had issues with this before so i make sure of this). >> >> here is the output python interpreter: >> >> Python 2.7.6 (default, Mar 22 2014, 22:59:56) >> [GCC 4.8.2] on linux2 >> Type "help", "copyright", "credits" or "license" for more >> information. >> >> >>> import urlparse >> >>> result = >> urlparse.urlparse('http://us-secondary.example.com:80') >> >>> print result.hostname, result.port >> us-secondary.example.com <http://us-secondary.example.com> 80 >> >> >> that looks ok to me. >> >> >> >> On 07/07/14 22:57, Josh Durgin wrote: >> >> On 07/04/2014 08:36 AM, Peter wrote: >> >> i am having issues running radosgw-agent to sync data >> between two >> radosgw zones. As far as i can tell both zones are >> running correctly. >> >> My issue is when i run the radosgw-agent command: >> >> >> radosgw-agent -v --src-access-key <access_key> >> --src-secret-key >> <secret_key> --dest-access-key <access_key> >> --dest-secret-key >> <secret_key> --src-zone us-master >> http://us-secondary.example.com:80 >> >> >> i get the following error: >> >> |DEBUG:boto:Using access key provided by client.|| >> ||DEBUG:boto:Using secret key provided by client.|| >> ||DEBUG:boto:StringToSign:|| >> ||GET|| >> || >> ||Fri, 04 Jul 2014 15:25:53 GMT|| >> ||/admin/config|| >> ||DEBUG:boto:Signature:|| >> ||AWS EA20YO07DA8JJJX7ZIPJ:WbykwyXu5m5IlbEsBzo8bKEGIzg=|| >> ||DEBUG:boto:url = >> 'http://us-secondary.example.comhttp://us-secondary.example.com/admin/config'|| >> <http://us-secondary.example.com/admin/config%27%7C%7C> >> ||params={}|| >> ||headers={'Date': 'Fri, 04 Jul 2014 15:25:53 GMT', >> 'Content-Length': >> '0', 'Authorization': 'AWS >> EA20YO07DA8JJJX7ZIPJ:WbykwyXu5m5IlbEsBzo8bKEGIzg=', >> 'User-Agent': >> 'Boto/2.20.1 Python/2.7.6 Linux/3.13.0-24-generic'}|| >> ||data=None|| >> ||ERROR:root:Could not retrieve region map from destination|| >> ||Traceback (most recent call last):|| >> || File >> "/usr/lib/python2.7/dist-packages/radosgw_agent/cli.py", line >> 269, in main|| >> || region_map = client.get_region_map(dest_conn)|| >> || File >> "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", >> line 391, in get_region_map|| >> || region_map = request(connection, 'get', >> 'admin/config')|| >> || File >> "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", >> line 153, in request|| >> || result = handler(url, params=params, >> headers=request.headers, >> data=data)|| >> || File >> "/usr/lib/python2.7/dist-packages/requests/api.py", line >> 55, in >> get|| >> || return request('get', url, **kwargs)|| >> || File >> "/usr/lib/python2.7/dist-packages/requests/api.py", line >> 44, in >> request|| >> || return session.request(method=method, url=url, >> **kwargs)|| >> || File >> "/usr/lib/python2.7/dist-packages/requests/sessions.py", line >> 349, in request|| >> || prep = self.prepare_request(req)|| >> || File >> "/usr/lib/python2.7/dist-packages/requests/sessions.py", line >> 287, in prepare_request|| >> || hooks=merge_hooks(request.hooks, self.hooks),|| >> || File >> "/usr/lib/python2.7/dist-packages/requests/models.py", line >> 287, in prepare|| >> || self.prepare_url(url, params)|| >> || File >> "/usr/lib/python2.7/dist-packages/requests/models.py", line >> 334, in prepare_url|| >> || scheme, auth, host, port, path, query, fragment = >> parse_url(url)|| >> || File >> "/usr/lib/python2.7/dist-packages/urllib3/util.py", line 390, >> in parse_url|| >> || raise LocationParseError("Failed to parse: %s" % url)|| >> ||LocationParseError: Failed to parse: Failed to parse: >> us-secondary.example.comhttp: >> >> >> |||Is this a bug? or is my setup wrong? i can navigate to >> http://us-secondary.example.com/admin/config and it >> correctly outputs >> zone details. at the output above >> >> >> It seems like an issue with your environment. What version of >> radosgw-agent and which distro is this running on? >> >> Are there any special characters in the access or secret keys >> that >> might need to be escaped on the command line? >> >> |DEBUG:boto:url = >> 'http://us-secondary.example.comhttp://us-secondary.example.com/admin/config'|| >> <http://us-secondary.example.com/admin/config%27%7C%7C> >> >> >> |should the url be repeated like that? >> >> >> No, and it's rather strange since it should be the url passed >> on the >> command line, parsed, and with /admin/config added. >> >> Could post the result of this run in a python interpreter: >> >> import urlparse >> result = urlparse.urlparse('http://us-secondary.example.com:80') >> print result.hostname, result.port >> >> Josh >> >> >> _______________________________________________ >> ceph-users mailing list >> ceph-users at lists.ceph.com <mailto:ceph-users at lists.ceph.com> >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> >> > > > > _______________________________________________ > ceph-users mailing list > ceph-users at lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140721/4c6dafdf/attachment.htm>