hello again, i couldn't find 'http://us-secondary.example.comhttp://us-secondary.example.com/ <http://us-secondary.example.com/>' in any zone or regions config files. How could it be getting the URL from someplace else if i am specifying as command line option after radosgw-agent ? Here is region config: > { "name": "us", > "api_name": "us", > "is_master": "True", > "endpoints": [ > "http:\/\/us-master.example.com:80\/"], > "master_zone": "us-master", > "zones": [ > { "name": "us-master", > "endpoints": [ > "http:\/\/us-master.example.com:80\/"], > "log_meta": "true", > "log_data": "true"}, > { "name": "us-secondary", > "endpoints": [ > "http:\/\/us-master.example.com:80\/"], > "log_meta": "true", > "log_data": "true"} > ], > "placement_targets": [ > { > "name": "default-placement", > "tags": [] > } > ], > "default_placement": "default-placement"} I also get the above when i navigate to http://us-master.example.com/admin/config and http://us-secondary.example.com/admin/config . us-master zone looks like this: > { "domain_root": ".us-master.domain.rgw", > "control_pool": ".us-master.rgw.control", > "gc_pool": ".us-master.rgw.gc", > "log_pool": ".us-master.log", > "intent_log_pool": ".us-master.intent-log", > "usage_log_pool": ".us-master.usage", > "user_keys_pool": ".us-master.users", > "user_email_pool": ".us-master.users.email", > "user_swift_pool": ".us-master.users.swift", > "user_uid_pool": ".us-master.users.uid", > "system_key": { "access_key": "EA02UO07DA8JJJX7ZIPJ", "secret_key": > "InmPlbQhsj7dqYYYYjdNabqkZaqR8ShWC6fS0XVo"}, > "placement_pools": [ > { "key": "default-placement", > "val": { "index_pool": ".us-master.rgw.buckets.index", > "data_pool": ".us-master.rgw.buckets"} > } > ] > } us-secondary zone: > { "domain_root": ".us-secondary.domain.rgw", > "control_pool": ".us-secondary.rgw.control", > "gc_pool": ".us-secondary.rgw.gc", > "log_pool": ".us-secondary.log", > "intent_log_pool": ".us-secondary.intent-log", > "usage_log_pool": ".us-secondary.usage", > "user_keys_pool": ".us-secondary.users", > "user_email_pool": ".us-secondary.users.email", > "user_swift_pool": ".us-secondary.users.swift", > "user_uid_pool": ".us-secondary.users.uid", > "system_key": { "access_key": "EA02UO07DA8JJJX7ZIPJ", "secret_key": > "InmPlbQhsj7dqYYYYjdNabqkZaqR8ShWC6fS0XVo"}, > "placement_pools": [ > { "key": "default-placement", > "val": { "index_pool": ".us-secondary.rgw.buckets.index", > "data_pool": ".us-secondary.rgw.buckets"} > } > ] > } us-master user exists on us-master cluster gateway, us-secondary user exists on us-secondary cluster gateway. both us-master and us-secondary gateway users have same access and secret key. should us-master and us-secondary users exist on both clusters? i can resolve us-master.example.com and us-secondary.example.com from both gateways. Thanks On 09/07/14 22:20, Craig Lewis wrote: > Just to ask a couple obvious questions... > > You didn't accidentally > put 'http://us-secondary.example.comhttp://us-secondary.example.com/ > <http://us-secondary.example.com/>' in any of your region or zone > configuration files? The fact that it's missing the :80 makes me > think it's getting that URL from someplace that isn't the command line. > > You do have both system users on both clusters, with the same access > and secret keys? > > You can resolve us-secondary.example.com > <http://us-secondary.example.com>. from this host? > > > I tested URLs of the form http://us-secondary.example.com/ and > http://us-secondary.example.com:80 in my setup, and both work fine. > > > > On Wed, Jul 9, 2014 at 3:56 AM, Peter <ptiernan at tchpc.tcd.ie > <mailto:ptiernan at tchpc.tcd.ie>> wrote: > > thank you for your reply. I am running ceph 0.80.1, radosgw-agent > 1.2 on Ubuntu 14.04 LTS (GNU/Linux 3.13.0-24-generic x86_64) . I > also ran into this same issue with ubuntu 12.04 previously. > There are no special characters in the access or secret key (ive > had issues with this before so i make sure of this). > > here is the output python interpreter: > > Python 2.7.6 (default, Mar 22 2014, 22:59:56) > [GCC 4.8.2] on linux2 > Type "help", "copyright", "credits" or "license" for more > information. > > >>> import urlparse > >>> result = > urlparse.urlparse('http://us-secondary.example.com:80') > >>> print result.hostname, result.port > us-secondary.example.com <http://us-secondary.example.com> 80 > > > that looks ok to me. > > > > On 07/07/14 22:57, Josh Durgin wrote: > > On 07/04/2014 08:36 AM, Peter wrote: > > i am having issues running radosgw-agent to sync data > between two > radosgw zones. As far as i can tell both zones are running > correctly. > > My issue is when i run the radosgw-agent command: > > > radosgw-agent -v --src-access-key <access_key> > --src-secret-key > <secret_key> --dest-access-key <access_key> > --dest-secret-key > <secret_key> --src-zone us-master > http://us-secondary.example.com:80 > > > i get the following error: > > |DEBUG:boto:Using access key provided by client.|| > ||DEBUG:boto:Using secret key provided by client.|| > ||DEBUG:boto:StringToSign:|| > ||GET|| > || > ||Fri, 04 Jul 2014 15:25:53 GMT|| > ||/admin/config|| > ||DEBUG:boto:Signature:|| > ||AWS EA20YO07DA8JJJX7ZIPJ:WbykwyXu5m5IlbEsBzo8bKEGIzg=|| > ||DEBUG:boto:url = > 'http://us-secondary.example.comhttp://us-secondary.example.com/admin/config'|| > <http://us-secondary.example.com/admin/config%27%7C%7C> > ||params={}|| > ||headers={'Date': 'Fri, 04 Jul 2014 15:25:53 GMT', > 'Content-Length': > '0', 'Authorization': 'AWS > EA20YO07DA8JJJX7ZIPJ:WbykwyXu5m5IlbEsBzo8bKEGIzg=', > 'User-Agent': > 'Boto/2.20.1 Python/2.7.6 Linux/3.13.0-24-generic'}|| > ||data=None|| > ||ERROR:root:Could not retrieve region map from destination|| > ||Traceback (most recent call last):|| > || File > "/usr/lib/python2.7/dist-packages/radosgw_agent/cli.py", line > 269, in main|| > || region_map = client.get_region_map(dest_conn)|| > || File > "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", > line 391, in get_region_map|| > || region_map = request(connection, 'get', > 'admin/config')|| > || File > "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py", > line 153, in request|| > || result = handler(url, params=params, > headers=request.headers, > data=data)|| > || File > "/usr/lib/python2.7/dist-packages/requests/api.py", line > 55, in > get|| > || return request('get', url, **kwargs)|| > || File > "/usr/lib/python2.7/dist-packages/requests/api.py", line > 44, in > request|| > || return session.request(method=method, url=url, > **kwargs)|| > || File > "/usr/lib/python2.7/dist-packages/requests/sessions.py", line > 349, in request|| > || prep = self.prepare_request(req)|| > || File > "/usr/lib/python2.7/dist-packages/requests/sessions.py", line > 287, in prepare_request|| > || hooks=merge_hooks(request.hooks, self.hooks),|| > || File > "/usr/lib/python2.7/dist-packages/requests/models.py", line > 287, in prepare|| > || self.prepare_url(url, params)|| > || File > "/usr/lib/python2.7/dist-packages/requests/models.py", line > 334, in prepare_url|| > || scheme, auth, host, port, path, query, fragment = > parse_url(url)|| > || File > "/usr/lib/python2.7/dist-packages/urllib3/util.py", line 390, > in parse_url|| > || raise LocationParseError("Failed to parse: %s" % url)|| > ||LocationParseError: Failed to parse: Failed to parse: > us-secondary.example.comhttp: > > > |||Is this a bug? or is my setup wrong? i can navigate to > http://us-secondary.example.com/admin/config and it > correctly outputs > zone details. at the output above > > > It seems like an issue with your environment. What version of > radosgw-agent and which distro is this running on? > > Are there any special characters in the access or secret keys that > might need to be escaped on the command line? > > |DEBUG:boto:url = > 'http://us-secondary.example.comhttp://us-secondary.example.com/admin/config'|| > <http://us-secondary.example.com/admin/config%27%7C%7C> > > > |should the url be repeated like that? > > > No, and it's rather strange since it should be the url passed > on the > command line, parsed, and with /admin/config added. > > Could post the result of this run in a python interpreter: > > import urlparse > result = urlparse.urlparse('http://us-secondary.example.com:80') > print result.hostname, result.port > > Josh > > > _______________________________________________ > ceph-users mailing list > ceph-users at lists.ceph.com <mailto:ceph-users at lists.ceph.com> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140721/57670b1f/attachment.htm>
 |