radosgw-agent failed to parse

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Just to ask a couple obvious questions...

You didn't accidentally put 'http://us-secondary.example.comhttp://
us-secondary.example.com/' in any of your region or zone configuration
files?  The fact that it's missing the :80 makes me think it's getting that
URL from someplace that isn't the command line.

You do have both system users on both clusters, with the same access and
secret keys?

You can resolve us-secondary.example.com. from this host?


I tested URLs of the form http://us-secondary.example.com/ and
http://us-secondary.example.com:80 in my setup, and both work fine.



On Wed, Jul 9, 2014 at 3:56 AM, Peter <ptiernan at tchpc.tcd.ie> wrote:

> thank you for your reply. I am running ceph 0.80.1, radosgw-agent 1.2 on
> Ubuntu 14.04 LTS (GNU/Linux 3.13.0-24-generic x86_64) . I also ran into
> this same issue with ubuntu 12.04 previously.
> There are no special characters in the access or secret key (ive had
> issues with this before so i make sure of this).
>
> here is the output python interpreter:
>
>  Python 2.7.6 (default, Mar 22 2014, 22:59:56)
>> [GCC 4.8.2] on linux2
>> Type "help", "copyright", "credits" or "license" for more information.
>>
>> >>> import urlparse
>> >>> result = urlparse.urlparse('http://us-secondary.example.com:80')
>> >>> print result.hostname, result.port
>> us-secondary.example.com 80
>>
>
> that looks ok to me.
>
>
>
> On 07/07/14 22:57, Josh Durgin wrote:
>
>> On 07/04/2014 08:36 AM, Peter wrote:
>>
>>> i am having issues running radosgw-agent to sync data between two
>>> radosgw zones. As far as i can tell both zones are running correctly.
>>>
>>> My issue is when i run the radosgw-agent command:
>>>
>>>
>>>  radosgw-agent -v --src-access-key <access_key> --src-secret-key
>>>> <secret_key> --dest-access-key <access_key> --dest-secret-key
>>>> <secret_key> --src-zone us-master http://us-secondary.example.com:80
>>>>
>>>
>>> i get the following error:
>>>
>>> |DEBUG:boto:Using access key provided by client.||
>>> ||DEBUG:boto:Using secret key provided by client.||
>>> ||DEBUG:boto:StringToSign:||
>>> ||GET||
>>> ||
>>> ||Fri, 04 Jul 2014 15:25:53 GMT||
>>> ||/admin/config||
>>> ||DEBUG:boto:Signature:||
>>> ||AWS EA20YO07DA8JJJX7ZIPJ:WbykwyXu5m5IlbEsBzo8bKEGIzg=||
>>> ||DEBUG:boto:url =
>>> 'http://us-secondary.example.comhttp://us-secondary.
>>> example.com/admin/config'||
>>> <http://us-secondary.example.com/admin/config'%7C%7C>
>>> ||params={}||
>>> ||headers={'Date': 'Fri, 04 Jul 2014 15:25:53 GMT', 'Content-Length':
>>> '0', 'Authorization': 'AWS
>>> EA20YO07DA8JJJX7ZIPJ:WbykwyXu5m5IlbEsBzo8bKEGIzg=', 'User-Agent':
>>> 'Boto/2.20.1 Python/2.7.6 Linux/3.13.0-24-generic'}||
>>> ||data=None||
>>> ||ERROR:root:Could not retrieve region map from destination||
>>> ||Traceback (most recent call last):||
>>> ||  File "/usr/lib/python2.7/dist-packages/radosgw_agent/cli.py", line
>>> 269, in main||
>>> ||    region_map = client.get_region_map(dest_conn)||
>>> ||  File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py",
>>> line 391, in get_region_map||
>>> ||    region_map = request(connection, 'get', 'admin/config')||
>>> ||  File "/usr/lib/python2.7/dist-packages/radosgw_agent/client.py",
>>> line 153, in request||
>>> ||    result = handler(url, params=params, headers=request.headers,
>>> data=data)||
>>> ||  File "/usr/lib/python2.7/dist-packages/requests/api.py", line 55, in
>>> get||
>>> ||    return request('get', url, **kwargs)||
>>> ||  File "/usr/lib/python2.7/dist-packages/requests/api.py", line 44, in
>>> request||
>>> ||    return session.request(method=method, url=url, **kwargs)||
>>> ||  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line
>>> 349, in request||
>>> ||    prep = self.prepare_request(req)||
>>> ||  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line
>>> 287, in prepare_request||
>>> ||    hooks=merge_hooks(request.hooks, self.hooks),||
>>> ||  File "/usr/lib/python2.7/dist-packages/requests/models.py", line
>>> 287, in prepare||
>>> ||    self.prepare_url(url, params)||
>>> ||  File "/usr/lib/python2.7/dist-packages/requests/models.py", line
>>> 334, in prepare_url||
>>> ||    scheme, auth, host, port, path, query, fragment = parse_url(url)||
>>> ||  File "/usr/lib/python2.7/dist-packages/urllib3/util.py", line 390,
>>> in parse_url||
>>> ||    raise LocationParseError("Failed to parse: %s" % url)||
>>> ||LocationParseError: Failed to parse: Failed to parse:
>>> us-secondary.example.comhttp:
>>>
>>>
>>> |||Is this a bug? or is my setup wrong? i can navigate to
>>> http://us-secondary.example.com/admin/config and it correctly outputs
>>> zone details. at the output above
>>>
>>
>> It seems like an issue with your environment. What version of
>> radosgw-agent and which distro is this running on?
>>
>> Are there any special characters in the access or secret keys that
>> might need to be escaped on the command line?
>>
>>  |DEBUG:boto:url =
>>> 'http://us-secondary.example.comhttp://us-secondary.
>>> example.com/admin/config'||
>>> <http://us-secondary.example.com/admin/config'%7C%7C>
>>>
>>>
>>> |should the url be repeated like that?
>>>
>>
>> No, and it's rather strange since it should be the url passed on the
>> command line, parsed, and with /admin/config added.
>>
>> Could post the result of this run in a python interpreter:
>>
>> import urlparse
>> result = urlparse.urlparse('http://us-secondary.example.com:80')
>> print result.hostname, result.port
>>
>> Josh
>>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140709/5b07dff1/attachment.htm>


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux