Problem with radosgw and some file name characters

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, May 20, 2014 at 4:13 AM, Andrei Mikhailovsky <andrei at arhont.com> wrote:
> Anyone have any idea how to fix the problem with getting 403 when trying to
> upload files with none standard characters? I am sure I am not the only one
> with these requirements.

It might be the specific client that you're using and the way it signs
the requests. Can you try a different S3 client, see whether it works
or not? Are you by any chance going through some kind of a load
balancer that rewrites the urls?

Yehuda

> ________________________________
> From: "Andrei Mikhailovsky" <andrei at arhont.com>
> To: "Yehuda Sadeh" <yehuda at inktank.com>
> Cc: ceph-users at lists.ceph.com
> Sent: Monday, 19 May, 2014 12:38:29 PM
>
> Subject: Re: Problem with radosgw and some file name characters
>
> Yehuda,
>
> Never mind my last post, i've found the issue with the rule that you've
> suggested. my fastcgi script is called differently, so that's why i was
> getting the 404.
>
> I've tried your rewrite rule and I am still having the same issues. The same
> characters are failing with the rule you've suggested.
>
>
> Any idea how to fix the issue?
>
> Cheers
>
> Andrei
> ________________________________
> From: "Andrei Mikhailovsky" <andrei at arhont.com>
> To: "Yehuda Sadeh" <yehuda at inktank.com>
> Cc: ceph-users at lists.ceph.com
> Sent: Monday, 19 May, 2014 9:30:03 AM
> Subject: Re: Problem with radosgw and some file name characters
>
> Yehuda,
>
> I've tried the rewrite rule that you've suggested, but it is not working for
> me. I get 404 when trying to access the service.
>
>         RewriteRule  ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING}
> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>
> Any idea what is wrong with this rule?
>
> Cheers
>
> Andrei
>
> ________________________________
>
>
> From: "Yehuda Sadeh" <yehuda at inktank.com>
> To: "Andrei Mikhailovsky" <andrei at arhont.com>
> Cc: ceph-users at lists.ceph.com
> Sent: Friday, 16 May, 2014 5:44:52 PM
> Subject: Re: Problem with radosgw and some file name characters
>
> Was talking about this. There is a different and simpler rule that we
> use nowadays, for some reason it's not well documented:
>
> RewriteRule  ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING}
> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>
> I still need to see a more verbose log to make a better educated guess.
>
> Yehuda
>
> On Thu, May 15, 2014 at 3:01 PM, Andrei Mikhailovsky <andrei at arhont.com>
> wrote:
>>
>> Yehuda,
>>
>> what do you mean by the rewrite rule? is this for Apache? I've used the
>> ceph
>> documentation to create it. My rule is:
>>
>>
>>         RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*)
>> /s3gw.fcgi?page=$1&params=$2&%{QUERY_STRING}
>> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>>
>> Or are you talking about something else?
>>
>> Cheers
>>
>> Andrei
>> ________________________________
>> From: "Yehuda Sadeh" <yehuda at inktank.com>
>> To: "Andrei Mikhailovsky" <andrei at arhont.com>
>> Cc: ceph-users at lists.ceph.com
>> Sent: Thursday, 15 May, 2014 4:05:06 PM
>> Subject: Re: Problem with radosgw and some file name
>> characters
>>
>>
>> Your rewrite rule might be off a bit. Can you provide log with 'debug rgw
>> =
>> 20'?
>>
>> Yehuda
>>
>> On Thu, May 15, 2014 at 8:02 AM, Andrei Mikhailovsky <andrei at arhont.com>
>> wrote:
>>> Hello guys,
>>>
>>>
>>> I am trying to figure out what is the problem here.
>>>
>>>
>>> Currently running Ubuntu 12.04 with latest updates and radosgw version
>>> 0.72.2-1precise. My ceph.conf file is pretty standard from the radosgw
>>> howto.
>>>
>>>
>>>
>>> I am testing radosgw as a backup solution to S3 compatible clients. I am
>>> planning to copy a large number of files/folders and I am having issues
>>> with
>>> a large number of files. The client reports the following error on some
>>> files:
>>>
>>>
>>> <?xml version='1.0' encoding='UTF-8'?>
>>>
>>> <Error>
>>>
>>> <Code>AccessDenied</Code>
>>>
>>> </Error>
>>>
>>>
>>> Looking on the server backup I only see the following errors in the
>>> radosgw.log file:
>>>
>>> 2014-05-13 23:50:35.786181 7f09467dc700  1 ====== starting new request
>>> req=0x245d7e0 =====
>>> 2014-05-13 23:50:35.786470 7f09467dc700  1 ====== req done req=0x245d7e0
>>> http_status=403 ======
>>>
>>>
>>> So, i've done  a small file set comprising of test files including the
>>> following names:
>>>
>>> Testing and Testing.txt
>>> Testing ^ Testing.txt
>>> Testing = Testing.txt
>>> Testing _ Testing.txt
>>> Testing - Testing.txt
>>> Testing ; Testing.txt
>>> Testing ! Testing.txt
>>> Testing ? Testing.txt
>>> Testing ( Testing.txt
>>> Testing ) Testing.txt
>>> Testing @ Testing.txt
>>> Testing $ Testing.txt
>>> Testing * Testing.txt
>>> Testing & Testing.txt
>>> Testing # Testing.txt
>>> Testing % Testing.txt
>>> Testing + Testing.txt
>>>
>>> From the above list the files with the following characters are giving me
>>> Access Denied / 403 error:
>>>
>>> =;()@$*&+
>>>
>>> The rest of the files are successfully uploaded.
>>>
>>> Does anyone know what is required to fix the problem?
>>>
>>> Many thanks
>>>
>>> Andrei
>>>
>>>
>>> _______________________________________________
>>> ceph-users mailing list
>>> ceph-users at lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux