Problem with radosgw and some file name characters

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Anyone have any idea how to fix the problem with getting 403 when trying to upload files with none standard characters? I am sure I am not the only one with these requirements. 

Cheers 
----- Original Message -----

From: "Andrei Mikhailovsky" <andrei@xxxxxxxxxx> 
To: "Yehuda Sadeh" <yehuda at inktank.com> 
Cc: ceph-users at lists.ceph.com 
Sent: Monday, 19 May, 2014 12:38:29 PM 
Subject: Re: Problem with radosgw and some file name characters 


Yehuda, 

Never mind my last post, i've found the issue with the rule that you've suggested. my fastcgi script is called differently, so that's why i was getting the 404. 

I've tried your rewrite rule and I am still having the same issues. The same characters are failing with the rule you've suggested. 


Any idea how to fix the issue? 

Cheers 

Andrei 
----- Original Message -----

From: "Andrei Mikhailovsky" <andrei@xxxxxxxxxx> 
To: "Yehuda Sadeh" <yehuda at inktank.com> 
Cc: ceph-users at lists.ceph.com 
Sent: Monday, 19 May, 2014 9:30:03 AM 
Subject: Re: Problem with radosgw and some file name characters 


Yehuda, 

I've tried the rewrite rule that you've suggested, but it is not working for me. I get 404 when trying to access the service. 

RewriteRule ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L] 

Any idea what is wrong with this rule? 


Cheers 

Andrei 

----- Original Message -----



From: "Yehuda Sadeh" <yehuda@xxxxxxxxxxx> 
To: "Andrei Mikhailovsky" <andrei at arhont.com> 
Cc: ceph-users at lists.ceph.com 
Sent: Friday, 16 May, 2014 5:44:52 PM 
Subject: Re: Problem with radosgw and some file name characters 

Was talking about this. There is a different and simpler rule that we 
use nowadays, for some reason it's not well documented: 

RewriteRule ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING} 
[E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L] 

I still need to see a more verbose log to make a better educated guess. 

Yehuda 

On Thu, May 15, 2014 at 3:01 PM, Andrei Mikhailovsky <andrei at arhont.com> wrote: 
> 
> Yehuda, 
> 
> what do you mean by the rewrite rule? is this for Apache? I've used the ceph 
> documentation to create it. My rule is: 
> 
> 
> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) 
> /s3gw.fcgi?page=$1&params=$2&%{QUERY_STRING} 
> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L] 
> 
> Or are you talking about something else? 
> 
> Cheers 
> 
> Andrei 
> ________________________________ 
> From: "Yehuda Sadeh" <yehuda at inktank.com> 
> To: "Andrei Mikhailovsky" <andrei at arhont.com> 
> Cc: ceph-users at lists.ceph.com 
> Sent: Thursday, 15 May, 2014 4:05:06 PM 
> Subject: Re: Problem with radosgw and some file name characters 
> 
> 
> Your rewrite rule might be off a bit. Can you provide log with 'debug rgw = 
> 20'? 
> 
> Yehuda 
> 
> On Thu, May 15, 2014 at 8:02 AM, Andrei Mikhailovsky <andrei at arhont.com> 
> wrote: 
>> Hello guys, 
>> 
>> 
>> I am trying to figure out what is the problem here. 
>> 
>> 
>> Currently running Ubuntu 12.04 with latest updates and radosgw version 
>> 0.72.2-1precise. My ceph.conf file is pretty standard from the radosgw 
>> howto. 
>> 
>> 
>> 
>> I am testing radosgw as a backup solution to S3 compatible clients. I am 
>> planning to copy a large number of files/folders and I am having issues 
>> with 
>> a large number of files. The client reports the following error on some 
>> files: 
>> 
>> 
>> <?xml version='1.0' encoding='UTF-8'?> 
>> 
>> <Error> 
>> 
>> <Code>AccessDenied</Code> 
>> 
>> </Error> 
>> 
>> 
>> Looking on the server backup I only see the following errors in the 
>> radosgw.log file: 
>> 
>> 2014-05-13 23:50:35.786181 7f09467dc700 1 ====== starting new request 
>> req=0x245d7e0 ===== 
>> 2014-05-13 23:50:35.786470 7f09467dc700 1 ====== req done req=0x245d7e0 
>> http_status=403 ====== 
>> 
>> 
>> So, i've done a small file set comprising of test files including the 
>> following names: 
>> 
>> Testing and Testing.txt 
>> Testing ^ Testing.txt 
>> Testing = Testing.txt 
>> Testing _ Testing.txt 
>> Testing - Testing.txt 
>> Testing ; Testing.txt 
>> Testing ! Testing.txt 
>> Testing ? Testing.txt 
>> Testing ( Testing.txt 
>> Testing ) Testing.txt 
>> Testing @ Testing.txt 
>> Testing $ Testing.txt 
>> Testing * Testing.txt 
>> Testing & Testing.txt 
>> Testing # Testing.txt 
>> Testing % Testing.txt 
>> Testing + Testing.txt 
>> 
>> From the above list the files with the following characters are giving me 
>> Access Denied / 403 error: 
>> 
>> =;()@$*&+ 
>> 
>> The rest of the files are successfully uploaded. 
>> 
>> Does anyone know what is required to fix the problem? 
>> 
>> Many thanks 
>> 
>> Andrei 
>> 
>> 
>> _______________________________________________ 
>> ceph-users mailing list 
>> ceph-users at lists.ceph.com 
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com 
>> 
> 


_______________________________________________ 
ceph-users mailing list 
ceph-users at lists.ceph.com 
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com 


_______________________________________________ 
ceph-users mailing list 
ceph-users at lists.ceph.com 
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140520/35d77cf5/attachment.htm>


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux