Yehuda, Here is what I get with debug logging. I've sanitised output a bit: 2014-05-16 21:37:23.565906 7fb9e67fc700 1 ====== starting new request req=0x2243820 ===== 2014-05-16 21:37:23.565964 7fb9e67fc700 2 req 14:0.000058::HEAD /Testing%20=%20Testing.txt::initializing 2014-05-16 21:37:23.565976 7fb9e67fc700 10 host=file-test.<url> rgw_dns_name=<url> 2014-05-16 21:37:23.566011 7fb9e67fc700 10 s->object=Testing = Testing.txt s->bucket=file-test 2014-05-16 21:37:23.566018 7fb9e67fc700 20 FCGI_ROLE=RESPONDER 2014-05-16 21:37:23.566020 7fb9e67fc700 20 SCRIPT_URL=/Testing = Testing.txt 2014-05-16 21:37:23.566020 7fb9e67fc700 20 SCRIPT_URI=https://file-test.<url>/Testing = Testing.txt 2014-05-16 21:37:23.566021 7fb9e67fc700 20 HTTP_AUTHORIZATION=AWS 1VBD65666666:x6JvIaP666 2014-05-16 21:37:23.566022 7fb9e67fc700 20 HTTPS=on 2014-05-16 21:37:23.566047 7fb9e67fc700 20 SSL_TLS_SNI=file-test.<url> 2014-05-16 21:37:23.566048 7fb9e67fc700 20 HTTP_HOST=file-test.<url> 2014-05-16 21:37:23.566049 7fb9e67fc700 20 HTTP_DATE=Fri, 16 May 2014 20:37:23 GMT 2014-05-16 21:37:23.566050 7fb9e67fc700 20 HTTP_USER_AGENT=DragonDisk 1.05 ( http://www.dragondisk.com ) 2014-05-16 21:37:23.566051 7fb9e67fc700 20 HTTP_X_FORWARDED_FOR=10.1.1.228 2014-05-16 21:37:23.566052 7fb9e67fc700 20 HTTP_X_FORWARDED_HOST=file-test.<url> 2014-05-16 21:37:23.566053 7fb9e67fc700 20 HTTP_X_FORWARDED_SERVER=<url> 2014-05-16 21:37:23.566054 7fb9e67fc700 20 HTTP_CONNECTION=Keep-Alive 2014-05-16 21:37:23.566055 7fb9e67fc700 20 PATH=/usr/local/bin:/usr/bin:/bin 2014-05-16 21:37:23.566055 7fb9e67fc700 20 SERVER_SIGNATURE= 2014-05-16 21:37:23.566056 7fb9e67fc700 20 SERVER_SOFTWARE=Apache/2.2.22 (Ubuntu) 2014-05-16 21:37:23.566056 7fb9e67fc700 20 SERVER_NAME=file-test.<url> 2014-05-16 21:37:23.566057 7fb9e67fc700 20 SERVER_ADDR=192.168.169.200 2014-05-16 21:37:23.566057 7fb9e67fc700 20 SERVER_PORT=443 2014-05-16 21:37:23.566058 7fb9e67fc700 20 REMOTE_ADDR=192.168.169.121 2014-05-16 21:37:23.566059 7fb9e67fc700 20 DOCUMENT_ROOT=/var/www 2014-05-16 21:37:23.566059 7fb9e67fc700 20 SERVER_ADMIN= 2014-05-16 21:37:23.566060 7fb9e67fc700 20 SCRIPT_FILENAME=/var/www/s3gw.fcgi 2014-05-16 21:37:23.566060 7fb9e67fc700 20 REMOTE_PORT=52750 2014-05-16 21:37:23.566061 7fb9e67fc700 20 GATEWAY_INTERFACE=CGI/1.1 2014-05-16 21:37:23.566062 7fb9e67fc700 20 SERVER_PROTOCOL=HTTP/1.1 2014-05-16 21:37:23.566062 7fb9e67fc700 20 REQUEST_METHOD=HEAD 2014-05-16 21:37:23.566063 7fb9e67fc700 20 QUERY_STRING=page=Testing¶ms= = Testing.txt 2014-05-16 21:37:23.566063 7fb9e67fc700 20 REQUEST_URI=/Testing%20=%20Testing.txt 2014-05-16 21:37:23.566064 7fb9e67fc700 20 SCRIPT_NAME=/Testing = Testing.txt 2014-05-16 21:37:23.566066 7fb9e67fc700 2 req 14:0.000160:s3:HEAD /Testing%20=%20Testing.txt::getting op 2014-05-16 21:37:23.566071 7fb9e67fc700 2 req 14:0.000166:s3:HEAD /Testing%20=%20Testing.txt:get_obj:authorizing 2014-05-16 21:37:23.566095 7fb9e67fc700 20 get_obj_state: rctx=0x7fb9a40076a0 obj=.users:1VBD656666 state=0x7fb9a4007768 s->prefetch_data=0 2014-05-16 21:37:23.566106 7fb9e67fc700 10 moving .users+1VBD65666666 to cache LRU end 2014-05-16 21:37:23.566109 7fb9e67fc700 10 cache get: name=.users+1VBD6566666 : hit 2014-05-16 21:37:23.566117 7fb9e67fc700 20 get_obj_state: s->obj_tag was set empty 2014-05-16 21:37:23.566123 7fb9e67fc700 10 moving .users+1VBD6566666 to cache LRU end 2014-05-16 21:37:23.566124 7fb9e67fc700 10 cache get: name=.users+1VBD6566666 : hit 2014-05-16 21:37:23.566151 7fb9e67fc700 20 get_obj_state: rctx=0x7fb9a4007c60 obj=.users.uid:andrei state=0x7fb9a4007568 s->prefetch_data=0 2014-05-16 21:37:23.566157 7fb9e67fc700 10 moving .users.uid+andrei to cache LRU end 2014-05-16 21:37:23.566159 7fb9e67fc700 10 cache get: name=.users.uid+andrei : hit 2014-05-16 21:37:23.566163 7fb9e67fc700 20 get_obj_state: s->obj_tag was set empty 2014-05-16 21:37:23.566166 7fb9e67fc700 10 moving .users.uid+andrei to cache LRU end 2014-05-16 21:37:23.566167 7fb9e67fc700 10 cache get: name=.users.uid+andrei : hit 2014-05-16 21:37:23.566214 7fb9e67fc700 10 get_canon_resource(): dest=/file-test/Testing%20=%20Testing.txt 2014-05-16 21:37:23.566217 7fb9e67fc700 10 auth_hdr: HEAD Fri, 16 May 2014 20:37:23 GMT /file-test/Testing%20=%20Testing.txt 2014-05-16 21:37:23.566292 7fb9e67fc700 15 calculated digest=EGQFDk7vQUX5IIb11AgaonaMzng= 2014-05-16 21:37:23.566295 7fb9e67fc700 15 auth_sign=x6JvIaPCGQv6666666666 2014-05-16 21:37:23.566296 7fb9e67fc700 15 compare=51 2014-05-16 21:37:23.566298 7fb9e67fc700 10 failed to authorize request 2014-05-16 21:37:23.566409 7fb9e67fc700 2 req 14:0.000504:s3:HEAD /Testing%20=%20Testing.txt:get_obj:http status=403 2014-05-16 21:37:23.566544 7fb9e67fc700 1 ====== req done req=0x2243820 http_status=403 ====== 2014-05-16 21:37:23.600916 7fba57ba3780 20 enqueued request req=0x2241b80 2014-05-16 21:37:23.600930 7fba57ba3780 20 RGWWQ: 2014-05-16 21:37:23.600932 7fba57ba3780 20 req: 0x2241b80 2014-05-16 21:37:23.600936 7fba57ba3780 10 allocated request req=0x2243d10 2014-05-16 21:37:23.600976 7fb9c77d6700 20 dequeued request req=0x2241b80 2014-05-16 21:37:23.600987 7fb9c77d6700 20 RGWWQ: empty Files without the characters that i've listed previously get copied without any problems and I get http status=200 Cheers Andrei ----- Original Message ----- From: "Yehuda Sadeh" <yehuda@xxxxxxxxxxx> To: "Andrei Mikhailovsky" <andrei at arhont.com> Cc: ceph-users at lists.ceph.com Sent: Friday, 16 May, 2014 5:44:52 PM Subject: Re: Problem with radosgw and some file name characters Was talking about this. There is a different and simpler rule that we use nowadays, for some reason it's not well documented: RewriteRule ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L] I still need to see a more verbose log to make a better educated guess. Yehuda On Thu, May 15, 2014 at 3:01 PM, Andrei Mikhailovsky <andrei at arhont.com> wrote: > > Yehuda, > > what do you mean by the rewrite rule? is this for Apache? I've used the ceph > documentation to create it. My rule is: > > > RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) > /s3gw.fcgi?page=$1¶ms=$2&%{QUERY_STRING} > [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L] > > Or are you talking about something else? > > Cheers > > Andrei > ________________________________ > From: "Yehuda Sadeh" <yehuda at inktank.com> > To: "Andrei Mikhailovsky" <andrei at arhont.com> > Cc: ceph-users at lists.ceph.com > Sent: Thursday, 15 May, 2014 4:05:06 PM > Subject: Re: Problem with radosgw and some file name characters > > > Your rewrite rule might be off a bit. Can you provide log with 'debug rgw = > 20'? > > Yehuda > > On Thu, May 15, 2014 at 8:02 AM, Andrei Mikhailovsky <andrei at arhont.com> > wrote: >> Hello guys, >> >> >> I am trying to figure out what is the problem here. >> >> >> Currently running Ubuntu 12.04 with latest updates and radosgw version >> 0.72.2-1precise. My ceph.conf file is pretty standard from the radosgw >> howto. >> >> >> >> I am testing radosgw as a backup solution to S3 compatible clients. I am >> planning to copy a large number of files/folders and I am having issues >> with >> a large number of files. The client reports the following error on some >> files: >> >> >> <?xml version='1.0' encoding='UTF-8'?> >> >> <Error> >> >> <Code>AccessDenied</Code> >> >> </Error> >> >> >> Looking on the server backup I only see the following errors in the >> radosgw.log file: >> >> 2014-05-13 23:50:35.786181 7f09467dc700 1 ====== starting new request >> req=0x245d7e0 ===== >> 2014-05-13 23:50:35.786470 7f09467dc700 1 ====== req done req=0x245d7e0 >> http_status=403 ====== >> >> >> So, i've done a small file set comprising of test files including the >> following names: >> >> Testing and Testing.txt >> Testing ^ Testing.txt >> Testing = Testing.txt >> Testing _ Testing.txt >> Testing - Testing.txt >> Testing ; Testing.txt >> Testing ! Testing.txt >> Testing ? Testing.txt >> Testing ( Testing.txt >> Testing ) Testing.txt >> Testing @ Testing.txt >> Testing $ Testing.txt >> Testing * Testing.txt >> Testing & Testing.txt >> Testing # Testing.txt >> Testing % Testing.txt >> Testing + Testing.txt >> >> From the above list the files with the following characters are giving me >> Access Denied / 403 error: >> >> =;()@$*&+ >> >> The rest of the files are successfully uploaded. >> >> Does anyone know what is required to fix the problem? >> >> Many thanks >> >> Andrei >> >> >> _______________________________________________ >> ceph-users mailing list >> ceph-users at lists.ceph.com >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140516/d7340e2b/attachment.htm>
 |