On Thu, Mar 13, 2014 at 9:48 AM, <ghislain.chevalier@xxxxxxxxxx> wrote: > Hi Yehuda, > > and thx for answering quickly... > > I suppose you want me to add --debug_ms 20 in the radosgw command. > Was it right? Nope. Just --debug-rgw=20. > Or is it an entry (not documented) in the ceph.conf: rgw_debug = 20? > > I trapped some exchanges btw the rasdosgw server and all the osd servers but it's very verbose... > > 2014-03-13 17:02:38.625252 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x7f5f4c006230 > 2014-03-13 17:02:38.625257 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13efb00 10.194.182.58:6800/4728 > 2014-03-13 17:02:38.625264 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).discard_queue > 2014-03-13 17:02:38.625273 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).unregister_pipe - not registered > 2014-03-13 17:02:38.625282 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).join > 2014-03-13 17:02:38.625299 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaped pipe 0x13efb00 10.194.182.58:6800/4728 > 2014-03-13 17:02:38.625308 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x13efb00 > 2014-03-13 17:02:38.625313 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13e44d0 10.194.182.43:6789/0 > 2014-03-13 17:02:38.625319 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).discard_queue > 2014-03-13 17:02:38.625328 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).unregister_pipe - not registered > 2014-03-13 17:02:38.625336 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).join > > The reason I'm using fcgid is that fastcgi is not available in Ubuntu 13.10 (maybe I'm wrong!!) > I don't think that's correct. > What I didn't understand is > why I got as many radosgw processes as launched http requests? socket issue? Probably because apache wasn't able to communicate with the radosgw process so it just spawned another process. > why I got a script header error in the error.log meaning that the script is launched? Because it could not communicate with the radosgw backend. > > I set the log level to debug in apache and I got > > [Thu Mar 13 17:15:56.071467 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of Require all granted: granted > [Thu Mar 13 17:15:56.071558 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of <RequireAny>: granted > [Thu Mar 13 17:15:56.072527 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: server r-cephrgw01:/usr/local/bin/radosgw(20415) started > [Thu Mar 13 17:15:56.090184 2014] [fcgid:warn] [pid 20351:tid 140472486065920] (104)Connection reset by peer: [client 10.194.182.60:44440] mod_fcgid: error reading data from FastCGI server > [Thu Mar 13 17:15:56.090247 2014] [core:error] [pid 20351:tid 140472486065920] [client 10.194.182.60:44440] End of script output before headers: radosgw.fcgi > [Thu Mar 13 17:16:02.078648 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: process /usr/local/bin/radosgw(20415) exit(communication error), terminated by calling exit(), return code: 0 > > Best Regards > > > -----Message d'origine----- > De : Yehuda Sadeh [mailto:yehuda@xxxxxxxxxxx] > Envoyé : jeudi 13 mars 2014 16:19 > À : CHEVALIER Ghislain IMT/OLPS > Cc : ceph-devel@xxxxxxxxxxxxxxx > Objet : Re: [Ceph-devel] Issue with radosgw in Ubuntu 13.10/emperor/fcgid > > On Thu, Mar 13, 2014 at 3:58 AM, <ghislain.chevalier@xxxxxxxxxx> wrote: >> >> Hi All, >> >> I currently try to install a radosgw/emperor on a dedicated server under Ubuntu 13.10 >> This server is an exception in the cluster which is in Emperor under Ubuntu 12.04 LTS >> >> The apache2 and radosgw installation seem to be correct; I created a S3 user with a swift subuser but I get an error 500 trying to use it. >> I use fcgid module instead of fastcgi and so the configuration is quite different. >> FYI : I installed a radosgw/dumpling/fastcgi on another platform and it works well !! >> >> In radosgw log, I got no errors. >> In apache2 error log, I got >> [Thu Mar 13 11:38:15.584859 2014] [fcgid:warn] [pid 15279:tid 140016017676032] (104)Connection reset by peer: [client 10.194.182.60:43871] mod_fcgid: error reading data from FastCGI server >> [Thu Mar 13 11:38:15.584953 2014] [core:error] [pid 15279:tid 140016017676032] [client 10.194.182.60:43871] End of script output before headers: radosgw.fcgi >> >> I noticed that a radosgw script is launched at every http request... > > Yeah, that could be one of the issues with fcgid, not sure if there's > a way to tell it to just be static (as we do with mod_fastcgi), any > reason why you're using fcgid? > > A 500 response usually means that apache was not able to communicate > with the radosgw backend. Not sure what the issue with your config, it > has been a while since I configured fcgid. Try bumping up the radosgw > logs (debug rgw = 20) to see if the requests do get there or not. > > > Yehuda > >> I hope someone will find what is wrong in my configuration!!! >> >> Here are my configuration files. >> >> rgw.conf: >> <VirtualHost *:88> >> ServerName r-cephrgw01 >> DocumentRoot /var/www >> <IfModule mod_rewrite.c> >> RewriteEngine On >> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) /radosgw.fcgi?page=$1¶ms=$2&%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L] >> </IfModule> >> <IfModule mod_fcgid.c> >> <Directory /var/www> >> Options +ExecCGI >> AllowOverride All >> SetHandler fcgid-script >> FcgidWrapper "/usr/local/bin/radosgw -n client.radosgw.r-cephrgw01" .fcgi virtual >> Order allow,deny >> Allow from all >> AuthBasicAuthoritative Off >> </Directory> >> </IfModule> >> AllowEncodedSlashes On >> ServerSignature Off >> </VirtualHost> >> >> >> ceph.conf: >> [client.radosgw.r-cephrgw01] >> host = r-cephrgw01 >> rgw_socket_path = /var/run/ceph/radosgw.sock >> keyring = /etc/ceph/keyring.radosgw.r-cephrgw01 >> rgw_dns_name = r-cephrgw01 >> log_file = /var/log/ceph/radosgw.log >> rgw_port = 88 >> rgw_print_continue = false >> user = www-data >> >> radosgw.fcgi: >> #!/bin/sh >> exec /usr/local/bin/radosgw -c /etc/ceph/ceph.conf -n client.radosgw.r-cephrgw01 >> >> >> User johndoe in radosgw: >> radosgw-admin user info --uid=johndoe >> { "user_id": "johndoe", >> "display_name": "John Doe", >> "email": "john@xxxxxxxxxxx", >> "suspended": 0, >> "max_buckets": 1000, >> "auid": 0, >> "subusers": [ >> { "id": "johndoe:swift", >> "permissions": "full-control"}], >> "keys": [ >> { "user": "johndoe", >> "access_key": "s3johndoe", >> "secret_key": "s3secret"}], >> "swift_keys": [ >> { "user": "johndoe:swift", >> "secret_key": "swsecret"}], >> "caps": [], >> "op_mask": "read, write, delete", >> "default_placement": "", >> "placement_tags": [], >> "bucket_quota": { "enabled": false, >> "max_size_kb": -1, >> "max_objects": -1}} >> >> >> ceph auth list for radosgw client >> client.radosgw.r-cephrgw01 >> key: AQAvdwdTwMSvGxAAsctezTxARKVVq9sWsUmAPg== >> caps: [mon] allow rw >> caps: [osd] allow rwx >> >> - - - - - - - - - - - - - - - - - >> Ghislain Chevalier >> ORANGE/OLNC/OLPS/ASE/DAPI/CSE >> Storage Service Architect >> +33299124432 >> ghislain.chevalier@xxxxxxxxxx >> >> _________________________________________________________________________________________________________________________ >> >> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc >> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler >> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, >> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. >> >> This message and its attachments may contain confidential or privileged information that may be protected by law; >> they should not be distributed, used or copied without authorisation. >> If you have received this email in error, please notify the sender and delete this message and its attachments. >> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. >> Thank you. >> > > _________________________________________________________________________________________________________________________ > > Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc > pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler > a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, > Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. > > This message and its attachments may contain confidential or privileged information that may be protected by law; > they should not be distributed, used or copied without authorisation. > If you have received this email in error, please notify the sender and delete this message and its attachments. > As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. > Thank you. > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html