Re: [Ceph-devel] Issue with radosgw in Ubuntu 13.10/emperor/fcgid

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Thu, Mar 13, 2014 at 9:48 AM,  <ghislain.chevalier@xxxxxxxxxx> wrote:
> Hi Yehuda,
>
> and thx for answering quickly...
>
> I suppose you want me to add --debug_ms 20 in the radosgw command.
> Was it right?

Nope. Just --debug-rgw=20.

> Or is it an entry (not documented) in the ceph.conf: rgw_debug = 20?
>
> I trapped some exchanges btw the rasdosgw server and all the osd servers but it's very verbose...
>
> 2014-03-13 17:02:38.625252 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x7f5f4c006230
> 2014-03-13 17:02:38.625257 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13efb00 10.194.182.58:6800/4728
> 2014-03-13 17:02:38.625264 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).discard_queue
> 2014-03-13 17:02:38.625273 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).unregister_pipe - not registered
> 2014-03-13 17:02:38.625282 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).join
> 2014-03-13 17:02:38.625299 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaped pipe 0x13efb00 10.194.182.58:6800/4728
> 2014-03-13 17:02:38.625308 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x13efb00
> 2014-03-13 17:02:38.625313 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13e44d0 10.194.182.43:6789/0
> 2014-03-13 17:02:38.625319 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).discard_queue
> 2014-03-13 17:02:38.625328 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).unregister_pipe - not registered
> 2014-03-13 17:02:38.625336 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).join
>
> The reason I'm using fcgid is that fastcgi is not available in Ubuntu 13.10 (maybe I'm wrong!!)
>

I don't think that's correct.

> What I didn't understand is
> why I got as many radosgw processes as launched http requests? socket issue?

Probably because apache wasn't able to communicate with the radosgw
process so it just spawned another process.

> why I got a script header error in the error.log meaning that the script is launched?

Because it could not communicate with the radosgw backend.

>
> I set the log level to debug in apache and I got
>
> [Thu Mar 13 17:15:56.071467 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of Require all granted: granted
> [Thu Mar 13 17:15:56.071558 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of <RequireAny>: granted
> [Thu Mar 13 17:15:56.072527 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: server r-cephrgw01:/usr/local/bin/radosgw(20415) started
> [Thu Mar 13 17:15:56.090184 2014] [fcgid:warn] [pid 20351:tid 140472486065920] (104)Connection reset by peer: [client 10.194.182.60:44440] mod_fcgid: error reading data from FastCGI server
> [Thu Mar 13 17:15:56.090247 2014] [core:error] [pid 20351:tid 140472486065920] [client 10.194.182.60:44440] End of script output before headers: radosgw.fcgi
> [Thu Mar 13 17:16:02.078648 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: process /usr/local/bin/radosgw(20415) exit(communication error), terminated by calling exit(), return code: 0
>
> Best Regards
>
>
> -----Message d'origine-----
> De : Yehuda Sadeh [mailto:yehuda@xxxxxxxxxxx]
> Envoyé : jeudi 13 mars 2014 16:19
> À : CHEVALIER Ghislain IMT/OLPS
> Cc : ceph-devel@xxxxxxxxxxxxxxx
> Objet : Re: [Ceph-devel] Issue with radosgw in Ubuntu 13.10/emperor/fcgid
>
> On Thu, Mar 13, 2014 at 3:58 AM,  <ghislain.chevalier@xxxxxxxxxx> wrote:
>>
>> Hi All,
>>
>> I currently try to install a radosgw/emperor on a dedicated server under Ubuntu 13.10
>> This server is an exception in the cluster which is in Emperor under Ubuntu 12.04 LTS
>>
>> The apache2 and radosgw installation seem to be correct; I created a S3 user with a swift subuser but I get an error 500 trying to use it.
>> I use fcgid module instead of fastcgi and so the configuration is quite different.
>> FYI : I installed a radosgw/dumpling/fastcgi on another platform and it works well !!
>>
>> In radosgw log, I got no errors.
>> In apache2 error log, I got
>> [Thu Mar 13 11:38:15.584859 2014] [fcgid:warn] [pid 15279:tid 140016017676032] (104)Connection reset by peer: [client 10.194.182.60:43871] mod_fcgid: error reading data from FastCGI server
>> [Thu Mar 13 11:38:15.584953 2014] [core:error] [pid 15279:tid 140016017676032] [client 10.194.182.60:43871] End of script output before headers: radosgw.fcgi
>>
>> I noticed that a radosgw script is launched at every http request...
>
> Yeah, that  could be one of the issues with fcgid, not sure if there's
> a way to tell it to just be static (as we do with mod_fastcgi), any
> reason why you're using fcgid?
>
> A 500 response usually means that apache was not able to communicate
> with the radosgw backend. Not sure what the issue with your config, it
> has been a while since I configured fcgid. Try bumping up the radosgw
> logs (debug rgw = 20) to see if the requests do get there or not.
>
>
> Yehuda
>
>> I hope someone will find what is wrong in my configuration!!!
>>
>> Here are my configuration files.
>>
>> rgw.conf:
>> <VirtualHost *:88>
>> ServerName  r-cephrgw01
>> DocumentRoot /var/www
>> <IfModule mod_rewrite.c>
>> RewriteEngine On
>> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) /radosgw.fcgi?page=$1&params=$2&%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>> </IfModule>
>> <IfModule mod_fcgid.c>
>> <Directory /var/www>
>> Options +ExecCGI
>> AllowOverride All
>> SetHandler fcgid-script
>> FcgidWrapper "/usr/local/bin/radosgw -n client.radosgw.r-cephrgw01" .fcgi virtual
>> Order allow,deny
>> Allow from all
>> AuthBasicAuthoritative Off
>> </Directory>
>> </IfModule>
>> AllowEncodedSlashes On
>> ServerSignature Off
>> </VirtualHost>
>>
>>
>> ceph.conf:
>> [client.radosgw.r-cephrgw01]
>> host = r-cephrgw01
>> rgw_socket_path = /var/run/ceph/radosgw.sock
>> keyring = /etc/ceph/keyring.radosgw.r-cephrgw01
>> rgw_dns_name = r-cephrgw01
>> log_file = /var/log/ceph/radosgw.log
>> rgw_port = 88
>> rgw_print_continue = false
>> user = www-data
>>
>> radosgw.fcgi:
>> #!/bin/sh
>> exec /usr/local/bin/radosgw -c /etc/ceph/ceph.conf -n client.radosgw.r-cephrgw01
>>
>>
>> User johndoe in radosgw:
>> radosgw-admin user info --uid=johndoe
>> { "user_id": "johndoe",
>>   "display_name": "John Doe",
>>   "email": "john@xxxxxxxxxxx",
>>   "suspended": 0,
>>   "max_buckets": 1000,
>>   "auid": 0,
>>   "subusers": [
>>         { "id": "johndoe:swift",
>>           "permissions": "full-control"}],
>>   "keys": [
>>         { "user": "johndoe",
>>           "access_key": "s3johndoe",
>>           "secret_key": "s3secret"}],
>>   "swift_keys": [
>>         { "user": "johndoe:swift",
>>           "secret_key": "swsecret"}],
>>   "caps": [],
>>   "op_mask": "read, write, delete",
>>   "default_placement": "",
>>   "placement_tags": [],
>>   "bucket_quota": { "enabled": false,
>>       "max_size_kb": -1,
>>       "max_objects": -1}}
>>
>>
>> ceph auth list for radosgw client
>> client.radosgw.r-cephrgw01
>>         key: AQAvdwdTwMSvGxAAsctezTxARKVVq9sWsUmAPg==
>>         caps: [mon] allow rw
>>         caps: [osd] allow rwx
>>
>> - - - - - - - - - - - - - - - - -
>> Ghislain Chevalier
>> ORANGE/OLNC/OLPS/ASE/DAPI/CSE
>> Storage Service Architect
>>  +33299124432
>> ghislain.chevalier@xxxxxxxxxx
>>
>> _________________________________________________________________________________________________________________________
>>
>> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
>> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
>> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
>> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>>
>> This message and its attachments may contain confidential or privileged information that may be protected by law;
>> they should not be distributed, used or copied without authorisation.
>> If you have received this email in error, please notify the sender and delete this message and its attachments.
>> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
>> Thank you.
>>
>
> _________________________________________________________________________________________________________________________
>
> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or privileged information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
> Thank you.
>
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html




[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux