RE: [Ceph-devel] Issue with radosgw in Ubuntu 13.10/emperor/fcgid

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Yehuda,

and thx for answering quickly...

I suppose you want me to add --debug_ms 20 in the radosgw command.
Was it right?
Or is it an entry (not documented) in the ceph.conf: rgw_debug = 20?

I trapped some exchanges btw the rasdosgw server and all the osd servers but it's very verbose...

2014-03-13 17:02:38.625252 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x7f5f4c006230
2014-03-13 17:02:38.625257 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13efb00 10.194.182.58:6800/4728
2014-03-13 17:02:38.625264 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).discard_queue
2014-03-13 17:02:38.625273 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).unregister_pipe - not registered
2014-03-13 17:02:38.625282 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).join
2014-03-13 17:02:38.625299 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaped pipe 0x13efb00 10.194.182.58:6800/4728
2014-03-13 17:02:38.625308 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x13efb00
2014-03-13 17:02:38.625313 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13e44d0 10.194.182.43:6789/0
2014-03-13 17:02:38.625319 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).discard_queue
2014-03-13 17:02:38.625328 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).unregister_pipe - not registered
2014-03-13 17:02:38.625336 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).join

The reason I'm using fcgid is that fastcgi is not available in Ubuntu 13.10 (maybe I'm wrong!!)

What I didn't understand is 
why I got as many radosgw processes as launched http requests? socket issue?
why I got a script header error in the error.log meaning that the script is launched?

I set the log level to debug in apache and I got

[Thu Mar 13 17:15:56.071467 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of Require all granted: granted
[Thu Mar 13 17:15:56.071558 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of <RequireAny>: granted
[Thu Mar 13 17:15:56.072527 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: server r-cephrgw01:/usr/local/bin/radosgw(20415) started
[Thu Mar 13 17:15:56.090184 2014] [fcgid:warn] [pid 20351:tid 140472486065920] (104)Connection reset by peer: [client 10.194.182.60:44440] mod_fcgid: error reading data from FastCGI server
[Thu Mar 13 17:15:56.090247 2014] [core:error] [pid 20351:tid 140472486065920] [client 10.194.182.60:44440] End of script output before headers: radosgw.fcgi
[Thu Mar 13 17:16:02.078648 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: process /usr/local/bin/radosgw(20415) exit(communication error), terminated by calling exit(), return code: 0

Best Regards


-----Message d'origine-----
De : Yehuda Sadeh [mailto:yehuda@xxxxxxxxxxx] 
Envoyé : jeudi 13 mars 2014 16:19
À : CHEVALIER Ghislain IMT/OLPS
Cc : ceph-devel@xxxxxxxxxxxxxxx
Objet : Re: [Ceph-devel] Issue with radosgw in Ubuntu 13.10/emperor/fcgid

On Thu, Mar 13, 2014 at 3:58 AM,  <ghislain.chevalier@xxxxxxxxxx> wrote:
>
> Hi All,
>
> I currently try to install a radosgw/emperor on a dedicated server under Ubuntu 13.10
> This server is an exception in the cluster which is in Emperor under Ubuntu 12.04 LTS
>
> The apache2 and radosgw installation seem to be correct; I created a S3 user with a swift subuser but I get an error 500 trying to use it.
> I use fcgid module instead of fastcgi and so the configuration is quite different.
> FYI : I installed a radosgw/dumpling/fastcgi on another platform and it works well !!
>
> In radosgw log, I got no errors.
> In apache2 error log, I got
> [Thu Mar 13 11:38:15.584859 2014] [fcgid:warn] [pid 15279:tid 140016017676032] (104)Connection reset by peer: [client 10.194.182.60:43871] mod_fcgid: error reading data from FastCGI server
> [Thu Mar 13 11:38:15.584953 2014] [core:error] [pid 15279:tid 140016017676032] [client 10.194.182.60:43871] End of script output before headers: radosgw.fcgi
>
> I noticed that a radosgw script is launched at every http request...

Yeah, that  could be one of the issues with fcgid, not sure if there's
a way to tell it to just be static (as we do with mod_fastcgi), any
reason why you're using fcgid?

A 500 response usually means that apache was not able to communicate
with the radosgw backend. Not sure what the issue with your config, it
has been a while since I configured fcgid. Try bumping up the radosgw
logs (debug rgw = 20) to see if the requests do get there or not.


Yehuda

> I hope someone will find what is wrong in my configuration!!!
>
> Here are my configuration files.
>
> rgw.conf:
> <VirtualHost *:88>
> ServerName  r-cephrgw01
> DocumentRoot /var/www
> <IfModule mod_rewrite.c>
> RewriteEngine On
> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) /radosgw.fcgi?page=$1&params=$2&%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
> </IfModule>
> <IfModule mod_fcgid.c>
> <Directory /var/www>
> Options +ExecCGI
> AllowOverride All
> SetHandler fcgid-script
> FcgidWrapper "/usr/local/bin/radosgw -n client.radosgw.r-cephrgw01" .fcgi virtual
> Order allow,deny
> Allow from all
> AuthBasicAuthoritative Off
> </Directory>
> </IfModule>
> AllowEncodedSlashes On
> ServerSignature Off
> </VirtualHost>
>
>
> ceph.conf:
> [client.radosgw.r-cephrgw01]
> host = r-cephrgw01
> rgw_socket_path = /var/run/ceph/radosgw.sock
> keyring = /etc/ceph/keyring.radosgw.r-cephrgw01
> rgw_dns_name = r-cephrgw01
> log_file = /var/log/ceph/radosgw.log
> rgw_port = 88
> rgw_print_continue = false
> user = www-data
>
> radosgw.fcgi:
> #!/bin/sh
> exec /usr/local/bin/radosgw -c /etc/ceph/ceph.conf -n client.radosgw.r-cephrgw01
>
>
> User johndoe in radosgw:
> radosgw-admin user info --uid=johndoe
> { "user_id": "johndoe",
>   "display_name": "John Doe",
>   "email": "john@xxxxxxxxxxx",
>   "suspended": 0,
>   "max_buckets": 1000,
>   "auid": 0,
>   "subusers": [
>         { "id": "johndoe:swift",
>           "permissions": "full-control"}],
>   "keys": [
>         { "user": "johndoe",
>           "access_key": "s3johndoe",
>           "secret_key": "s3secret"}],
>   "swift_keys": [
>         { "user": "johndoe:swift",
>           "secret_key": "swsecret"}],
>   "caps": [],
>   "op_mask": "read, write, delete",
>   "default_placement": "",
>   "placement_tags": [],
>   "bucket_quota": { "enabled": false,
>       "max_size_kb": -1,
>       "max_objects": -1}}
>
>
> ceph auth list for radosgw client
> client.radosgw.r-cephrgw01
>         key: AQAvdwdTwMSvGxAAsctezTxARKVVq9sWsUmAPg==
>         caps: [mon] allow rw
>         caps: [osd] allow rwx
>
> - - - - - - - - - - - - - - - - -
> Ghislain Chevalier
> ORANGE/OLNC/OLPS/ASE/DAPI/CSE
> Storage Service Architect
>  +33299124432
> ghislain.chevalier@xxxxxxxxxx
>
> _________________________________________________________________________________________________________________________
>
> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or privileged information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
> Thank you.
>

_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html




[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux