Cannot connect to the RADOS Gateway with Swift client

Joe Hakim Rahme <joe.hakim.rahme@xxxxxxxxxxxx> · Mon, 15 Apr 2013 15:02:11 +0200

Hello everyone,

I am trying to set up a Rados Gateway on top of an existing Ceph install. Here're the details:

# ceph -s
   health HEALTH_OK
   monmap e3: 3 mons at {0=10.68.0.46:6789/0,1=10.68.0.47:6789/0,2=10.68.0.51:6789/0}, election epoch 16, quorum 0,1,2 0,1,2
   osdmap e106: 3 osds: 3 up, 3 in
    pgmap v32049: 496 pgs: 496 active+clean; 61256 MB data, 105 GB used, 727 GB / 833 GB avail; 0B/s rd, 1687B/s wr, 0op/s
   mdsmap e1: 0/0/1 up

In order to set up the gateway, I followed the instructions on the quick start 
(http://ceph.com/docs/master/start/quick-rgw/) as closely as I can. Right now, 
I have Apache up and running, I can see a process called radosgw:

# ps aux | grep rados
root     27513  0.0  0.0 1228964 6804 ?        Ssl  Apr11   1:59 /usr/bin/radosgw -c /etc/ceph/ceph.conf -n client.radosgw.gateway

So I'm assuming that everything works correctly. I even managed to create a 
user (and a subuser for the Swift interface): 

# radosgw-admin user info --uid=test
{ "user_id": "test",
  "display_name": "Mr. Test",
  "email": "",
  "suspended": 0,
  "max_buckets": 1000,
  "subusers": [
        { "id": "test:swift",
          "permissions": "full-control"}],
  "keys": [
        { "user": "test",
          "access_key": "AMTMPBLXLO0HRKF0DZZN",
          "secret_key": "yvnEKuvTwJQnC\/\/VzX1zzr\/EcYAUn+vClw+kf03i"}],
  "swift_keys": [
        { "user": "test:swift",
          "secret_key": "yItNK97aFv+3dRh8IYzSTU5kI4\/C9WteFcX17chd"}],
  "caps": []}

However, if I try to connect to the gateway (using the Swift client 
(https://github.com/openstack/python-swiftclient), it keeps failing:

#swift -A http://127.0.0.1:80 -U test -K "yItNK97aFv+3dRh8IYzSTU5kI4\/C9WteFcX17chd" stat
Auth GET failed: http://127.0.0.1:80 403 Forbidden

The same thing happens with `wget`:
#wget "http://127.0.0.1/?X-Auth-User=test:swift&X-Auth-Key=yItNK97aFv+3dRh8IYzSTU5kI4\/C9WteFcX17chd";
--2013-04-15 12:36:01--  http://127.0.0.1/?X-Auth-User=test:swift&X-Auth-Key=yItNK97aFv+3dRh8IYzSTU5kI4%5C/C9WteFcX17chd
Connecting to 127.0.0.1:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
2013-04-15 12:36:01 ERROR 403: Forbidden.

I tried to replace http with https and I get an SSL error:

# wget "https://127.0.0.1/?X-Auth-User=test:swift&X-Auth-Key=yItNK97aFv+3dRh8IYzSTU5kI4\/C9WteFcX17chd";
--2013-04-15 12:36:08--  https://127.0.0.1/?X-Auth-User=test:swift&X-Auth-Key=yItNK97aFv+3dRh8IYzSTU5kI4%5C/C9WteFcX17chd
Connecting to 127.0.0.1:443... connected.
GnuTLS: An unexpected TLS packet was received.
Unable to establish SSL connection.

# swift -A https://127.0.0.1 -U test:swift -K "yItNK97aFv+3dRh8IYzSTU5kI4\/C9WteFcX17chd" stat
[Errno 1] _ssl.c:504: error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol

I tried to check various logs and the only error I found is in /var/log/apache/errors.log
[Mon Apr 15 12:36:20 2013] [error] [client 127.0.0.1] FastCGI: invalid (dynamic) server "/var/www/": script is a directory!

Here's the content of the file /etc/apache2/sites-enabled/rgw.conf 
(taken from the quick start instructions):
------------------------------------------------------------------------------------------------------------------------------------------------------------
FastCgiExternalServer /var/www/s3gw.fcgi -socket /tmp/radosgw.sock

<VirtualHost *:80>
        ServerName os-ci-test2
        ServerAdmin joe@xxxxxxxxxxxx
        DocumentRoot /var/www
        <IfModule mod_fastcgi.c>
                <Directory /var/www>
                        Options +ExecCGI
                        AllowOverride All
                        SetHandler fastcgi-script
                        Order allow,deny
                        Allow from all
                        AuthBasicAuthoritative Off
                </Directory>
        </IfModule>
        AllowEncodedSlashes On
        ErrorLog /var/log/apache2/error.log
        CustomLog /var/log/apache2/access.log combined
        ServerSignature Off
</VirtualHost>

RewriteEngine On
RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) /s3gw.fcgi?page=$1&params=$2&%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
------------------------------------------------------------------------------------------------------------------------------------------------------------

I am very new to Ceph and object storage in general. I don't know anything 
about FastCGI. Can you help me with my investigation?
Let me know if you need to see some more conf files or logs. I'm not pasting 
them here to avoid filling the space with meaningless info.

Thanks in advance for whoever wants to help me make it work.
---
Joe H. Rahme

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com