Re: RadosGW and S3-compatible clients for PC and OSX

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I've made some tests again with s3cmd

you need to have a valid and accessible host_bucket key in the .s3cfg
for example:
host_bucket = %(bucket)s.myhostname.com

if you dont have it, it does not allow you to use lowercase buckets
I believe it checks if the bucket name is a valid dns name, etc

for osx:

brew install s3cmd

[]s
-lorieri




On Tue, Apr 23, 2013 at 4:00 PM, Igor Laskovy <igor.laskovy@xxxxxxxxx> wrote:
So, I totally lost in this, but I did it, and now CrossFTP report:
[R1] Connect to osd01.ceph.labspace.studiogrizzly.com
[R1] Current path: /
[R1] Current path: /
[R1] LIST /
[R1] Request Error [<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL / was not found on this server.</p>
</body></html>
].

On Tue, Apr 23, 2013 at 9:39 PM, Yehuda Sadeh <yehuda@xxxxxxxxxxx> wrote:
> On Tue, Apr 23, 2013 at 11:33 AM, Igor Laskovy <igor.laskovy@xxxxxxxxx> wrote:
>> In /etc/apache2/httpd.conf I have :
>> ServerName osd01.ceph.labspace.studiogrizzly.com
>>
>> In /etc/apache2/sites-available/rgw.conf :
>
>
>
>> FastCgiExternalServer /var/www/s3gw.fcgi -socket /tmp/radosgw.sock
>>
>> <VirtualHost *:80>
>>         ServerName osd01.ceph.labspace.studiogrizzly.com
>>         ServerAdmin igor.laskovy@xxxxxxxxx
>>         DocumentRoot /var/www
>> </VirtualHost>
>
> remove this line ^^^
>
>>
>> RewriteEngine On
>> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*)
>> /s3gw.fcgi?page=$1&params=$2&%{QUERY_STRING}
>> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>>
>> <VirtualHost *:80>
>
> remove this line ^^^
>
>>
>>         <IfModule mod_fastcgi.c>
>>                 <Directory /var/www>
>>                         Options +ExecCGI
>>                         AllowOverride All
>>                         SetHandler fastcgi-script
>>                         Order allow,deny
>>                         Allow from all
>>                         AuthBasicAuthoritative Off
>>                 </Directory>
>>         </IfModule>
>>
>>         AllowEncodedSlashes On
>>         ErrorLog /var/log/apache2/error.log
>>         CustomLog /var/log/apache2/access.log combined
>>         ServerSignature Off
>> </VirtualHost>
>>
>> On Tue, Apr 23, 2013 at 5:57 PM, Yehuda Sadeh <yehuda@xxxxxxxxxxx> wrote:
>>> On Tue, Apr 23, 2013 at 7:51 AM, Igor Laskovy <igor.laskovy@xxxxxxxxx> wrote:
>>>> Sorry for delayed reply,
>>>>
>>>> I am not good familiar with apache.
>>>> For RGW I use one of the OSD nodes. This is clear minimum installation of
>>>> Ubunut 12.04 and ceph deployment on it, no another services.
>>>> I must to say that I use default apache2 package from Ubuntu repository and
>>>> have rgw print continue = false in ceph.conf .
>>>> Again, all configuration made as shown at here
>>>> http://ceph.com/docs/master/radosgw/manual-install/ and here
>>>> http://ceph.com/docs/master/radosgw/config/ nothing more.
>>>> As {fqdn} I have used FQDN for this node.
>>>>
>>>>> try listing whatever under /etc/apache2/sites-enabled, see if there's
>>>>> anything else there.
>>>> Looks like apache works.
>>>>
>>>> Which exactly log files can I show for you?
>>>
>>> I think that your apache site config is the more interesting thing to
>>> look at it right now. The docs might be a bit unclear, we've seen some
>>> error there recently, can you make sure that there's only a single
>>> VirtualHost section in it?
>>>
>>>>
>>>>
>>>> On Sun, Apr 21, 2013 at 11:49 PM, Yehuda Sadeh <yehuda@xxxxxxxxxxx> wrote:
>>>>>
>>>>> On Sun, Apr 21, 2013 at 10:05 AM, Igor Laskovy <igor.laskovy@xxxxxxxxx>
>>>>> wrote:
>>>>> >
>>>>> > Just initial connect to rgw server, nothing further.
>>>>> > Please see below behavior for CrossFTP and S3Browser cases.
>>>>> >
>>>>> > On CrossFTP side:
>>>>> > [R1] Connect to rgw.labspace
>>>>> > [R1] Current path: /
>>>>> > [R1] Current path: /
>>>>> > [R1] LIST /
>>>>> > [R1] Expected XML document response from S3 but received content type
>>>>> > text/html
>>>>> > [R1] Disconnected
>>>>> >
>>>>> > On rgw side:
>>>>> > root@osd01:~# ps aux |grep rados
>>>>> > root      1785  0.4  0.1 2045404 6068 ?        Ssl  19:47   0:00
>>>>> > /usr/bin/radosgw -n client.radosgw.a
>>>>> >
>>>>> > root@osd01:~# tail -f /var/log/apache2/error.log
>>>>> > [Sun Apr 21 19:43:56 2013] [notice] FastCGI: process manager initialized
>>>>> > (pid 1433)
>>>>> > [Sun Apr 21 19:43:56 2013] [notice] Apache/2.2.22 (Ubuntu)
>>>>> > mod_fastcgi/mod_fastcgi-SNAP-0910052141 mod_ssl/2.2.22 OpenSSL/1.0.1
>>>>> > configured -- resuming normal operations
>>>>> > [Sun Apr 21 19:50:19 2013] [error] [client 192.168.1.51] File does not
>>>>> > exist: /var/www/favicon.ico
>>>>>
>>>>> Doesn't seem that your apache is configured right. How does your site
>>>>> config file look like? Do you have any other sites configured (e.g.,
>>>>> the default one)? try listing whatever under
>>>>> /etc/apache2/sites-enabled, see if there's anything else there.
>>>>> >
>>>>> > tail -f /var/log/apache2/access.log
>>>>> > nothing
>>>>> >
>>>>> > On S3browser side:
>>>>> >
>>>>> > [4/21/2013 7:56 PM] Getting buckets list... TaskID: 2
>>>>> > [4/21/2013 7:56 PM] System.Net.WebException:The underlying connection
>>>>> > was closed: An unexpected error occurred on a send. TaskID: 2 TaskID: 2
>>>>> > [4/21/2013 7:56 PM] Error occurred during Getting buckets list TaskID: 2
>>>>> >
>>>>> > On rgw side:
>>>>> >
>>>>> > root@osd01:~# tail -f /var/log/apache2/error.log
>>>>> > [Sun Apr 21 19:56:19 2013] [error] [client 192.168.1.51] Invalid method
>>>>> > in request \x16\x03\x01
>>>>> > [Sun Apr 21 19:56:22 2013] [error] [client 192.168.1.51] Invalid method
>>>>> > in request \x16\x03\x01
>>>>> > [Sun Apr 21 19:56:23 2013] [error] [client 192.168.1.51] Invalid method
>>>>> > in request \x16\x03\x01
>>>>> > [Sun Apr 21 19:56:23 2013] [error] [client 192.168.1.51] Invalid method
>>>>> > in request \x16\x03\x01
>>>>> > [Sun Apr 21 19:56:24 2013] [error] [client 192.168.1.51] Invalid method
>>>>> > in request \x16\x03\x01
>>>>> > [Sun Apr 21 19:56:24 2013] [error] [client 192.168.1.51] Invalid method
>>>>> > in request \x16\x03\x01
>>>>> > [Sun Apr 21 19:56:25 2013] [error] [client 192.168.1.51] Invalid method
>>>>> > in request \x16\x03\x01
>>>>> > [Sun Apr 21 19:56:25 2013] [error] [client 192.168.1.51] Invalid method
>>>>> > in request \x16\x03\x01
>>>>> >
>>>>> > tail -f /var/log/apache2/access.log
>>>>> > nothing
>>>>> >
>>>>> >
>>>>> >
>>>>> > On Sun, Apr 21, 2013 at 7:43 PM, Yehuda Sadeh <yehuda@xxxxxxxxxxx>
>>>>> > wrote:
>>>>> >>
>>>>> >> On Sun, Apr 21, 2013 at 9:39 AM, Igor Laskovy <igor.laskovy@xxxxxxxxx>
>>>>> >> wrote:
>>>>> >> > Well, in each case something specific. For CrossFTP, for example, it
>>>>> >> > says
>>>>> >> > that asking the server it receive text data instead of XML.
>>>>> >>
>>>>> >> When doing what? Are you able to do anything?
>>>>> >>
>>>>> >> > In logs on servers side I don't found something interested.
>>>>> >>
>>>>> >> What do the apache access and error logs show?
>>>>> >>
>>>>> >> >
>>>>> >> > I do everything shown at http://ceph.com/docs/master/radosgw/ and
>>>>> >> > only that,
>>>>> >> > excluding swift compatible preparation.
>>>>> >> > May be there are needs something additional? Manual creating of root
>>>>> >> > bucket
>>>>> >> > or something like that?
>>>>> >> >
>>>>> >> >
>>>>> >> > On Sun, Apr 21, 2013 at 6:53 PM, Yehuda Sadeh <yehuda@xxxxxxxxxxx>
>>>>> >> > wrote:
>>>>> >> >>
>>>>> >> >> On Sun, Apr 21, 2013 at 3:02 AM, Igor Laskovy
>>>>> >> >> <igor.laskovy@xxxxxxxxx>
>>>>> >> >> wrote:
>>>>> >> >> > A little bit more.
>>>>> >> >> >
>>>>> >> >> > I have tried deploy RGW via http://ceph.com/docs/master/radosgw/
>>>>> >> >> > and
>>>>> >> >> > than
>>>>> >> >> > connect S3 Browser, CrossFTP and CloudBerry Explorer clients, but
>>>>> >> >> > all
>>>>> >> >> > unsuccessfully.
>>>>> >> >> >
>>>>> >> >> > Again my question, does anybody use S3 desktop clients with RGW?
>>>>> >> >>
>>>>> >> >> These applications should be compatible with rgw. Are you sure your
>>>>> >> >> setup works? What are you getting?
>>>>> >> >>
>>>>> >> >> Yehuda
>>>>> >> >
>>>>> >> >
>>>>> >> >
>>>>> >> >
>>>>> >> > --
>>>>> >> > Igor Laskovy
>>>>> >> > facebook.com/igor.laskovy
>>>>> >> > studiogrizzly.com
>>>>> >
>>>>> >
>>>>> >
>>>>> >
>>>>> > --
>>>>> > Igor Laskovy
>>>>> > facebook.com/igor.laskovy
>>>>> > studiogrizzly.com
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Igor Laskovy
>>>> facebook.com/igor.laskovy
>>>> studiogrizzly.com
>>
>>
>>
>> --
>> Igor Laskovy
>> facebook.com/igor.laskovy
>> studiogrizzly.com



--
Igor Laskovy
facebook.com/igor.laskovy
studiogrizzly.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux