Multipart upload on ceph 0.8 doesn't work?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thank you Luis for your response.

Quite unbelievable, but your solution worked!
Unfortunately, I'm stuck again when trying to upload parts of the file.

Apache's logs:


==> apache.access.log <==
127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT /bucketbig/ HTTP/1.1" 200
477 "{Referer}i" "Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic"
127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "POST
/bucketbig/Bosphorus?uploads HTTP/1.1" 200 249 "{Referer}i" "Boto/2.30.0
Python/2.7.6 Linux/3.13.0-30-generic"

==> apache.error.log <==
[Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server
"/home/pszablow/ceph/src/htdocs/rgw.fcgi"

==> apache.access.log <==
127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT
/bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9&partNumber=1
HTTP/1.1" 500 531 "{Referer}i" "Boto/2.30.0 Python/2.7.6
Linux/3.13.0-30-generic"

==> apache.error.log <==
[Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
(111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
failed
[Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server
"/home/pszablow/ceph/src/htdocs/rgw.fcgi"



I'm using the default fastcgi module, not the one provided by Ceph. I've
tried installing it on my ubuntu 14.04, but unfortunately I keep getting
the error:
libapache2-mod-fastcgi : requires: apache2.2-common (>= 2.2.4)


Is the modified fastcgi module mandatory in order to use multi part upload?


Thanks,

Patrycja Szab?owska


2014-07-03 18:34 GMT+02:00 Luis Periquito <luis.periquito at ocado.com>:

> I was at this issue this morning. It seems radosgw requires you to have a
> pool named '' to work with multipart. I just created a pool with that name
> rados mkpool ''
>
> either that or allow the pool be created by the radosgw...
>
>
> On 3 July 2014 16:27, Patrycja Szab?owska <szablowska.patrycja at gmail.com>
> wrote:
>
>> Hi,
>>
>> I'm trying to make multi part upload work. I'm using ceph
>> 0.80-702-g9bac31b (from the ceph's github).
>>
>> I've tried the code provided by Mark Kirkwood here:
>>
>>
>> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html
>>
>>
>> But unfortunately, it gives me the error:
>>
>> (multitest)pszablow at pat-desktop:~/$ python boto_multi.py
>>   begin upload of abc.yuv
>>   size 7464960000, 7 parts
>> Traceback (most recent call last):
>>   File "boto_multi.py", line 36, in <module>
>>     part = bucket.initiate_multipart_upload(objname)
>>   File
>> "/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py",
>> line 1742, in initiate_multipart_upload
>>     response.status, response.reason, body)
>> boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
>> <?xml version="1.0"
>> encoding="UTF-8"?><Error><Code>AccessDenied</Code></Error>
>>
>>
>> The single part upload works for me. I am able to create buckets and
>> objects.
>> I've tried also other similar examples, but none of them works.
>>
>>
>> Any ideas what's wrong? Does the ceph's multi part upload actually
>> work for anybody?
>>
>>
>> Thanks,
>>
>> Patrycja Szab?owska
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users at lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
>
>
> --
>
> Luis Periquito
>
> Unix Engineer
>
> Ocado.com <http://www.ocado.com/>
>
> Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park,
> Hatfield, Herts AL10 9NE
>
> Notice:  This email is confidential and may contain copyright material of
> members of the Ocado Group. Opinions and views expressed in this message
> may not necessarily reflect the opinions and views of the members of the
> Ocado Group.
>
> If you are not the intended recipient, please notify us immediately and
> delete all copies of this message. Please note that it is your
> responsibility to scan this message for viruses.
>
> References to the ?Ocado Group? are to Ocado Group plc (registered in
> England and Wales with number 7098618) and its subsidiary undertakings (as
> that expression is defined in the Companies Act 2006) from time to time.
> The registered office of Ocado Group plc is Titan Court, 3 Bishops Square,
> Hatfield Business Park, Hatfield, Herts. AL10 9NE.
>



-- 
Pozdrawiam
Patrycja Szab?owska
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140704/38112a1f/attachment.htm>


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux