Multipart upload on ceph 0.8 doesn't work?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Still not sure do I need the ceph's modified fastcgi or not.
But I guess this explains my problem with the installation:
http://tracker.ceph.com/issues/8233


It would be nice to have at least a workaround for this...

Thanks,

Patrycja Szab?owska



2014-07-04 16:02 GMT+02:00 Patrycja Szab?owska <
szablowska.patrycja at gmail.com>:

> Thank you Luis for your response.
>
> Quite unbelievable, but your solution worked!
> Unfortunately, I'm stuck again when trying to upload parts of the file.
>
> Apache's logs:
>
>
> ==> apache.access.log <==
> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT /bucketbig/ HTTP/1.1" 200
> 477 "{Referer}i" "Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic"
> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "POST
> /bucketbig/Bosphorus?uploads HTTP/1.1" 200 249 "{Referer}i" "Boto/2.30.0
> Python/2.7.6 Linux/3.13.0-30-generic"
>
> ==> apache.error.log <==
> [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
> 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>
> ==> apache.access.log <==
> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT
> /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9&partNumber=1
> HTTP/1.1" 500 531 "{Referer}i" "Boto/2.30.0 Python/2.7.6
> Linux/3.13.0-30-generic"
>
> ==> apache.error.log <==
> [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
> (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
> connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
> failed
> [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
> 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>
>
>
> I'm using the default fastcgi module, not the one provided by Ceph. I've
> tried installing it on my ubuntu 14.04, but unfortunately I keep getting
> the error:
>
> libapache2-mod-fastcgi : requires: apache2.2-common (>= 2.2.4)
>
>
> Is the modified fastcgi module mandatory in order to use multi part upload?
>
>
> Thanks,
>
> Patrycja Szab?owska
>
>
> 2014-07-03 18:34 GMT+02:00 Luis Periquito <luis.periquito at ocado.com>:
>
>> I was at this issue this morning. It seems radosgw requires you to have a
>> pool named '' to work with multipart. I just created a pool with that name
>> rados mkpool ''
>>
>> either that or allow the pool be created by the radosgw...
>>
>>
>> On 3 July 2014 16:27, Patrycja Szab?owska <szablowska.patrycja at gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I'm trying to make multi part upload work. I'm using ceph
>>> 0.80-702-g9bac31b (from the ceph's github).
>>>
>>> I've tried the code provided by Mark Kirkwood here:
>>>
>>>
>>> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html
>>>
>>>
>>> But unfortunately, it gives me the error:
>>>
>>> (multitest)pszablow at pat-desktop:~/$ python boto_multi.py
>>>   begin upload of abc.yuv
>>>   size 7464960000, 7 parts
>>> Traceback (most recent call last):
>>>   File "boto_multi.py", line 36, in <module>
>>>     part = bucket.initiate_multipart_upload(objname)
>>>   File
>>> "/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py",
>>> line 1742, in initiate_multipart_upload
>>>     response.status, response.reason, body)
>>> boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
>>> <?xml version="1.0"
>>> encoding="UTF-8"?><Error><Code>AccessDenied</Code></Error>
>>>
>>>
>>> The single part upload works for me. I am able to create buckets and
>>> objects.
>>> I've tried also other similar examples, but none of them works.
>>>
>>>
>>> Any ideas what's wrong? Does the ceph's multi part upload actually
>>> work for anybody?
>>>
>>>
>>> Thanks,
>>>
>>> Patrycja Szab?owska
>>> _______________________________________________
>>> ceph-users mailing list
>>> ceph-users at lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>
>>
>>
>> --
>>
>> Luis Periquito
>>
>> Unix Engineer
>>
>> Ocado.com <http://www.ocado.com/>
>>
>> Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park,
>> Hatfield, Herts AL10 9NE
>>
>> Notice:  This email is confidential and may contain copyright material of
>> members of the Ocado Group. Opinions and views expressed in this message
>> may not necessarily reflect the opinions and views of the members of the
>> Ocado Group.
>>
>> If you are not the intended recipient, please notify us immediately and
>> delete all copies of this message. Please note that it is your
>> responsibility to scan this message for viruses.
>>
>> References to the ?Ocado Group? are to Ocado Group plc (registered in
>> England and Wales with number 7098618) and its subsidiary undertakings (as
>> that expression is defined in the Companies Act 2006) from time to time.
>> The registered office of Ocado Group plc is Titan Court, 3 Bishops Square,
>> Hatfield Business Park, Hatfield, Herts. AL10 9NE.
>>
>
>
>
> --
> Pozdrawiam
> Patrycja Szab?owska
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140704/ae710576/attachment.htm>


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux