Multipart upload on ceph 0.8 doesn't work?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I've installed Ubuntu 12.04 in order to test multiupload with the ceph's
modified fastcgi (according to this:
https://ceph.com/docs/master/install/install-ceph-gateway/#apache-fastcgi-w-100-continue
).

The problem is still the same: I can initiate the multi part upload or
upload single part, but when trying to put a part of multi part upload I
get the error with Fastcgi as I've shown before.

Here's a part of the error log once again:

==> apache.error.log <==
[Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server
"/home/pszablow/ceph/src/htdocs/rgw.fcgi"
[Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
(111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
failed
[Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server
"/home/pszablow/ceph/src/htdocs/rgw.fcgi"


It seems to me that it doesn't matter if I turn the rgw print continue on
or off.

I've got no idea what to try next to make it work... Are there any other
pools needed to put parts in upload?


Thanks,

Patrycja Szab?owska



2014-07-04 16:26 GMT+02:00 Patrycja Szab?owska <
szablowska.patrycja at gmail.com>:

> Still not sure do I need the ceph's modified fastcgi or not.
> But I guess this explains my problem with the installation:
> http://tracker.ceph.com/issues/8233
>
>
> It would be nice to have at least a workaround for this...
>
> Thanks,
>
> Patrycja Szab?owska
>
>
>
> 2014-07-04 16:02 GMT+02:00 Patrycja Szab?owska <
> szablowska.patrycja at gmail.com>:
>
> Thank you Luis for your response.
>>
>> Quite unbelievable, but your solution worked!
>> Unfortunately, I'm stuck again when trying to upload parts of the file.
>>
>> Apache's logs:
>>
>>
>> ==> apache.access.log <==
>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT /bucketbig/ HTTP/1.1" 200
>> 477 "{Referer}i" "Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic"
>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "POST
>> /bucketbig/Bosphorus?uploads HTTP/1.1" 200 249 "{Referer}i" "Boto/2.30.0
>> Python/2.7.6 Linux/3.13.0-30-generic"
>>
>> ==> apache.error.log <==
>> [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
>> 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
>> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>>
>> ==> apache.access.log <==
>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT
>> /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9&partNumber=1
>> HTTP/1.1" 500 531 "{Referer}i" "Boto/2.30.0 Python/2.7.6
>> Linux/3.13.0-30-generic"
>>
>> ==> apache.error.log <==
>> [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
>> (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
>> connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
>> failed
>> [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
>> 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
>> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>>
>>
>>
>> I'm using the default fastcgi module, not the one provided by Ceph. I've
>> tried installing it on my ubuntu 14.04, but unfortunately I keep getting
>> the error:
>>
>> libapache2-mod-fastcgi : requires: apache2.2-common (>= 2.2.4)
>>
>>
>> Is the modified fastcgi module mandatory in order to use multi part
>> upload?
>>
>>
>> Thanks,
>>
>> Patrycja Szab?owska
>>
>>
>> 2014-07-03 18:34 GMT+02:00 Luis Periquito <luis.periquito at ocado.com>:
>>
>>> I was at this issue this morning. It seems radosgw requires you to have
>>> a pool named '' to work with multipart. I just created a pool with that
>>> name
>>> rados mkpool ''
>>>
>>> either that or allow the pool be created by the radosgw...
>>>
>>>
>>> On 3 July 2014 16:27, Patrycja Szab?owska <szablowska.patrycja at gmail.com
>>> > wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm trying to make multi part upload work. I'm using ceph
>>>> 0.80-702-g9bac31b (from the ceph's github).
>>>>
>>>> I've tried the code provided by Mark Kirkwood here:
>>>>
>>>>
>>>> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html
>>>>
>>>>
>>>> But unfortunately, it gives me the error:
>>>>
>>>> (multitest)pszablow at pat-desktop:~/$ python boto_multi.py
>>>>   begin upload of abc.yuv
>>>>   size 7464960000, 7 parts
>>>> Traceback (most recent call last):
>>>>   File "boto_multi.py", line 36, in <module>
>>>>     part = bucket.initiate_multipart_upload(objname)
>>>>   File
>>>> "/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py",
>>>> line 1742, in initiate_multipart_upload
>>>>     response.status, response.reason, body)
>>>> boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
>>>> <?xml version="1.0"
>>>> encoding="UTF-8"?><Error><Code>AccessDenied</Code></Error>
>>>>
>>>>
>>>> The single part upload works for me. I am able to create buckets and
>>>> objects.
>>>> I've tried also other similar examples, but none of them works.
>>>>
>>>>
>>>> Any ideas what's wrong? Does the ceph's multi part upload actually
>>>> work for anybody?
>>>>
>>>>
>>>> Thanks,
>>>>
>>>> Patrycja Szab?owska
>>>> _______________________________________________
>>>> ceph-users mailing list
>>>> ceph-users at lists.ceph.com
>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>>
>>>
>>>
>>>
>>> --
>>>
>>> Luis Periquito
>>>
>>> Unix Engineer
>>>
>>> Ocado.com <http://www.ocado.com/>
>>>
>>> Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park,
>>> Hatfield, Herts AL10 9NE
>>>
>>> Notice:  This email is confidential and may contain copyright material
>>> of members of the Ocado Group. Opinions and views expressed in this message
>>> may not necessarily reflect the opinions and views of the members of the
>>> Ocado Group.
>>>
>>> If you are not the intended recipient, please notify us immediately and
>>> delete all copies of this message. Please note that it is your
>>> responsibility to scan this message for viruses.
>>>
>>> References to the ?Ocado Group? are to Ocado Group plc (registered in
>>> England and Wales with number 7098618) and its subsidiary undertakings (as
>>> that expression is defined in the Companies Act 2006) from time to time.
>>> The registered office of Ocado Group plc is Titan Court, 3 Bishops Square,
>>> Hatfield Business Park, Hatfield, Herts. AL10 9NE.
>>>
>>
>>
>>
>> --
>> Pozdrawiam
>> Patrycja Szab?owska
>>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140707/bd94bbbe/attachment.htm>


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux