Thank you Josh,
I'm not sure if this is ceph's fault or perhaps FastCGI's or Boto's.
When trying to upload 10KB chunk I've had those mysterious FastCGI's
errors on server side and boto.exception.BotoServerError:
BotoServerError: 500 Internal Server Error on client side.
I've tried now to upload 4MB part - the error on client's side was as
expected EntityTooSmall - but returned at the end, when I've called
the method complete_upload.
Perhaps this output can be helpful to someone:
$ python boto_multi.py
begin upload of Bosphorus_1920x1080_30fps_420_8bit_AVC_MP4.mp4
size 7507998, 2 parts
upload part 1 size 4194304
upload part 2 size 3313694
end upload
Traceback (most recent call last):
File "boto_multi.py", line 48, in <module>
part.complete_upload()
File "local/lib/python2.7/site-packages/boto/s3/multipart.py", line
319, in complete_upload
self.id, xml)
File "local/lib/python2.7/site-packages/boto/s3/bucket.py", line
1779, in complete_multipart_upload
response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 400 Bad Request
<?xml version="1.0" encoding="UTF-8"?><Error><Code>EntityTooSmall</Code></Error>
Cheers,
Patrycja Szab?owska
2014-07-08 0:10 GMT+02:00 Josh Durgin <josh.durgin at inktank.com>:
> On 07/07/2014 05:41 AM, Patrycja Szab?owska wrote:
>>
>> OK, the mystery is solved.
>>
>> From https://www.mail-archive.com/ceph-users at lists.ceph.com/msg10368.html
>> "During a multi part upload you can't upload parts smaller than 5M"
>>
>> I've tried to upload smaller chunks, like 10KB. I've changed chunk size
>> to 5MB and it works now.
>>
>> It's a pity that the Ceph's docs don't mention the limit (or I couldn't
>> found it anywhere). And that the error wasn't helpful at all.
>
>
> Glad you figured it out. This is in the s3 docs [1], but the lack of
> error message is a regression. I added a couple tickets for this:
>
> http://tracker.ceph.com/issues/8764
> http://tracker.ceph.com/issues/8766
>
> Josh
>
> [1] http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadUploadPart.html
