Thanks
Workaround, don't use multipart when obj size == 0 ?
On Dec 3, 2013 6:43 AM, "Yehuda Sadeh" <yehuda@xxxxxxxxxxx> wrote:
I created earlier an issue (6919) and updated it with the relevant
issue. This has been fixed in dumpling, although I don't remember
hitting the scenario that you did. Was probably hitting it as part of
the development work that was done then.
In any case I created a branch with the relevant fixes in it (wip-6919).
Thanks,
Yehuda
On Mon, Dec 2, 2013 at 8:39 PM, Dominik Mostowiec
<dominikmostowiec@xxxxxxxxx> wrote:
> for another object.
> http://pastebin.com/VkVAYgwn
>
>
> 2013/12/3 Yehuda Sadeh <yehuda@xxxxxxxxxxx>:
>> I see. Do you have backtrace for the crash?
>>
>> On Mon, Dec 2, 2013 at 6:19 PM, Dominik Mostowiec
>> <dominikmostowiec@xxxxxxxxx> wrote:
>>> 0.56.7
>>>
>>> W dniu poniedziałek, 2 grudnia 2013 użytkownik Yehuda Sadeh napisał:
>>>
>>>> I'm having trouble reproducing the issue. What version are you using?
>>>>
>>>> Thanks,
>>>> Yehuda
>>>>
>>>> On Mon, Dec 2, 2013 at 2:16 PM, Yehuda Sadeh <yehuda@xxxxxxxxxxx> wrote:
>>>> > Actually, I read that differently. It only says that if there's more
>>>> > than 1 part, all parts except for the last one need to be > 5M. Which
>>>> > means that for uploads that are smaller than 5M there should be zero
>>>> > or one parts.
>>>> >
>>>> > On Mon, Dec 2, 2013 at 12:54 PM, Dominik Mostowiec
>>>> > <dominikmostowiec@xxxxxxxxx> wrote:
>>>> >> You're right.
>>>> >>
>>>> >> S3 api doc:
>>>> >> http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadComplete.html
>>>> >> "Err:EntityTooSmall
>>>> >> Your proposed upload is smaller than the minimum allowed object size.
>>>> >> Each part must be at least 5 MB in size, except the last part."
>>>> >>
>>>> >> Thanks.
>>>> >>
>>>> >> This error should be triggered from radosgw also.
>>>> >>
>>>> >> --
>>>> >> Regards
>>>> >> Dominik
>>>> >>
>>>> >> 2013/12/2 Yehuda Sadeh <yehuda@xxxxxxxxxxx>:
>>>> >>> Looks like it. There should be a guard against it (mulitpart upload
>>>> >>> minimum is 5M).
>>>> >>>
>>>> >>> On Mon, Dec 2, 2013 at 12:32 PM, Dominik Mostowiec
>>>> >>> <dominikmostowiec@xxxxxxxxx> wrote:
>>>> >>>> Yes, this is probably upload empty file.
>>>> >>>> This is the problem?
>>>> >>>>
>>>> >>>> --
>>>> >>>> Regards
>>>> >>>> Dominik
>>>> >>>>
>>>> >>>>
>>>> >>>> 2013/12/2 Yehuda Sadeh <yehuda@xxxxxxxxxxx>:
>>>> >>>>> By any chance are you uploading empty objects through the multipart
>>>> >>>>> upload api?
>>>> >>>>>
>>>> >>>>> On Mon, Dec 2, 2013 at 12:08 PM, Dominik Mostowiec
>>>> >>>>> <dominikmostowiec@xxxxxxxxx> wrote:
>>>> >>>>>> Hi,
>>>> >>>>>> Another file with the same problems:
>>>> >>>>>>
>>>> >>>>>> 2013-12-01 11:37:15.556687 7f7891fd3700 1 ====== starting new
>>>> >>>>>> request
>>>> >>>>>> req=0x25406d0 =====
>>>> >>>>>> 2013-12-01 11:37:15.556739 7f7891fd3700 2 req
>>>> >>>>>> 1314:0.000052::::initializing
>>>> >>>>>> 2013-12-01 11:37:15.556789 7f7891fd3700 10 s->object=files/192.txt
>>>> >>>>>> s->bucket=testbucket
>>>> >>>>>> 2013-12-01 11:37:15.556799 7f7891fd3700 2 req
>>>> >>>>>> 1314:0.000112:s3:POST
>>>> >>>>>> /testbucket/files/192.txt::getting op
>>>> >>>>>> 2013-12-01 11:37:15.556804 7f7891fd3700 2 req
>>>> >>>>>> 1314:0.000118:s3:POST
>>>> >>>>>> /testbucket/files/192.txt:complete_multipart:authorizing
>>>> >>>>>> 2013-12-01 11:37:15.560013 7f7891fd3700 10 get_canon_resource():
>>>> >>>>>>
>>>> >>>>>> dest=/testbucket/files/192.txt?uploadId=i92xi2olzDtFAeLXlfU2PFP9CDU87BC
>>>> >>>>>> 2013-12-01 11:37:15.560027 7f7891fd3700 10 auth_hdr:
>>>> >>>>>> POST
>>>> >>>>>>
>>>> >>>>>> application/xml
>>>> >>>>>> Sun, 01 Dec 2013 10:37:10 GMT
>>>> >>>>>> /testbucket/files/192.txt?uploadId=i92xi2olzDtFAeLXlfU2PFP9CDU87BC
>>>> >>>>>> 2013-12-01 11:37:15.560085 7f7891fd3700 2 req
>>>> >>>>>> 1314:0.003399:s3:POST
>>>> >>>>>> /testbucket/files/192.txt:complete_multipart:reading permissions
>>>> >>>>>> 2013-12-01 11:37:15.562356 7f7891fd3700 2 req
>>>> >>>>>> 1314:0.005670:s3:POST
>>>> >>>>>> /testbucket/files/192.txt:complete_multipart:verifying op
>>>> >>>>>> permissions
>>>> >>>>>> 2013-12-01 11:37:15.562373 7f7891fd3700 5 Searching permissions
>>>> >>>>>> for
>>>> >>>>>> uid=0 mask=2
>>>> >>>>>> 2013-12-01 11:37:15.562377 7f7891fd3700 5 Found permission: 15
>>>> >>>>>> 2013-12-01 11:37:15.562378 7f7891fd3700 10 uid=0 requested perm
>>>> >>>>>> (type)=2, policy perm=2, user_perm_mask=2, acl perm=2
>>>> >>>>>> 2013-12-01 11:37:15.562381 7f7891fd3700 2 req
>>>> >>>>>> 1314:0.005695:s3:POST
>>>> >>>>>> /testbucket/files/192.txt:complete_multipart:verifying op params
>>>> >>>>>> 2013-12-01 11:37:15.562384 7f7891fd3700 2 req
>>>> >>>>>> 1314:0.005698:s3:POST
>>>> >>>>>> /testbucket/files/192.txt:complete_multipart:executing
>>>> >>>>>> 2013-12-01 11:37:15.565461 7f7891fd3700 10 calculated etag:
>>>> >>>>>> d41d8cd98f00b204e9800998ecf8427e-0
>>>> >>>>>> 2013-12-01 11:37:15.566718 7f7891fd3700 10 can't clone object
>>>> >>>>>> testbucket:files/192.txt to shadow object, tag/shadow_obj haven't
>>>> >>>>>> been
>>>> >>>>>> set
>>>> >>>>>> 2013-12-01 11:37:15.566777 7f7891fd3700 0 setting object
>>>> >>>>>> tag=_leyAzxCw7YxpKv8P3v3QGwcsw__9VmP
>>>> >>>>>> 2013-12-01 11:37:15.678973 7f7891fd3700 2 req
>>>> >>>>>> 1314:0.122286:s3:POST
>>>> >>>>>> /testbucket/files/192.txt:complete_multipart:http status=200
>>>> >>>>>> 2013-12-01 11:37:15.679192 7f7891fd3700 1 ====== req done
>>>> >>>>>> req=0x25406d0 http_status=200 ======
>>>> >>>>>>
>>>> >>>>>> Yes, I can read oryginal object.
>>>> >>>>>>
>>>> >>>>>> --
>>>> >>>>>> Regards
>>>> >>>>>> Dominik
>>>> >>>>>>
>>>> >>>>>> 2013/12/2 Yehuda Sadeh <yehuda@xxxxxxxxxxx>:
>>>> >>>>>>> That's unknown bug. I have a guess as to how the original object
>>>> >>>>>>> was
>>>> >>>>>>> created. Can you read the original object, but only copy fails?
>>>> >>>>>>>
>>>> >>>>>>> On Dec 2, 2013 4:53 AM, "Dominik Mostowiec"
>>>> >>>>>>> <dominikmostowiec@xxxxxxxxx>
>>>> >>>>>>> wrote:
>>>> >>>>>>>>
>>>> >>>>>>>> Hi,
>>>> >>>>>>>> I found that issue is related with "ETag: ....-0" (ends -0)
>>>> >>>>>>>> This is known bug ?
>>>> >>>>>>>>
>>>> >>>>>>>> --
>>>> >>>>>>>> Regards
>>>> >>>>>>>> Dominik
>>>> >>>>>>>>
>>>> >>>>>>>> 2013/12/2 Dominik Mostowiec <dominikmostowiec@xxxxxxxxx>:
>>>> >>>>>>>> > Hi,
>>>> >>>>>>>> > I have strange problem.
>>>> >>>>>>>> > Obj copy (0 size) killing radosgw.
>>>> >>>>>>>> >
>>>> >>>>>>>> > Head for this file:
>>>> >>>>>>>> > Content-Type: application/octet-stream
>>>> >>>>>>>> > Server: Apache/2.2.22 (Ubuntu)
>>>> >>>>>>>> > ETag: "d41d8cd98f00b204e9800998ecf8427e-0"
>>>> >>>>>>>> > Last-Modified: 2013-12-01T10:37:15Z
>>>> >>>>>>>> >
>>>> >>>>>>>> > rgw log.
>>>> >>>>>>>> > 2013-12-02 08:18:59.196651 7f5308ff1700 1 ====== starting new
>>>> >>>>>>>> > request
>>>> >>>>>>>> > req=0x2be6fa0 =====
>>>> >>>>>>>> > 2013-12-02 08:18:59.196709 7f5308ff1700 2 req
>>>> >>>>>>>> > 237:0.000058::::initializing
>>>> >>>>>>>> > 2013-12-02 08:18:59.196752 7f5308ff1700 10 meta>>
>>>> >>>>>>>> > HTTP_X_AMZ_ACL=public-read
>>>> >>>>>>>> > 2013-12-02 08:18:59.196760 7f5308ff1700 10 meta>>
>>>> >>>>>>>> > HTTP_X_AMZ_COPY_SOURCE=/testbucket/testfile.xml
>>>> >>>>>>>> > 2013-12-02 08:18:59.196766 7f5308ff1700 10 meta>>
>>>> >>>>>>>> > HTTP_X_AMZ_METADATA_DIRECTIVE=COPY
>>>> >>>>>>>> > 2013-12-02 08:18:59.196771 7f5308ff1700 10 x>>
>>>> >>>>>>>> > x-amz-acl:public-read
>>>> >>>>>>>> > 2013-12-02 08:18:59.196772 7f5308ff1700 10 x>>
>>>> >>>>>>>> > x-amz-copy-source:/testbucket/testfile.xml
>>>> >>>>>>>> > 2013-12-02 08:18:59.196773 7f5308ff1700 10 x>>
>>>> >>>>>>>> > x-amz-metadata-directive:COPY
>>>> >>>>>>>> > 2013-12-02 08:18:59.196786 7f5308ff1700 10
>>>> >>>>>>>> > s->object=/testbucket/new_testfile.ini s->bucket=testbucket
>>>> >>>>>>>> > 2013-12-02 08:18:59.196792 7f5308ff1700 2 req
>>>> >>>>>>>> > 237:0.000141:s3:PUT
>>>> >>>>>>>> > /testbucket/new_testfile.ini::getting op
>>>> >>>>>>>> > 2013-12-02 08:18:59.196797 7f5308ff1700 2 req
>>>> >>>>>>>> > 237:0.000146:s3:PUT
>>>> >>>>>>>> > /testbucket/new_testfile.ini:copy_obj:authorizing
>>>> >>>>>>>> > 2013-12-02 08:18:59.200648 7f5308ff1700 10
>>>> >>>>>>>> > get_canon_resource():
>>>> >>>>>>>> > dest=/testbucket/new_testfile.ini
>>>> >>>>>>>> > 2013-12-02 08:18:59.200661 7f5308ff1700 10 auth_hdr:
>>>> >>>>>>>> > PUT
>>>> >>>>>>>> > 1B2M2Y8AsgTpgAmY7PhCfg==
>>>> >>>>>>>> > application/octet-stream
>>>> >>>>>>>> > Mon, 02 Dec 2013 07:18:55 GMT
>>>> >>>>>>>> > x-amz-acl:public-read
>>>> >>>>>>>> > x-amz-copy-source:/testbucket/testfile.xml
>>>> >>>>>>>> > x-amz-metadata-directive:COPY
>>>> >>>>>>>> > /testbucket/new_testfile.ini
>>>> >>>>>>>> > 2013-12-02 08:18:59.200717 7f5308ff1700 2 req
>>>> >>>>>>>> > 237:0.004066:s3:PUT
>>>> >>>>>>>> > /testbucket/new_testfile.ini:copy_obj:reading permissions
>>>> >>>>>>>> > 2013-12-02 08:18:59.203330 7f5308ff1700 2 req
>>>> >>>>>>>> > 237:0.006679:s3:PUT
>>>> >>>>>>>> > /testbucket/new_testfile.ini:copy_obj:verifying op permissions
>>>> >>>>>>>> > 2013-12-02 08:18:59.207627 7f5308ff1700 10 manifest: total_size
>>>> >>>>>>>> > = 0
>>>> >>>>>>>> > 2013-12-02 08:18:59.207649 7f5308ff1700 5 Searching
>>>> >>>>>>>> > permissions for
>>>> >>>>>>>> > uid=0 mask=1
>>>> >>>>>>>> > 2013-12-02 08:18:59.207652 7f5308ff1700 5 Found permission: 15
>>>> >>>>>>>> > 2013-12-02 08:18:59.207654 7f5308ff1700 10 uid=0 requested
>>>> >>>>>>>> > perm
>>>> >>>>>>>> > (type)=1, policy perm=1, user_perm_mask=15, acl perm=1
>>>> >>>>>>>> > 2013-12-02 08:18:59.207669 7f5308ff1700 5 Searching
>>>> >>>>>>>> > permissions for
>>>> >>>>>>>> > uid=0 mask=2
>>>> >>>>>>>> > 2013-12-02 08:18:59.207670 7f5308ff1700 5 Found permission: 15
>>>> >>>>>>>> > 2013-12-02 08:18:59.207671 7f5308ff1700 10 uid=0 requested
>>>> >>>>>>>> > perm
>>>> >>>>>>>> > (type)=2, policy perm=2, user_perm_mask=15, acl perm=2
>>>> >>>>>>>> > 2013-12-02 08:18:59.207681 7f5308ff1700 2 req
>>>> >>>>>>>> > 237:0.011030:s3:PUT
>>>> >>>>>>>> > /testbucket/new_testfile.ini:copy_obj:verifying op params
>>>> >>>>>>>> > 2013-12-02 08:18:59.207686 7f5308ff1700 2 req
>>>> >>>>>>>> > 237:0.011035:s3:PUT
>>>> >>>>>>>> > /testbucket/new_testfile.ini:copy_obj:executing
>>>> >>>>>>>> > 2013-12-02 08:18:59.207699 7f5308ff1700 10 x>>
>>>> >>>>>>>> > x-amz-acl:public-read
>>>> >>>>>>>> > 2013-12-02 08:18:59.207704 7f5308ff1700 10 x>>
>>>> >>>>>>>> > x-amz-copy-source:/testbucket/testfile.xml
>>>> >>>>>>>> > 2013-12-02 08:18:59.207709 7f5308ff1700 10 x>>
>>>> >>>>>>>> > x-amz-metadata-directive:COPY
>>>> >>>>>>>> > 2013-12-02 08:18:59.207759 7f5308ff1700 5 Copy object
>>>> >>>>>>>> > testbucket(@.rgw.buckets[406250.1]):testfile.ini =>
>>>> >>>>>>>> > testbucket(@.rgw.buckets[406250.1]):new_testfile.ini
>>>> >>>>>>>> > 2013-12-02 08:18:59.208903 7f5308ff1700 -1 *** Caught signal
>>>> >>>>>>>> > (Segmentation fault) **
>>>> >>>>>>>> > in thread 7f5308ff1700
>>>> >>>>>>>> >
>>>> >>>>>>>> >
>>>> >>>>>>>> > --
>>>> >>>>>>>> > Regards
>>>> >>>>>>>> > Dominik
>>>> >>>>>>>>
>>>> >>>>>>>>
>>>> >>>>>>>>
>>>> >>>>>>>> --
>>>> >>>>>>>> Pozdrawiam
>>>> >>>>>>>> Dominik
>>>> >>>>>>>> _______________________________________________
>>>> >>>>>>>> ceph-users mailing list
>>>> >>>>>>>> ceph-users@xxxxxxxxxxxxxx
>>>> >>>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>> >>>>>>
>>>> >>>>>>
>>>> >>>>>>
>>>> >>>>>> --
>>>> >>>>>> Pozdrawiam
>>>> >>>>>> Dominik
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>> --
>>>> >>>> Pozdrawiam
>>>> >>>> Dominik
>>>> >>
>>>> >>
>>>> >>
>>>> >> --
>>>> >> Pozdrawiam
>>>> >> Dominik
>>>
>>>
>>>
>>> --
>>> Pozdrawiam
>>> Dominik
>
>
>
> --
> Pozdrawiam
> Dominik
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
