Actually, I read that differently. It only says that if there's more than 1 part, all parts except for the last one need to be > 5M. Which means that for uploads that are smaller than 5M there should be zero or one parts. On Mon, Dec 2, 2013 at 12:54 PM, Dominik Mostowiec <dominikmostowiec@xxxxxxxxx> wrote: > You're right. > > S3 api doc: http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadComplete.html > "Err:EntityTooSmall > Your proposed upload is smaller than the minimum allowed object size. > Each part must be at least 5 MB in size, except the last part." > > Thanks. > > This error should be triggered from radosgw also. > > -- > Regards > Dominik > > 2013/12/2 Yehuda Sadeh <yehuda@xxxxxxxxxxx>: >> Looks like it. There should be a guard against it (mulitpart upload >> minimum is 5M). >> >> On Mon, Dec 2, 2013 at 12:32 PM, Dominik Mostowiec >> <dominikmostowiec@xxxxxxxxx> wrote: >>> Yes, this is probably upload empty file. >>> This is the problem? >>> >>> -- >>> Regards >>> Dominik >>> >>> >>> 2013/12/2 Yehuda Sadeh <yehuda@xxxxxxxxxxx>: >>>> By any chance are you uploading empty objects through the multipart upload api? >>>> >>>> On Mon, Dec 2, 2013 at 12:08 PM, Dominik Mostowiec >>>> <dominikmostowiec@xxxxxxxxx> wrote: >>>>> Hi, >>>>> Another file with the same problems: >>>>> >>>>> 2013-12-01 11:37:15.556687 7f7891fd3700 1 ====== starting new request >>>>> req=0x25406d0 ===== >>>>> 2013-12-01 11:37:15.556739 7f7891fd3700 2 req 1314:0.000052::::initializing >>>>> 2013-12-01 11:37:15.556789 7f7891fd3700 10 s->object=files/192.txt >>>>> s->bucket=testbucket >>>>> 2013-12-01 11:37:15.556799 7f7891fd3700 2 req 1314:0.000112:s3:POST >>>>> /testbucket/files/192.txt::getting op >>>>> 2013-12-01 11:37:15.556804 7f7891fd3700 2 req 1314:0.000118:s3:POST >>>>> /testbucket/files/192.txt:complete_multipart:authorizing >>>>> 2013-12-01 11:37:15.560013 7f7891fd3700 10 get_canon_resource(): >>>>> dest=/testbucket/files/192.txt?uploadId=i92xi2olzDtFAeLXlfU2PFP9CDU87BC >>>>> 2013-12-01 11:37:15.560027 7f7891fd3700 10 auth_hdr: >>>>> POST >>>>> >>>>> application/xml >>>>> Sun, 01 Dec 2013 10:37:10 GMT >>>>> /testbucket/files/192.txt?uploadId=i92xi2olzDtFAeLXlfU2PFP9CDU87BC >>>>> 2013-12-01 11:37:15.560085 7f7891fd3700 2 req 1314:0.003399:s3:POST >>>>> /testbucket/files/192.txt:complete_multipart:reading permissions >>>>> 2013-12-01 11:37:15.562356 7f7891fd3700 2 req 1314:0.005670:s3:POST >>>>> /testbucket/files/192.txt:complete_multipart:verifying op permissions >>>>> 2013-12-01 11:37:15.562373 7f7891fd3700 5 Searching permissions for >>>>> uid=0 mask=2 >>>>> 2013-12-01 11:37:15.562377 7f7891fd3700 5 Found permission: 15 >>>>> 2013-12-01 11:37:15.562378 7f7891fd3700 10 uid=0 requested perm >>>>> (type)=2, policy perm=2, user_perm_mask=2, acl perm=2 >>>>> 2013-12-01 11:37:15.562381 7f7891fd3700 2 req 1314:0.005695:s3:POST >>>>> /testbucket/files/192.txt:complete_multipart:verifying op params >>>>> 2013-12-01 11:37:15.562384 7f7891fd3700 2 req 1314:0.005698:s3:POST >>>>> /testbucket/files/192.txt:complete_multipart:executing >>>>> 2013-12-01 11:37:15.565461 7f7891fd3700 10 calculated etag: >>>>> d41d8cd98f00b204e9800998ecf8427e-0 >>>>> 2013-12-01 11:37:15.566718 7f7891fd3700 10 can't clone object >>>>> testbucket:files/192.txt to shadow object, tag/shadow_obj haven't been >>>>> set >>>>> 2013-12-01 11:37:15.566777 7f7891fd3700 0 setting object >>>>> tag=_leyAzxCw7YxpKv8P3v3QGwcsw__9VmP >>>>> 2013-12-01 11:37:15.678973 7f7891fd3700 2 req 1314:0.122286:s3:POST >>>>> /testbucket/files/192.txt:complete_multipart:http status=200 >>>>> 2013-12-01 11:37:15.679192 7f7891fd3700 1 ====== req done >>>>> req=0x25406d0 http_status=200 ====== >>>>> >>>>> Yes, I can read oryginal object. >>>>> >>>>> -- >>>>> Regards >>>>> Dominik >>>>> >>>>> 2013/12/2 Yehuda Sadeh <yehuda@xxxxxxxxxxx>: >>>>>> That's unknown bug. I have a guess as to how the original object was >>>>>> created. Can you read the original object, but only copy fails? >>>>>> >>>>>> On Dec 2, 2013 4:53 AM, "Dominik Mostowiec" <dominikmostowiec@xxxxxxxxx> >>>>>> wrote: >>>>>>> >>>>>>> Hi, >>>>>>> I found that issue is related with "ETag: ....-0" (ends -0) >>>>>>> This is known bug ? >>>>>>> >>>>>>> -- >>>>>>> Regards >>>>>>> Dominik >>>>>>> >>>>>>> 2013/12/2 Dominik Mostowiec <dominikmostowiec@xxxxxxxxx>: >>>>>>> > Hi, >>>>>>> > I have strange problem. >>>>>>> > Obj copy (0 size) killing radosgw. >>>>>>> > >>>>>>> > Head for this file: >>>>>>> > Content-Type: application/octet-stream >>>>>>> > Server: Apache/2.2.22 (Ubuntu) >>>>>>> > ETag: "d41d8cd98f00b204e9800998ecf8427e-0" >>>>>>> > Last-Modified: 2013-12-01T10:37:15Z >>>>>>> > >>>>>>> > rgw log. >>>>>>> > 2013-12-02 08:18:59.196651 7f5308ff1700 1 ====== starting new request >>>>>>> > req=0x2be6fa0 ===== >>>>>>> > 2013-12-02 08:18:59.196709 7f5308ff1700 2 req >>>>>>> > 237:0.000058::::initializing >>>>>>> > 2013-12-02 08:18:59.196752 7f5308ff1700 10 meta>> >>>>>>> > HTTP_X_AMZ_ACL=public-read >>>>>>> > 2013-12-02 08:18:59.196760 7f5308ff1700 10 meta>> >>>>>>> > HTTP_X_AMZ_COPY_SOURCE=/testbucket/testfile.xml >>>>>>> > 2013-12-02 08:18:59.196766 7f5308ff1700 10 meta>> >>>>>>> > HTTP_X_AMZ_METADATA_DIRECTIVE=COPY >>>>>>> > 2013-12-02 08:18:59.196771 7f5308ff1700 10 x>> x-amz-acl:public-read >>>>>>> > 2013-12-02 08:18:59.196772 7f5308ff1700 10 x>> >>>>>>> > x-amz-copy-source:/testbucket/testfile.xml >>>>>>> > 2013-12-02 08:18:59.196773 7f5308ff1700 10 x>> >>>>>>> > x-amz-metadata-directive:COPY >>>>>>> > 2013-12-02 08:18:59.196786 7f5308ff1700 10 >>>>>>> > s->object=/testbucket/new_testfile.ini s->bucket=testbucket >>>>>>> > 2013-12-02 08:18:59.196792 7f5308ff1700 2 req 237:0.000141:s3:PUT >>>>>>> > /testbucket/new_testfile.ini::getting op >>>>>>> > 2013-12-02 08:18:59.196797 7f5308ff1700 2 req 237:0.000146:s3:PUT >>>>>>> > /testbucket/new_testfile.ini:copy_obj:authorizing >>>>>>> > 2013-12-02 08:18:59.200648 7f5308ff1700 10 get_canon_resource(): >>>>>>> > dest=/testbucket/new_testfile.ini >>>>>>> > 2013-12-02 08:18:59.200661 7f5308ff1700 10 auth_hdr: >>>>>>> > PUT >>>>>>> > 1B2M2Y8AsgTpgAmY7PhCfg== >>>>>>> > application/octet-stream >>>>>>> > Mon, 02 Dec 2013 07:18:55 GMT >>>>>>> > x-amz-acl:public-read >>>>>>> > x-amz-copy-source:/testbucket/testfile.xml >>>>>>> > x-amz-metadata-directive:COPY >>>>>>> > /testbucket/new_testfile.ini >>>>>>> > 2013-12-02 08:18:59.200717 7f5308ff1700 2 req 237:0.004066:s3:PUT >>>>>>> > /testbucket/new_testfile.ini:copy_obj:reading permissions >>>>>>> > 2013-12-02 08:18:59.203330 7f5308ff1700 2 req 237:0.006679:s3:PUT >>>>>>> > /testbucket/new_testfile.ini:copy_obj:verifying op permissions >>>>>>> > 2013-12-02 08:18:59.207627 7f5308ff1700 10 manifest: total_size = 0 >>>>>>> > 2013-12-02 08:18:59.207649 7f5308ff1700 5 Searching permissions for >>>>>>> > uid=0 mask=1 >>>>>>> > 2013-12-02 08:18:59.207652 7f5308ff1700 5 Found permission: 15 >>>>>>> > 2013-12-02 08:18:59.207654 7f5308ff1700 10 uid=0 requested perm >>>>>>> > (type)=1, policy perm=1, user_perm_mask=15, acl perm=1 >>>>>>> > 2013-12-02 08:18:59.207669 7f5308ff1700 5 Searching permissions for >>>>>>> > uid=0 mask=2 >>>>>>> > 2013-12-02 08:18:59.207670 7f5308ff1700 5 Found permission: 15 >>>>>>> > 2013-12-02 08:18:59.207671 7f5308ff1700 10 uid=0 requested perm >>>>>>> > (type)=2, policy perm=2, user_perm_mask=15, acl perm=2 >>>>>>> > 2013-12-02 08:18:59.207681 7f5308ff1700 2 req 237:0.011030:s3:PUT >>>>>>> > /testbucket/new_testfile.ini:copy_obj:verifying op params >>>>>>> > 2013-12-02 08:18:59.207686 7f5308ff1700 2 req 237:0.011035:s3:PUT >>>>>>> > /testbucket/new_testfile.ini:copy_obj:executing >>>>>>> > 2013-12-02 08:18:59.207699 7f5308ff1700 10 x>> x-amz-acl:public-read >>>>>>> > 2013-12-02 08:18:59.207704 7f5308ff1700 10 x>> >>>>>>> > x-amz-copy-source:/testbucket/testfile.xml >>>>>>> > 2013-12-02 08:18:59.207709 7f5308ff1700 10 x>> >>>>>>> > x-amz-metadata-directive:COPY >>>>>>> > 2013-12-02 08:18:59.207759 7f5308ff1700 5 Copy object >>>>>>> > testbucket(@.rgw.buckets[406250.1]):testfile.ini => >>>>>>> > testbucket(@.rgw.buckets[406250.1]):new_testfile.ini >>>>>>> > 2013-12-02 08:18:59.208903 7f5308ff1700 -1 *** Caught signal >>>>>>> > (Segmentation fault) ** >>>>>>> > in thread 7f5308ff1700 >>>>>>> > >>>>>>> > >>>>>>> > -- >>>>>>> > Regards >>>>>>> > Dominik >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Pozdrawiam >>>>>>> Dominik >>>>>>> _______________________________________________ >>>>>>> ceph-users mailing list >>>>>>> ceph-users@xxxxxxxxxxxxxx >>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>> >>>>> >>>>> >>>>> -- >>>>> Pozdrawiam >>>>> Dominik >>> >>> >>> >>> -- >>> Pozdrawiam >>> Dominik > > > > -- > Pozdrawiam > Dominik -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
