Re: AWS SDK and MultiPart Problem

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Pushed a fix to wip-10271. Haven't tested it though, let me know if you try it.

Thanks,
Yehuda

On Thu, Dec 11, 2014 at 8:38 AM, Yehuda Sadeh <yehuda@xxxxxxxxxx> wrote:
> I don't think it has been fixed recently. I'm looking at it now, and
> not sure why it hasn't triggered before in other areas.
>
> Yehuda
>
> On Thu, Dec 11, 2014 at 5:55 AM, Georgios Dimitrakakis
> <giorgis@xxxxxxxxxxxx> wrote:
>> This issue seems very similar to these:
>>
>> http://tracker.ceph.com/issues/8202
>> http://tracker.ceph.com/issues/8702
>>
>>
>> Would it make any difference if I try to build CEPH from sources?
>>
>> I mean is someone aware of it been fixed on any of the recent commits and
>> probably hasn't passed yet to the repositories?
>>
>> Regards,
>>
>> George
>>
>>
>>
>>
>>
>> On Mon, 08 Dec 2014 19:47:59 +0200, Georgios Dimitrakakis wrote:
>>>
>>> I 've just created issues #10271
>>>
>>> Best,
>>>
>>> George
>>>
>>> On Fri, 5 Dec 2014 09:30:45 -0800, Yehuda Sadeh wrote:
>>>>
>>>> It looks like a bug. Can you open an issue on tracker.ceph.com,
>>>> describing what you see?
>>>>
>>>> Thanks,
>>>> Yehuda
>>>>
>>>> On Fri, Dec 5, 2014 at 7:17 AM, Georgios Dimitrakakis
>>>> <giorgis@xxxxxxxxxxxx> wrote:
>>>>>
>>>>> It would be nice to see where and how "uploadId"
>>>>>
>>>>> is being calculated...
>>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>>
>>>>> George
>>>>>
>>>>>
>>>>>
>>>>>> For example if I try to perform the same multipart upload at an older
>>>>>> version ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60)
>>>>>>
>>>>>>
>>>>>> I can see the upload ID in the apache log as:
>>>>>>
>>>>>> "PUT
>>>>>>
>>>>>> /test/XXXX.dat?partNumber=25&uploadId=I3yihBFZmHx9CCqtcDjr8d-RhgfX8NW
>>>>>> HTTP/1.1" 200 - "-" "aws-sdk-nodejs/2.0.29 linux/v0.10.33"
>>>>>>
>>>>>> but when I try the same at ceph version 0.80.7
>>>>>> (6c0127fcb58008793d3c8b62d925bc91963672a3)
>>>>>>
>>>>>> I get the following:
>>>>>>
>>>>>> "PUT
>>>>>>
>>>>>>
>>>>>>
>>>>>> /test/XXXX.dat?partNumber=12&uploadId=2%2Ff9UgnHhdK0VCnMlpT-XA8ttia1HjK36
>>>>>> HTTP/1.1" 403 78 "-" "aws-sdk-nodejs/2.0.29 linux/v0.10.33"
>>>>>>
>>>>>>
>>>>>> and my guess is that the "%2F" at the latter is the one that is
>>>>>> causing the problem and hence the 403 error.
>>>>>>
>>>>>>
>>>>>>
>>>>>> What do you think???
>>>>>>
>>>>>>
>>>>>> Best,
>>>>>>
>>>>>> George
>>>>>>
>>>>>>
>>>>>>
>>>>>>> Hi all!
>>>>>>>
>>>>>>> I am using AWS SDK JS v.2.0.29 to perform a multipart upload into
>>>>>>> Radosgw with ceph version 0.80.7
>>>>>>> (6c0127fcb58008793d3c8b62d925bc91963672a3) and I am getting a 403
>>>>>>> error.
>>>>>>>
>>>>>>>
>>>>>>> I believe that the id which is send to all requests and has been
>>>>>>> urlencoded by the aws-sdk-js doesn't match with the one in rados
>>>>>>> because it's not urlencoded.
>>>>>>>
>>>>>>> Is that the case? Can you confirm it?
>>>>>>>
>>>>>>> Is there something I can do?
>>>>>>>
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>> George
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> ceph-users mailing list
>>>>>>> ceph-users@xxxxxxxxxxxxxx
>>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> ceph-users mailing list
>>>>>> ceph-users@xxxxxxxxxxxxxx
>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> ceph-users mailing list
>>>>> ceph-users@xxxxxxxxxxxxxx
>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>>
>>> _______________________________________________
>>> ceph-users mailing list
>>> ceph-users@xxxxxxxxxxxxxx
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux