Re: RadosGW - Problems running the S3 and SWIFT API at the same time

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I try to simplify the question to get some feedback.

Is anyone running the RadosGW in production with S3 and SWIFT API
active at the same time ?

thank you !

Saverio


2016-05-06 11:39 GMT+02:00 Saverio Proto <zioproto@xxxxxxxxx>:
> Hello,
>
> We have been running the Rados GW with the S3 API and we did not have
> problems for more than a year.
>
> We recently enabled also the SWIFT API for our users.
>
> radosgw --version
> ceph version 0.94.6 (e832001feaf8c176593e0325c8298e3f16dfb403)
>
> The idea is that each user of the system is free of choosing the S3
> client or the SWIFT client to access the same container/buckets.
>
> Please tell us if this is possible by design or if we are doing something wrong.
>
> We have now a problem that some files wrote in the past with S3,
> cannot be read with the SWIFT API because the md5sum always fails.
>
> I am able to reproduce the bug in this way:
>
> We have this file googlebooks-fre-all-2gram-20120701-ts.gz and we know
> the correct md5 is 1c8113d2bd21232688221ec74dccff3a
> You can download the same file here:
> https://www.dropbox.com/s/auq16vdv2maw4p7/googlebooks-fre-all-2gram-20120701-ts.gz?dl=0
>
> rclone mkdir lss3:bugreproduce
> rclone copy googlebooks-fre-all-2gram-20120701-ts.gz lss3:bugreproduce
>
> The file is successfully uploaded.
>
> At this point I can succesfully download again the file:
> rclone copy lss3:bugreproduce/googlebooks-fre-all-2gram-20120701-ts.gz test.gz
>
> but not with swift:
>
> swift download googlebooks-ngrams-gz
> fre/googlebooks-fre-all-2gram-20120701-ts.gz
> Error downloading object
> 'googlebooks-ngrams-gz/fre/googlebooks-fre-all-2gram-20120701-ts.gz':
> u'Error downloading fre/googlebooks-fre-all-2gram-20120701-ts.gz:
> md5sum != etag, 1c8113d2bd21232688221ec74dccff3a !=
> 1a209a31b4ac3eb923fac5e8d194d9d3-2'
>
> Also I found strange the dash character '-' at the end of the md5 that
> is trying to compare.
>
> Of course upload a file with the swift client and redownloading the
> same file just works.
>
> Should I open a bug for the radosgw on http://tracker.ceph.com/ ?
>
> thank you
>
> Saverio
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux