Re: rgw: object listing hangs on versioned bucket

KIMURA Osamu <kimura.osamu@xxxxxxxxxxxxxx> · Wed, 15 Jun 2016 14:26:02 +0900

I opened a ticket with earlier log.
http://tracker.ceph.com/issues/16309

Thank you,
KIMURA

On 2016/06/14 19:21, Orit Wasserman wrote:
It could be a different problem, can you open a new issue?

Thanks,
Orit

On Tue, Jun 14, 2016 at 5:13 AM, KIMURA Osamu
<kimura.osamu@xxxxxxxxxxxxxx> wrote:
Hello,

An our customer got a problem on RADOSGW.
The customer tried to list objects on a versioned bucket with S3 API,
then they got 500 server error due to FastCGI timeout.
RGW's internal listing process continued over the night (approx 10hours)
until they restarted the RGW. Please see attached radosgw log.

The behavior seems to be similar to bug#12913, but they are using
v0.94.6 of RGW. The bug should be resolved in the version.
http://tracker.ceph.com/issues/12913

As we can find in the log, RGW repeatedly tried to get information
for a specific object (testfile1896.txt).

The object has null version and another version as bellow.
Yes, versioning of the bucket was enabled after some objects had been
put in the bucket.

Similar condition can be found in bug#15243, but the fix only affects
to deletion.
http://tracker.ceph.com/issues/15243

Are there any problem remained in versioned object with null version?

Regards,
KIMURA

----------------------
<?xml version="1.0" encoding="UTF-8"?>
<ListVersionsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/";>
 <Name>hojo-bucket-02</Name>
 <Prefix>testfile1896.txt</Prefix>
 <KeyMarker></KeyMarker>
 <MaxKeys>1000</MaxKeys>
 <IsTruncated>false</IsTruncated>
 <Version>
  <Key>testfile1896.txt</Key>
  <VersionId>2MSeTpZoDSqt2nTk1oYHZNmF1e84C.1</VersionId>
  <IsLatest>true</IsLatest>
  <LastModified>2016-05-30T08:39:52.000Z</LastModified>
  <ETag>&quot;1d24c7924b9798bb9064dcb043b3d989&quot;</ETag>
  <Size>3152</Size>
  <StorageClass>STANDARD</StorageClass>
  <Owner>
   <ID>XXXXXXXX</ID>
   <DisplayName>XXXXXXXX</DisplayName>
  </Owner>
 </Version>
 <Version>
  <Key>testfile1896.txt</Key>
  <VersionId>null</VersionId>
  <IsLatest>false</IsLatest>
  <LastModified>2016-05-30T02:43:22.000Z</LastModified>
  <ETag>&quot;20a4fc4c12598089a8937496a5eba67e&quot;</ETag>
  <Size>3052</Size>
  <StorageClass>STANDARD</StorageClass>
  <Owner>
   <ID>XXXXXXXX</ID>
   <DisplayName>XXXXXXXX</DisplayName>
  </Owner>
 </Version>
</ListVersionsResult>

--
KIMURA Osamu / 木村 修
Engineering Department, Storage Development Division,
Data Center Platform Business Unit, FUJITSU LIMITED
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html