Re: Files listed in radosgw BI but is not available in ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Ok, so everything looks normal from the sysadmin "bi list" & the customer "s3cmd ls" views, except that the GET give a 404 NoSuchKey?

> Is there way to remove a file from a bucket without removing it from the bucketindex?

using rados rm probably, but from the customer ends, I hope not.

Do you have any usage stats that can confirm that the data has been deleted and/or are still there. (at the pool level maybe?)
Hopping for you that it's just a data/index/shard mismatch...


On 7/16/21 12:44 PM, Boris Behrens wrote:
[Externe UL*]

Hi Jean-Sebastien,

I have the exact opposite. Files can be listed (the are in the bucket
index), but are not available anymore.

Am Fr., 16. Juli 2021 um 18:41 Uhr schrieb Jean-Sebastien Landry
<Jean-Sebastien.Landry.6@xxxxxxxxx>:
Hi Boris, I don't have any answer for you, but I have situation similar
to yours.

https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/7E6O6ILGE5JCI4ISU66HZ6ZVZP6N6T3M/

I didn't try radoslist, I should have.

Is this new, or it just that the client realised this lately?
All the data seems missing or just some paths?
Did you reshard lately?
Did you test using client programs like s3cmd & rclone...?

I didn't have time to work on that this week, but I have to find a
solution too.
Meanwhile, I run with a lower shard number and my customer can access
all his data.
Cheers!

On 7/16/21 11:36 AM, Boris Behrens wrote:
[Externe UL*]

Hi everybody,
a customer mentioned that he got problems in accessing hist rgw data.
I checked the bucket index and the file should be available. Then I
pulled a list with radosgw-admin radoslist --bucket BUCKET and it
seems that the file is gone.

beside the "yaiks, is there a way the file might be somewhere else in
ceph?" how can this happen?

We do occational orphan objects cleanups but this does not pull the
bucket index into account.

It is a large bucket with 2.1m files in it and with 34 shards.

Cheers and happy weekend
   Boris

--
Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
im groüen Saal.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
________________________________

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx


--
Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
im groüen Saal.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
________________________________

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux