exactly. rados rm wouldn't remove it from the "radosgw-admin bucket radoslist" list, correct? our usage statistics are not really usable because it fluctuates in a 200tb range. I also hope that I find the files in the "rados ls" list, but I don't have much hope. For me it is key to understand how this happeneds and how I can verify the integrity of all buckets. Dataloss is the worst kind of problem for me. Am Fr., 16. Juli 2021 um 19:21 Uhr schrieb Jean-Sebastien Landry <Jean-Sebastien.Landry.6@xxxxxxxxx>: > > Ok, so everything looks normal from the sysadmin "bi list" & the > customer "s3cmd ls" views, except that the GET give a 404 NoSuchKey? > > > Is there way to remove a file from a bucket without removing it from > the bucketindex? > > using rados rm probably, but from the customer ends, I hope not. > > Do you have any usage stats that can confirm that the data has been > deleted and/or are still there. (at the pool level maybe?) > Hopping for you that it's just a data/index/shard mismatch... > > > On 7/16/21 12:44 PM, Boris Behrens wrote: > > [Externe UL*] > > > > Hi Jean-Sebastien, > > > > I have the exact opposite. Files can be listed (the are in the bucket > > index), but are not available anymore. > > > > Am Fr., 16. Juli 2021 um 18:41 Uhr schrieb Jean-Sebastien Landry > > <Jean-Sebastien.Landry.6@xxxxxxxxx>: > >> Hi Boris, I don't have any answer for you, but I have situation similar > >> to yours. > >> > >> https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/7E6O6ILGE5JCI4ISU66HZ6ZVZP6N6T3M/ > >> > >> I didn't try radoslist, I should have. > >> > >> Is this new, or it just that the client realised this lately? > >> All the data seems missing or just some paths? > >> Did you reshard lately? > >> Did you test using client programs like s3cmd & rclone...? > >> > >> I didn't have time to work on that this week, but I have to find a > >> solution too. > >> Meanwhile, I run with a lower shard number and my customer can access > >> all his data. > >> Cheers! > >> > >> On 7/16/21 11:36 AM, Boris Behrens wrote: > >>> [Externe UL*] > >>> > >>> Hi everybody, > >>> a customer mentioned that he got problems in accessing hist rgw data. > >>> I checked the bucket index and the file should be available. Then I > >>> pulled a list with radosgw-admin radoslist --bucket BUCKET and it > >>> seems that the file is gone. > >>> > >>> beside the "yaiks, is there a way the file might be somewhere else in > >>> ceph?" how can this happen? > >>> > >>> We do occational orphan objects cleanups but this does not pull the > >>> bucket index into account. > >>> > >>> It is a large bucket with 2.1m files in it and with 34 shards. > >>> > >>> Cheers and happy weekend > >>> Boris > >>> > >>> -- > >>> Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend > >>> im groüen Saal. > >>> _______________________________________________ > >>> ceph-users mailing list -- ceph-users@xxxxxxx > >>> To unsubscribe send an email to ceph-users-leave@xxxxxxx > >>> ________________________________ > >>> > >> _______________________________________________ > >> ceph-users mailing list -- ceph-users@xxxxxxx > >> To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > > > > -- > > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend > > im groüen Saal. > > _______________________________________________ > > ceph-users mailing list -- ceph-users@xxxxxxx > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > ________________________________ > > > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx -- Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groüen Saal. _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |