Is it possible to not complete a file upload so the actual file is not there, but it is listed in the bucket index? I really need help with this issue. Am Fr., 16. Juli 2021 um 19:35 Uhr schrieb Boris Behrens <bb@xxxxxxxxx>: > > exactly. > rados rm wouldn't remove it from the "radosgw-admin bucket radoslist" > list, correct? > > our usage statistics are not really usable because it fluctuates in a > 200tb range. > > I also hope that I find the files in the "rados ls" list, but I don't > have much hope. > > For me it is key to understand how this happeneds and how I can verify > the integrity of all buckets. > Dataloss is the worst kind of problem for me. > > Am Fr., 16. Juli 2021 um 19:21 Uhr schrieb Jean-Sebastien Landry > <Jean-Sebastien.Landry.6@xxxxxxxxx>: > > > > Ok, so everything looks normal from the sysadmin "bi list" & the > > customer "s3cmd ls" views, except that the GET give a 404 NoSuchKey? > > > > > Is there way to remove a file from a bucket without removing it from > > the bucketindex? > > > > using rados rm probably, but from the customer ends, I hope not. > > > > Do you have any usage stats that can confirm that the data has been > > deleted and/or are still there. (at the pool level maybe?) > > Hopping for you that it's just a data/index/shard mismatch... > > > > > > On 7/16/21 12:44 PM, Boris Behrens wrote: > > > [Externe UL*] > > > > > > Hi Jean-Sebastien, > > > > > > I have the exact opposite. Files can be listed (the are in the bucket > > > index), but are not available anymore. > > > > > > Am Fr., 16. Juli 2021 um 18:41 Uhr schrieb Jean-Sebastien Landry > > > <Jean-Sebastien.Landry.6@xxxxxxxxx>: > > >> Hi Boris, I don't have any answer for you, but I have situation similar > > >> to yours. > > >> > > >> https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/7E6O6ILGE5JCI4ISU66HZ6ZVZP6N6T3M/ > > >> > > >> I didn't try radoslist, I should have. > > >> > > >> Is this new, or it just that the client realised this lately? > > >> All the data seems missing or just some paths? > > >> Did you reshard lately? > > >> Did you test using client programs like s3cmd & rclone...? > > >> > > >> I didn't have time to work on that this week, but I have to find a > > >> solution too. > > >> Meanwhile, I run with a lower shard number and my customer can access > > >> all his data. > > >> Cheers! > > >> > > >> On 7/16/21 11:36 AM, Boris Behrens wrote: > > >>> [Externe UL*] > > >>> > > >>> Hi everybody, > > >>> a customer mentioned that he got problems in accessing hist rgw data. > > >>> I checked the bucket index and the file should be available. Then I > > >>> pulled a list with radosgw-admin radoslist --bucket BUCKET and it > > >>> seems that the file is gone. > > >>> > > >>> beside the "yaiks, is there a way the file might be somewhere else in > > >>> ceph?" how can this happen? > > >>> > > >>> We do occational orphan objects cleanups but this does not pull the > > >>> bucket index into account. > > >>> > > >>> It is a large bucket with 2.1m files in it and with 34 shards. > > >>> > > >>> Cheers and happy weekend > > >>> Boris > > >>> > > >>> -- > > >>> Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend > > >>> im groüen Saal. > > >>> _______________________________________________ > > >>> ceph-users mailing list -- ceph-users@xxxxxxx > > >>> To unsubscribe send an email to ceph-users-leave@xxxxxxx > > >>> ________________________________ > > >>> > > >> _______________________________________________ > > >> ceph-users mailing list -- ceph-users@xxxxxxx > > >> To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > > > > > > > -- > > > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend > > > im groüen Saal. > > > _______________________________________________ > > > ceph-users mailing list -- ceph-users@xxxxxxx > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > ________________________________ > > > > > _______________________________________________ > > ceph-users mailing list -- ceph-users@xxxxxxx > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > > -- > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend > im groüen Saal. -- Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groüen Saal. _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |