Here's a recipe, from the when I had the same question: " Re: rgw index shard much larger than others - ceph-users - lists.ceph.io" https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/MO7IHRGJ7TGPKT3GXCKMFLR674G3YGUX/ On Mon, 19 Jul 2021, 18:00 Boris Behrens, <bb@xxxxxxxxx> wrote: > Hi Dan, > how do I find out if a bucket got versioning enabled? > > Am Mo., 19. Juli 2021 um 17:00 Uhr schrieb Dan van der Ster > <dan@xxxxxxxxxxxxxx>: > > > > Hi Boris, > > > > Does the bucket have object versioning enabled? > > We saw something like this once a while ago: `s3cmd ls` showed an > > entry for an object, but when we tried to get it we had 404. > > We didn't find a good explanation in the end -- our user was able to > > re-upload the object and it didn't recur so we didn't debug further. > > > > I suggest you open a ticket in the tracker with all the evidence so > > the developers can help diagnose the problem. > > > > Cheers, Dan > > > > > > On Fri, Jul 16, 2021 at 6:45 PM Boris Behrens <bb@xxxxxxxxx> wrote: > > > > > > Hi Jean-Sebastien, > > > > > > I have the exact opposite. Files can be listed (the are in the bucket > > > index), but are not available anymore. > > > > > > Am Fr., 16. Juli 2021 um 18:41 Uhr schrieb Jean-Sebastien Landry > > > <Jean-Sebastien.Landry.6@xxxxxxxxx>: > > > > > > > > Hi Boris, I don't have any answer for you, but I have situation > similar > > > > to yours. > > > > > > > > > https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/7E6O6ILGE5JCI4ISU66HZ6ZVZP6N6T3M/ > > > > > > > > I didn't try radoslist, I should have. > > > > > > > > Is this new, or it just that the client realised this lately? > > > > All the data seems missing or just some paths? > > > > Did you reshard lately? > > > > Did you test using client programs like s3cmd & rclone...? > > > > > > > > I didn't have time to work on that this week, but I have to find a > > > > solution too. > > > > Meanwhile, I run with a lower shard number and my customer can access > > > > all his data. > > > > Cheers! > > > > > > > > On 7/16/21 11:36 AM, Boris Behrens wrote: > > > > > [Externe UL*] > > > > > > > > > > Hi everybody, > > > > > a customer mentioned that he got problems in accessing hist rgw > data. > > > > > I checked the bucket index and the file should be available. Then I > > > > > pulled a list with radosgw-admin radoslist --bucket BUCKET and it > > > > > seems that the file is gone. > > > > > > > > > > beside the "yaiks, is there a way the file might be somewhere else > in > > > > > ceph?" how can this happen? > > > > > > > > > > We do occational orphan objects cleanups but this does not pull the > > > > > bucket index into account. > > > > > > > > > > It is a large bucket with 2.1m files in it and with 34 shards. > > > > > > > > > > Cheers and happy weekend > > > > > Boris > > > > > > > > > > -- > > > > > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal > abweichend > > > > > im groüen Saal. > > > > > _______________________________________________ > > > > > ceph-users mailing list -- ceph-users@xxxxxxx > > > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > > > *ATTENTION : L’émetteur de ce courriel est externe à l’Université > Laval. > > > > > Évitez de cliquer sur un hyperlien, d’ouvrir une pièce jointe ou > de transmettre des informations si vous ne connaissez pas l’expéditeur du > courriel. En cas de doute, contactez l’équipe de soutien informatique de > votre unité ou hameconnage@xxxxxxxxx. > > > > > ________________________________ > > > > > > > > > _______________________________________________ > > > > ceph-users mailing list -- ceph-users@xxxxxxx > > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > > > > > > > > > > -- > > > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend > > > im groüen Saal. > > > _______________________________________________ > > > ceph-users mailing list -- ceph-users@xxxxxxx > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > > -- > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend > im groüen Saal. > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |