Re: Files listed in radosgw BI but is not available in ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Dan,
unfortunally there are no versioned objects in the bucket. All objects
are type plain.
I will create a bug ticket.

Am Mo., 19. Juli 2021 um 18:35 Uhr schrieb Dan van der Ster
<dan@xxxxxxxxxxxxxx>:
>
> Here's a recipe, from the when I had the same question:
>
>
> " Re: rgw index shard much larger than others - ceph-users - lists.ceph.io" https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/MO7IHRGJ7TGPKT3GXCKMFLR674G3YGUX/
>
> On Mon, 19 Jul 2021, 18:00 Boris Behrens, <bb@xxxxxxxxx> wrote:
>>
>> Hi Dan,
>> how do I find out if a bucket got versioning enabled?
>>
>> Am Mo., 19. Juli 2021 um 17:00 Uhr schrieb Dan van der Ster
>> <dan@xxxxxxxxxxxxxx>:
>> >
>> > Hi Boris,
>> >
>> > Does the bucket have object versioning enabled?
>> > We saw something like this once a while ago: `s3cmd ls` showed an
>> > entry for an object, but when we tried to get it we had 404.
>> > We didn't find a good explanation in the end -- our user was able to
>> > re-upload the object and it didn't recur so we didn't debug further.
>> >
>> > I suggest you open a ticket in the tracker with all the evidence so
>> > the developers can help diagnose the problem.
>> >
>> > Cheers, Dan
>> >
>> >
>> > On Fri, Jul 16, 2021 at 6:45 PM Boris Behrens <bb@xxxxxxxxx> wrote:
>> > >
>> > > Hi Jean-Sebastien,
>> > >
>> > > I have the exact opposite. Files can be listed (the are in the bucket
>> > > index), but are not available anymore.
>> > >
>> > > Am Fr., 16. Juli 2021 um 18:41 Uhr schrieb Jean-Sebastien Landry
>> > > <Jean-Sebastien.Landry.6@xxxxxxxxx>:
>> > > >
>> > > > Hi Boris, I don't have any answer for you, but I have situation similar
>> > > > to yours.
>> > > >
>> > > > https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/7E6O6ILGE5JCI4ISU66HZ6ZVZP6N6T3M/
>> > > >
>> > > > I didn't try radoslist, I should have.
>> > > >
>> > > > Is this new, or it just that the client realised this lately?
>> > > > All the data seems missing or just some paths?
>> > > > Did you reshard lately?
>> > > > Did you test using client programs like s3cmd & rclone...?
>> > > >
>> > > > I didn't have time to work on that this week, but I have to find a
>> > > > solution too.
>> > > > Meanwhile, I run with a lower shard number and my customer can access
>> > > > all his data.
>> > > > Cheers!
>> > > >
>> > > > On 7/16/21 11:36 AM, Boris Behrens wrote:
>> > > > > [Externe UL*]
>> > > > >
>> > > > > Hi everybody,
>> > > > > a customer mentioned that he got problems in accessing hist rgw data.
>> > > > > I checked the bucket index and the file should be available. Then I
>> > > > > pulled a list with radosgw-admin radoslist --bucket BUCKET and it
>> > > > > seems that the file is gone.
>> > > > >
>> > > > > beside the "yaiks, is there a way the file might be somewhere else in
>> > > > > ceph?" how can this happen?
>> > > > >
>> > > > > We do occational orphan objects cleanups but this does not pull the
>> > > > > bucket index into account.
>> > > > >
>> > > > > It is a large bucket with 2.1m files in it and with 34 shards.
>> > > > >
>> > > > > Cheers and happy weekend
>> > > > >   Boris
>> > > > >
>> > > > > --
>> > > > > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
>> > > > > im groüen Saal.
>> > > > > _______________________________________________
>> > > > > ceph-users mailing list -- ceph-users@xxxxxxx
>> > > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx
>> > > > > *ATTENTION : L’émetteur de ce courriel est externe à l’Université Laval.
>> > > > > Évitez de cliquer sur un hyperlien, d’ouvrir une pièce jointe ou de transmettre des informations si vous ne connaissez pas l’expéditeur du courriel. En cas de doute, contactez l’équipe de soutien informatique de votre unité ou hameconnage@xxxxxxxxx.
>> > > > > ________________________________
>> > > > >
>> > > > _______________________________________________
>> > > > ceph-users mailing list -- ceph-users@xxxxxxx
>> > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx
>> > >
>> > >
>> > >
>> > > --
>> > > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
>> > > im groüen Saal.
>> > > _______________________________________________
>> > > ceph-users mailing list -- ceph-users@xxxxxxx
>> > > To unsubscribe send an email to ceph-users-leave@xxxxxxx
>>
>>
>>
>> --
>> Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
>> im groüen Saal.



-- 
Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
im groüen Saal.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux