Re: Files listed in radosgw BI but is not available in ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Is it possible to not complete a file upload so the actual file is not
there, but it is listed in the bucket index?

I really need help with this issue.

Am Fr., 16. Juli 2021 um 19:35 Uhr schrieb Boris Behrens <bb@xxxxxxxxx>:
>
> exactly.
> rados rm wouldn't remove it from the "radosgw-admin bucket radoslist"
> list, correct?
>
> our usage statistics are not really usable because it fluctuates in a
> 200tb range.
>
> I also hope that I find the files in the "rados ls" list, but I don't
> have much hope.
>
> For me it is key to understand how this happeneds and how I can verify
> the integrity of all buckets.
> Dataloss is the worst kind of problem for me.
>
> Am Fr., 16. Juli 2021 um 19:21 Uhr schrieb Jean-Sebastien Landry
> <Jean-Sebastien.Landry.6@xxxxxxxxx>:
> >
> > Ok, so everything looks normal from the sysadmin "bi list" & the
> > customer "s3cmd ls" views, except that the GET give a 404 NoSuchKey?
> >
> >  > Is there way to remove a file from a bucket without removing it from
> > the bucketindex?
> >
> > using rados rm probably, but from the customer ends, I hope not.
> >
> > Do you have any usage stats that can confirm that the data has been
> > deleted and/or are still there. (at the pool level maybe?)
> > Hopping for you that it's just a data/index/shard mismatch...
> >
> >
> > On 7/16/21 12:44 PM, Boris Behrens wrote:
> > > [Externe UL*]
> > >
> > > Hi Jean-Sebastien,
> > >
> > > I have the exact opposite. Files can be listed (the are in the bucket
> > > index), but are not available anymore.
> > >
> > > Am Fr., 16. Juli 2021 um 18:41 Uhr schrieb Jean-Sebastien Landry
> > > <Jean-Sebastien.Landry.6@xxxxxxxxx>:
> > >> Hi Boris, I don't have any answer for you, but I have situation similar
> > >> to yours.
> > >>
> > >> https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/message/7E6O6ILGE5JCI4ISU66HZ6ZVZP6N6T3M/
> > >>
> > >> I didn't try radoslist, I should have.
> > >>
> > >> Is this new, or it just that the client realised this lately?
> > >> All the data seems missing or just some paths?
> > >> Did you reshard lately?
> > >> Did you test using client programs like s3cmd & rclone...?
> > >>
> > >> I didn't have time to work on that this week, but I have to find a
> > >> solution too.
> > >> Meanwhile, I run with a lower shard number and my customer can access
> > >> all his data.
> > >> Cheers!
> > >>
> > >> On 7/16/21 11:36 AM, Boris Behrens wrote:
> > >>> [Externe UL*]
> > >>>
> > >>> Hi everybody,
> > >>> a customer mentioned that he got problems in accessing hist rgw data.
> > >>> I checked the bucket index and the file should be available. Then I
> > >>> pulled a list with radosgw-admin radoslist --bucket BUCKET and it
> > >>> seems that the file is gone.
> > >>>
> > >>> beside the "yaiks, is there a way the file might be somewhere else in
> > >>> ceph?" how can this happen?
> > >>>
> > >>> We do occational orphan objects cleanups but this does not pull the
> > >>> bucket index into account.
> > >>>
> > >>> It is a large bucket with 2.1m files in it and with 34 shards.
> > >>>
> > >>> Cheers and happy weekend
> > >>>    Boris
> > >>>
> > >>> --
> > >>> Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
> > >>> im groüen Saal.
> > >>> _______________________________________________
> > >>> ceph-users mailing list -- ceph-users@xxxxxxx
> > >>> To unsubscribe send an email to ceph-users-leave@xxxxxxx
> > >>> ________________________________
> > >>>
> > >> _______________________________________________
> > >> ceph-users mailing list -- ceph-users@xxxxxxx
> > >> To unsubscribe send an email to ceph-users-leave@xxxxxxx
> > >
> > >
> > > --
> > > Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
> > > im groüen Saal.
> > > _______________________________________________
> > > ceph-users mailing list -- ceph-users@xxxxxxx
> > > To unsubscribe send an email to ceph-users-leave@xxxxxxx
> > > ________________________________
> > >
> > _______________________________________________
> > ceph-users mailing list -- ceph-users@xxxxxxx
> > To unsubscribe send an email to ceph-users-leave@xxxxxxx
>
>
>
> --
> Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
> im groüen Saal.



-- 
Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend
im groüen Saal.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux