Re: S3 Bucket usage up 150% diference between rgw-admin and external metering tools.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Jan 21, 2020 at 05:57:51PM +0000, Robin H. Johnson wrote:
> On Mon, Jan 20, 2020 at 12:57:51PM +0000, EDH - Manuel Rios wrote:
> > Hi Cephs
> > 
> > Several nodes of our Ceph 14.2.5 are fully dedicated to host cold storage / backups information.
> > 
> > Today checking the data usage with a customer found that rgw-admin is reporting:
> ...
> > That's near 5TB used space in CEPH, and the external tools are reporting just 1.42TB.
> - What are the external tools?
> - How many objects do the external tools report as existing?
> - Do the external tools include incomplete multipart uploads in their
>   size data?
> - If bucket versioning is enabled, do the tools include all versions in the
>   size data?
> - Are there leftover multipart pieces without a multipart head?  (this
>   is a Ceph bug that I think is fixed in your release, but old pieces
>   might still exist).

This has been filed as https://tracker.ceph.com/issues/43756

It's definitely lots of leftover MPU bits, as well as inconsistency
between MPU heads/parts in the index vs RADOS objects existing:
esp. cases with leftover MPU part in RADOS+index but the rest of the MPU is gone.

-- 
Robin Hugh Johnson
Gentoo Linux: Dev, Infra Lead, Foundation Treasurer
E-Mail   : robbat2@xxxxxxxxxx
GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85
GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136

Attachment: signature.asc
Description: PGP signature

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux