Hi Paul,
Are these non-current versioned objects displayed in the bucket stats?
Also, the LC rule applied to the bucket can only delete/expire objects for
a normal bucket.
In the case of a versioned bucket, the LC rule applied will expire the
current version [create a delete-marker for every object and move the
object version from current to non-current, thereby reflecting the same
number of objects in bucket stats output ].
Vidushi
On Mon, Jul 26, 2021 at 4:55 PM Paul JURCO <paul.jurco@xxxxxxxxx> wrote:
> Hi!
> I need some help understanding LC processing.
> On latest versions of octopus installed (tested with 15.2.13 and 15.2.8) we
> have at least one bucket which is not having the files removed when
> expiring.
> The size of the bucket reported with radosgw-admin compared with the one
> obtained with s3cmd is different, logs below:
> ~3 TB in bucket stats and 11GB from s3cmd.
> We tried to run manually several times the LC (lc process) but no success,
> even with bucket check (including with --fix --check-objects) didn't help.
> Configs changed are below, we have a few TB size buckets with millions of
> objects, 6h default processing LC time was always not enough:
> rgw_lc_debug_interval = 28800
> rgw_lifecycle_work_time = 00:00-23:59
> rgw_lc_max_worker = 5
> rgw_lc_max_wp_worker = 9
> rgw_enable_lc_threads = true
>
> Status of LC is always complete:
> {
> "bucket":
>
> ":feeds-bucket-dev-dc418787:3ccb869f-b0f4-4fb9-a8d7-ecf5f5e18f33.37270170.140",
> "started": "Mon, 26 Jul 2021 07:10:14 GMT",
> "status": "COMPLETE"
> },
> It looks like versioning is not supported yet, and with aws-cli I did not
> get any response for 's3api get-bucket-versioning'.
> So, what to do?
>
> $ s3cmd -c .s3cfg-feeds-bucket-dev-dc418787 du
> s3://feeds-bucket-dev-dc418787
> *12725854360 *192 objects s3://feeds-bucket-dev-dc418787/
> (192 files, 11GB)
>
> Output of 'radosgw-admin lc get' and 'bucket stats' is attached.
> Thank you for any suggestion!
>
> Also, we found that the LC is removing files earlier than set for another
> bucket, 6h after the file was added instead of 31 days.
>
> Paul
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
