Rados bucket issues, default.rgw.buckets.index growing every day

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

I have some issues with my bucket index. As you can see in the
attachment, everyday around 16:30, the amount of objects in the
default.rgw.buckets.index increases. This happens since upgrading from
12.2.2 to 12.2.4.

There is no real activity at that moment, but the logs do show the
following:

rgw.log.1.gz:2018-04-03 16:28:24.594527 7fad2e13d700  0
check_bucket_shards: resharding needed:
stats.num_objects=18446744073709551539 shard max_objects=100000
rgw.log.2.gz:2018-04-02 16:28:19.100159 7fad2e13d700  0
check_bucket_shards: resharding needed:
stats.num_objects=18446744073709551539 shard max_objects=100000
rgw.log.3.gz:2018-04-01 16:28:09.051291 7fad2e13d700  0
check_bucket_shards: resharding needed:
stats.num_objects=18446744073709551539 shard max_objects=100000
rgw.log.4.gz:2018-03-31 16:27:59.205853 7fad2e13d700  0
check_bucket_shards: resharding needed:
stats.num_objects=18446744073709551539 shard max_objects=100000
rgw.log.5.gz:2018-03-30 16:27:42.812917 7fad2e13d700  0
check_bucket_shards: resharding needed:
stats.num_objects=18446744073709551539 shard max_objects=100000
rgw.log.6.gz:2018-03-29 16:26:51.298205 7fad2e13d700  0
check_bucket_shards: resharding needed:
stats.num_objects=18446744073709551539 shard max_objects=100000
rgw.log.7.gz:2018-03-28 06:25:24.250243 7f646026a700  0
check_bucket_shards: resharding needed: stats.num_objects=134612 shard
max_objects=100000
rgw.log.7.gz:2018-03-28 16:26:45.095042 7fad2e13d700  0
check_bucket_shards: resharding needed:
stats.num_objects=18446744073709551539 shard max_objects=100000


I have dynamic bucketsharding enabled, and there is a reshard entry,
but because I use tenant and rados had a bug where it didn't add tenant
to the reshard-log, that entry is invalid. The bucket it mentions
doesn't even exist anymore.

So. How do I find out who is creating all these entries in the index,
and why. Secondly, how do I remove the reshardingentry for a bucket
that does not exist? I have a strong feeling that the two questions are
very much related, because of https://tracker.ceph.com/issues/22046

Thanks,

Mark

-- 
Kerio Operator in de Cloud? https://www.kerioindecloud.nl/
Mark Schouten  | Tuxis Internet Engineering
KvK: 61527076  | http://www.tuxis.nl/
T: 0318 200208 | info@xxxxxxxx

Attachment: index_pool_objects.png
Description: PNG image

Attachment: smime.p7s
Description: S/MIME cryptographic signature

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux