Hi, On 17/07/18 01:29, Brad Hubbard wrote: > Your issue is different since not only do the omap digests of all > replicas not match the omap digest from the auth object info but they > are all different to each other. > > What is min_size of pool 67 and what can you tell us about the events > leading up to this? min_size is 2 ; pool 67 is default.rgw.buckets.index. This is a moderately-large (3060 OSD) cluster that's been running for a while; we upgraded to 10.2.9 (from 10.2.6, also from Ubuntu) about a week ago. >> rados -p default.rgw.buckets.index setomapval >> .dir.861ae926-7ff0-48c5-86d6-a6ba8d0a7a14.7130858.6 temporary-key anything >> [deep-scrub] >> rados -p default.rgw.buckets.index rmomapkey >> .dir.861ae926-7ff0-48c5-86d6-a6ba8d0a7a14.7130858.6 temporary-key We did this, and it does appear to have resolved the issue (the pg is now happy). Regards, Matthew -- The Wellcome Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com