I think the warning is triggered by the mgr daemon and not the mon, try setting it there Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 On Tue, Apr 16, 2019 at 8:18 PM Sergei Genchev <sgenchev@xxxxxxxxx> wrote: > > Hi, > I am getting a health warning about many more objects for PG than > average. Seems to be common with RadosGW, where pools other than data > contain very small number of objects. > > ceph@ola-s3-stg:/etc/ceph$ ceph health detail > HEALTH_WARN 1 pools have many more objects per pg than average > MANY_OBJECTS_PER_PG 1 pools have many more objects per pg than average > pool s3dev.rgw.buckets.data objects per pg (22675) is more than > 84.2937 times cluster average (269) > > According to documentation, I should be able to quiet this warning by > setting mon_pg_warn_max_object_skew. > I did try to set this settings to both 0 and 10000 (docs are unclear > about 0 value), but I cannot make this warning disappear. > > ceph@ola-s3-stg:/etc/ceph$ ceph tell mon.* injectargs > '--mon_pg_warn_max_object_skew 0' > mon.olaxsa-cephmon00: injectargs: > mon.olaxsa-cephmon01: injectargs: > mon.olaxsa-cephmon02: injectargs: > ceph@ola-s3-stg:/etc/ceph$ ceph health > HEALTH_WARN 1 pools have many more objects per pg than average > ceph@ola-s3-stg:/etc/ceph$ ceph tell mon.* injectargs > '--mon_pg_warn_max_object_skew 100000' > mon.olaxsa-cephmon00: injectargs: > mon.olaxsa-cephmon01: injectargs: > mon.olaxsa-cephmon02: injectargs: > ceph@ola-s3-stg:/etc/ceph$ ceph health > HEALTH_WARN 1 pools have many more objects per pg than average > > I have also tried to set these values in cepf.conf and restart > monitors, but warning is still there > [global] > ..... > mon pg warn max object skew = 10000 > mon pg warn max object skew = 0 > > Where should I look next? > > Thank you! > > ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable) > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com