Re: Incomplete pgs and no data movement ( cluster appears readonly )

["Brent Kennedy" <bkennedy@xxxxxxxxxx>]

I change “mon max pg per osd” to 5000 because when I changed it to zero, which was supposed to disable it, it caused an issue where I couldn’t create any pools.  It would say 0 was larger than the minimum.  I imagine that’s a bug, if I wanted it disabled, then it shouldn’t use the calculation.  I then set “osd max pg per osd hard ratio ” to 5 after changing “mon max pg per osd” to 5000, figuring 5*5000 would cover it.  Perhaps not.  I will adjust it to 30 and restart the OSDs.

 

-Brent

 

 

 

From: Janne Johansson [mailto:icepic.dz@xxxxxxxxx]
Sent: Wednesday, January 10, 2018 3:00 AM
To: Brent Kennedy <bkennedy@xxxxxxxxxx>
Cc: ceph-users@xxxxxxxxxxxxxx
Subject: Re: Incomplete pgs and no data movement ( cluster appears readonly )

 

 

 

2018-01-10 8:51 GMT+01:00 Brent Kennedy <bkennedy@xxxxxxxxxx>:

As per a previous thread, my pgs are set too high.  I tried adjusting the “mon max pg per osd” up higher and higher, which did clear the error(restarted monitors and managers each time), but it seems that data simply wont move around the cluster.  If I stop the primary OSD of an incomplete pg, the cluster just shows those affected pages as active+undersized+degraded:

 

I also adjusted “osd max pg per osd hard ratio ” to 5, but that didn’t seem to trigger any data moved.  I did restart the OSDs each time I changed it.  The data just wont finish moving.  “ceph –w” shows this:

2018-01-10 07:49:27.715163 osd.20 [WRN] slow request 960.675164 seconds old, received at 2018-01-10 07:33:27.039907: osd_op(client.3542508.0:4097 14.0 14.50e8d0b0 (undecoded) ondisk+write+known_if_redirected e125984) currently queued_for_pg

 

 

Did you bump the ratio so that the PGs per OSD max * hard ratio actually became more than the amount of PGs you had?

Last time you mailed the ratio was 25xx and the max was 200 which meant the ratio would have needed to be far more than 5.0.

 

 

--

May the most significant bit of your life be positive.

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com