We have observed a very similar behavior.
In a 140 OSD cluster (new created and idle) ~8000 PGs are available.
After adding two new pools (each with 20000 PGs)
100 out of 140 OSDs are going down + out.
The cluster never recovers.
This problem can be reproduced every time with v0.67 and 0.72.
With v0.61 this problem does not show up.
-Dieter
On Thu, Mar 13, 2014 at 10:46:05AM +0100, Gandalf Corvotempesta wrote:
> 2014-03-13 9:02 GMT+01:00 Andrey Korolyov <andrey@xxxxxxx>:
> > Yes, if you have essentially high amount of commited data in the cluster
> > and/or large number of PG(tens of thousands).
>
> I've increased from 64 to 8192 PGs
>
> > If you have a room to
> > experiment with this transition from scratch you may want to play with
> > numbers in the OSD` queues since they causing deadlock-like behaviour on
> > operations like increasing PG count or large pool deletion. If cluster
> > has no I/O at all at the moment, such behaviour is not expected definitely.
>
> My cluster was totally idle, it's a test with ceph-ansible repository and nobody
> was using it.
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
