All of the stuck pgs are in pool 2. My guess is that that pool is referncing a broken crush rule. Your CRUSH map has min and max_size of 3 for all of the rules; it should be min 1 and max 10. Probably the RBD pool is set to 3 replicas, which means it matches no existing CRUSH rule and you get no OSDs. You can fix the CRUSH rules (that is a good idea anyway), or also change the pool 2 (rbd) to 3x replication: ceph osd pool set rbd size 3 sage On Mon, 4 Feb 2013, Yasuhiro Ohara wrote: > > Umm, I mean, my system stuck like: > > health HEALTH_WARN 1088 pgs stuck inactive; 1088 pgs stuck unclean > monmap e1: 5 mons at {0=128.114.52.59:6789/0,1=128.114.52.67:6789/0,2=128.114.52.68:6789/0,3=128.114.52.69:6789/0,4=128.114.52.70:6789/0}, election epoch 72, quorum 0,1,2,3,4 0,1,2,3,4 > osdmap e295: 16 osds: 16 up, 16 in > pgmap v83184: 3264 pgs: 1088 creating, 2176 active+clean; 672 GB data, 2042 GB used, 5107 GB / 7452 GB avail > mdsmap e20: 1/1/1 up {0=1=up:active}, 4 up:standby > > and I am asking how to bring it to HEALTHY state. > > regards, > Yasu > > From: Yasuhiro Ohara <yasu@xxxxxxxxxxxx> > Subject: Trigger to create PGs ? > Date: Mon, 04 Feb 2013 14:50:38 -0800 (PST) > Message-ID: <20130204.145038.210467743.yasu@xxxxxxxxxxxx> > > > > > Hi, > > > > I happened to have an incorrect crush map in the start-up of > > my system, but even after fixing it manually, the PGs do not > > seem to be created properly. Is there any way to trigger the > > system to start creating the PGs again ? > > > > Here's my configurations: > > ceph.conf: http://pastebin.com/EwwdQrf9 > > crush map: http://pastebin.com/UYNFvvQx > > ceph osd tree: http://pastebin.com/u2Z4Hppn > > ceph pg dump: http://pastebin.com/JfE146WJ > > > > FYI, in the first, I had mistakenly osd.0 in all host clauses. > > > > regards, > > Yasu > > > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html > > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html