Hi, ----- Mail original ----- > De: "Olivier DELHOMME" <olivier.delhomme at mines-paristech.fr> > ?: ceph-users at lists.ceph.com > Envoy?: Jeudi 24 Juillet 2014 21:29:40 > Objet: Re: [ceph-users] MON segfaulting when setting a crush ruleset to a pool (firefly 0.80.4) [...] I answer to myself as I found what was wrong. > > > $ ceph osd crush add-bucket rack1-pdu1 rack > > > $ ceph osd crush add-bucket rack1-pdu2 rack > > > $ ceph osd crush add-bucket rack1-pdu3 rack > > > $ ceph osd crush add-bucket rack2-pdu1 rack > > > $ ceph osd crush add-bucket rack2-pdu2 rack > > > $ ceph osd crush add-bucket rack2-pdu3 rack > > > $ ceph osd crush move ceph-osd0 rack=rack1-pdu1 > > > $ ceph osd crush move ceph-osd1 rack=rack1-pdu1 > > > $ ceph osd crush move ceph-osd2 rack=rack1-pdu1 > > > $ ceph osd crush move ceph-osd3 rack=rack1-pdu2 > > > $ ceph osd crush move ceph-osd4 rack=rack1-pdu2 > > > $ ceph osd crush move ceph-osd5 rack=rack1-pdu2 > > > $ ceph osd crush move ceph-osd6 rack=rack1-pdu3 > > > $ ceph osd crush move ceph-osd7 rack=rack1-pdu3 > > > $ ceph osd crush move ceph-osd8 rack=rack1-pdu3 > > > $ ceph osd crush move ceph-osd9 rack=rack2-pdu1 > > > $ ceph osd crush move ceph-osd10 rack=rack2-pdu1 > > > $ ceph osd crush move ceph-osd11 rack=rack2-pdu1 > > > $ ceph osd crush move ceph-osd12 rack=rack2-pdu2 > > > $ ceph osd crush move ceph-osd13 rack=rack2-pdu2 > > > $ ceph osd crush move ceph-osd14 rack=rack2-pdu2 > > > $ ceph osd crush move ceph-osd15 rack=rack2-pdu3 Here I forgot to move the rack[12]-pdu[123] to the root default tree... as you can see below : > > > $ ceph osd tree > > > # id weight type name up/down reweight > > > -23 0.91 rack rack2-pdu3 > > > -17 0.91 host ceph-osd15 > > > 15 0.91 osd.15 up 1 > > > -22 1.81 rack rack2-pdu2 > > > -14 0.45 host ceph-osd12 > > > 12 0.45 osd.12 up 1 > > > -15 0.45 host ceph-osd13 > > > 13 0.45 osd.13 up 1 > > > -16 0.91 host ceph-osd14 > > > 14 0.91 osd.14 up 1 > > > -21 1.35 rack rack2-pdu1 > > > -11 0.45 host ceph-osd9 > > > 9 0.45 osd.9 up 1 > > > -12 0.45 host ceph-osd10 > > > 10 0.45 osd.10 up 1 > > > -13 0.45 host ceph-osd11 > > > 11 0.45 osd.11 up 1 > > > -20 1.35 rack rack1-pdu3 > > > -8 0.45 host ceph-osd6 > > > 6 0.45 osd.6 up 1 > > > -9 0.45 host ceph-osd7 > > > 7 0.45 osd.7 up 1 > > > -10 0.45 host ceph-osd8 > > > 8 0.45 osd.8 up 1 > > > -19 1.35 rack rack1-pdu2 > > > -5 0.45 host ceph-osd3 > > > 3 0.45 osd.3 up 1 > > > -6 0.45 host ceph-osd4 > > > 4 0.45 osd.4 up 1 > > > -7 0.45 host ceph-osd5 > > > 5 0.45 osd.5 up 1 > > > -18 1.35 rack rack1-pdu1 > > > -2 0.45 host ceph-osd0 > > > 0 0.45 osd.0 up 1 > > > -3 0.45 host ceph-osd1 > > > 1 0.45 osd.1 up 1 > > > -4 0.45 host ceph-osd2 > > > 2 0.45 osd.2 up 1 > > > -1 0 root default Nothing is under root=default...