Yeah, your CRUSH rule says to separate replicas across hosts. You have only one host. You can add another host and the PGs will go clean. Or, you can change your CRUSH rule to separate across osds (not hosts) with ceph osd crush rule create-simple myrule default osd This should get crush ruleset 3; to confirm, ceph osd crush dump Then set your pools to use it with ceph osd pool set data crush_ruleset 3 ceph osd pool set metadata crush_ruleset 3 ceph osd pool set rbd crush_ruleset 3 Just remember to switch back to replicating across hosts when your cluster grows! sage On Wed, 28 Aug 2013, Johannes Klarenbeek wrote: > > Well, no. Thank you! J Lots of hard work went in this product and we are all > just using it for free. Thank you really!? ok here it is: > > > > { "devices": [ > > { "id": 0, > > "name": "osd.0"}, > > { "id": 1, > > "name": "osd.1"}, > > { "id": 2, > > "name": "osd.2"}, > > { "id": 3, > > "name": "osd.3"}, > > { "id": 4, > > "name": "osd.4"}, > > { "id": 5, > > "name": "osd.5"}], > > "types": [ > > { "type_id": 0, > > "name": "osd"}, > > { "type_id": 1, > > "name": "host"}, > > { "type_id": 2, > > "name": "rack"}, > > { "type_id": 3, > > "name": "row"}, > > { "type_id": 4, > > "name": "room"}, > > { "type_id": 5, > > "name": "datacenter"}, > > { "type_id": 6, > > "name": "root"}], > > "buckets": [ > > { "id": -1, > > "name": "default", > > "type_id": 6, > > "type_name": "root", > > "weight": 715650, > > "alg": "straw", > > "hash": "rjenkins1", > > "items": [ > > { "id": -2, > > "weight": 715650, > > "pos": 0}]}, > > { "id": -2, > > "name": "ceph-r1n2", > > "type_id": 1, > > "type_name": "host", > > "weight": 715650, > > "alg": "straw", > > "hash": "rjenkins1", > > "items": [ > > { "id": 0, > > "weight": 119275, > > "pos": 0}, > > { "id": 1, > > "weight": 119275, > > "pos": 1}, > > { "id": 2, > > "weight": 119275, > > "pos": 2}, > > { "id": 3, > > "weight": 119275, > > "pos": 3}, > > { "id": 4, > > "weight": 119275, > > "pos": 4}, > > { "id": 5, > > "weight": 119275, > > "pos": 5}]}], > > "rules": [ > > { "rule_id": 0, > > "rule_name": "data", > > "ruleset": 0, > > "type": 1, > > "min_size": 1, > > "max_size": 10, > > "steps": [ > > { "op": "take", > > "item": -1}, > > { "op": "chooseleaf_firstn", > > "num": 0, > > "type": "host"}, > > { "op": "emit"}]}, > > { "rule_id": 1, > > "rule_name": "metadata", > > "ruleset": 1, > > "type": 1, > > "min_size": 1, > > "max_size": 10, > > "steps": [ > > { "op": "take", > > "item": -1}, > > { "op": "chooseleaf_firstn", > > "num": 0, > > "type": "host"}, > > { "op": "emit"}]}, > > { "rule_id": 2, > > "rule_name": "rbd", > > "ruleset": 2, > > "type": 1, > > "min_size": 1, > > "max_size": 10, > > "steps": [ > > { "op": "take", > > "item": -1}, > > { "op": "chooseleaf_firstn", > > "num": 0, > > "type": "host"}, > > { "op": "emit"}]}], > > "tunables": { "choose_local_tries": 2, > > "choose_local_fallback_tries": 5, > > "choose_total_tries": 19, > > "chooseleaf_descend_once": 0}} > > > > > > __________ Informatie van ESET Endpoint Antivirus, versie van database > viruskenmerken 8737 (20130828) __________ > > Het bericht is gecontroleerd door ESET Endpoint Antivirus. > > http://www.eset.com > > >
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com