Hi Fyodor, The problem is your rules: On Sun, 29 May 2011, Fyodor Ustinov wrote: > # rules > rule data { > ruleset 0 > type replicated > min_size 1 > max_size 10 > step take root > step choose firstn 0 type rack This is giving you N _racks_. You probably want step chooseleaf firstn 0 type rack which will give you N devices from distinct racks. BTW, you can verify that the map is behaving with something like $ crushtool -i crushfile --test devices weights (hex): [10000,10000,10000,10000,10000,10000,10000,10000,10000,10000,10000] rule 0 (data), x = 0..9999 device 0: 2391 device 1: 2446 device 2: 2338 device 3: 2332 device 4: 2360 device 5: 2450 device 6: 0 device 7: 1368 device 8: 1460 device 9: 1446 device 10: 1409 num results 2: 10000 rule 1 (metadata), x = 0..9999 device 0: 2391 device 1: 2446 device 2: 2338 device 3: 2332 device 4: 2360 device 5: 2450 device 6: 0 device 7: 1368 device 8: 1460 device 9: 1446 device 10: 1409 num results 2: 10000 rule 2 (rbd), x = 0..9999 device 0: 2391 device 1: 2446 device 2: 2338 device 3: 2332 device 4: 2360 device 5: 2450 device 6: 0 device 7: 1368 device 8: 1460 device 9: 1446 device 10: 1409 num results 2: 10000 (That's with 'choose' changed to 'chooseleaf'. Your current map gives 0 objects on every device.) Cheers- sage -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html