I found the problem :-) no weight on any osd (in ceph osd tree) I just had to reweight the osd! ----- Mail original ----- De: "Nicolas Zin" <nicolas.zin@xxxxxxxxxxxxxxxxxxxx> À: ceph-users@xxxxxxxxxxxxxx Envoyé: Mercredi 14 Janvier 2015 10:41:00 Objet: problem deploying ceph on a 3 node test lab : active+degraded Hi, I have 3 VM running Ubuntu 14.04. I followed mainly the http://ceph.com/docs/master/rados/deployment/ceph-deploy-install document to deploy on a 3 VM nodes. First I thought that he didn't like to have to NIC card (one for public, one for storage). Now I switch to a only one NIC platform. I never manage to reach a HEALTH state. But I cannot have a healthy ceph installation, it says "HEALTH_WARN 192 pgs degraded; 192 pgs stuck unclean" I'm stuck since one day, trying to understand what is going on. Can someone enlight me? (monitors works like a charm) root@ceph1:~# cat /etc/ceph/ceph.conf [global] fsid = b5543e57-489b-4eec-9a92-148d4e7b6a82 mon_initial_members = ceph1, ceph2, ceph3 mon_host = 192.168.48.230,192.168.49.10,192.168.48.237 auth_cluster_required = cephx auth_service_required = cephx auth_client_required = cephx filestore_xattr_use_omap = true public_network = 192.168.48.0/22 #cluster_network = 192.168.100.0/24 osd_journal_size = 512 root@ceph1:~# ceph -w cluster b5543e57-489b-4eec-9a92-148d4e7b6a82 health HEALTH_WARN 192 pgs degraded; 192 pgs stuck unclean monmap e2: 3 mons at {ceph1=192.168.48.230:6789/0,ceph2=192.168.49.10:6789/ 0,ceph3=192.168.48.237:6789/0}, election epoch 28, quorum 0,1,2 ceph1,ceph3,ceph 2 osdmap e62: 3 osds: 3 up, 3 in pgmap v148: 192 pgs, 3 pools, 0 bytes data, 0 objects 101 MB used, 11771 MB / 11873 MB avail 192 active+degraded root@ceph1:~# ceph health detail HEALTH_WARN 192 pgs degraded; 192 pgs stuck unclean pg 1.2c is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.2d is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.2f is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.2d is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.2c is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.2e is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.2a is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.2b is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.29 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.2a is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.28 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.2b is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.2b is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.29 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.28 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.2a is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.28 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.29 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.25 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.27 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.26 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.27 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.24 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.26 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.24 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.25 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.27 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.25 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.24 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.26 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.22 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.23 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.21 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.23 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.22 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.20 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.20 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.21 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.23 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.21 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.20 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.22 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.1e is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.1f is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.1d is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.1e is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.1c is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.1f is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.1f is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.1d is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.1c is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.1e is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.1c is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.1d is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.19 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.1b is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.1a is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.18 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.1a is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.1b is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.1b is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.19 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.18 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.1a is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.18 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.19 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.15 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.17 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.16 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.14 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.16 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.17 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.17 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.15 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.14 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.16 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.14 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.15 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.11 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.13 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.12 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.10 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.12 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.13 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.13 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.11 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.10 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.12 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.10 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.11 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.d is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.e is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.f is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.c is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.f is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.e is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.d is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.c is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.f is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.c is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.d is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.e is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.b is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.a is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.9 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.a is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.b is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.8 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.9 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.8 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.b is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.8 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.9 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.a is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.7 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.6 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.5 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.6 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.7 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.4 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.5 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.4 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.7 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.4 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.5 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.6 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.2 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.3 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.1 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.2 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.3 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.0 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.0 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.1 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.3 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.1 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.0 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.2 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.3f is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.3e is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.3d is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.3e is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.3f is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.3c is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.3d is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.3c is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.3f is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.3c is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.3d is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.3e is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.3b is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.3a is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.39 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.3a is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.3b is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.38 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.39 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.38 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.3b is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.38 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.39 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.3a is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.37 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.36 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.35 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.36 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.37 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.34 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.35 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.34 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.37 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.34 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.35 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.36 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.33 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.32 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.31 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.32 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.33 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.30 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.31 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.30 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.33 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.30 is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.31 is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.32 is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.2f is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.2e is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.2d is stuck unclean since forever, current state active+degraded, last acting [0] pg 0.2e is stuck unclean since forever, current state active+degraded, last acting [0] pg 1.2f is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.2c is stuck unclean since forever, current state active+degraded, last acting [0] pg 2.2f is active+degraded, acting [0] pg 0.2d is active+degraded, acting [0] pg 1.2c is active+degraded, acting [0] pg 2.2e is active+degraded, acting [0] pg 0.2c is active+degraded, acting [0] pg 1.2d is active+degraded, acting [0] pg 2.29 is active+degraded, acting [0] pg 0.2b is active+degraded, acting [0] pg 1.2a is active+degraded, acting [0] pg 2.28 is active+degraded, acting [0] pg 0.2a is active+degraded, acting [0] pg 1.2b is active+degraded, acting [0] pg 2.2b is active+degraded, acting [0] pg 0.29 is active+degraded, acting [0] pg 1.28 is active+degraded, acting [0] pg 2.2a is active+degraded, acting [0] pg 0.28 is active+degraded, acting [0] pg 1.29 is active+degraded, acting [0] pg 2.25 is active+degraded, acting [0] pg 0.27 is active+degraded, acting [0] pg 1.26 is active+degraded, acting [0] pg 2.24 is active+degraded, acting [0] pg 0.26 is active+degraded, acting [0] pg 1.27 is active+degraded, acting [0] pg 2.27 is active+degraded, acting [0] pg 0.25 is active+degraded, acting [0] pg 1.24 is active+degraded, acting [0] pg 2.26 is active+degraded, acting [0] pg 0.24 is active+degraded, acting [0] pg 1.25 is active+degraded, acting [0] pg 2.21 is active+degraded, acting [0] pg 0.23 is active+degraded, acting [0] pg 1.22 is active+degraded, acting [0] pg 2.20 is active+degraded, acting [0] pg 0.22 is active+degraded, acting [0] pg 1.23 is active+degraded, acting [0] pg 2.23 is active+degraded, acting [0] pg 0.21 is active+degraded, acting [0] pg 1.20 is active+degraded, acting [0] pg 2.22 is active+degraded, acting [0] pg 0.20 is active+degraded, acting [0] pg 1.21 is active+degraded, acting [0] pg 2.1d is active+degraded, acting [0] pg 0.1f is active+degraded, acting [0] pg 1.1e is active+degraded, acting [0] pg 2.1c is active+degraded, acting [0] pg 0.1e is active+degraded, acting [0] pg 1.1f is active+degraded, acting [0] pg 2.1f is active+degraded, acting [0] pg 0.1d is active+degraded, acting [0] pg 1.1c is active+degraded, acting [0] pg 2.1e is active+degraded, acting [0] pg 0.1c is active+degraded, acting [0] pg 1.1d is active+degraded, acting [0] pg 2.19 is active+degraded, acting [0] pg 0.1b is active+degraded, acting [0] pg 1.1a is active+degraded, acting [0] pg 2.18 is active+degraded, acting [0] pg 0.1a is active+degraded, acting [0] pg 1.1b is active+degraded, acting [0] pg 2.1b is active+degraded, acting [0] pg 0.19 is active+degraded, acting [0] pg 1.18 is active+degraded, acting [0] pg 2.1a is active+degraded, acting [0] pg 0.18 is active+degraded, acting [0] pg 1.19 is active+degraded, acting [0] pg 2.15 is active+degraded, acting [0] pg 0.17 is active+degraded, acting [0] pg 1.16 is active+degraded, acting [0] pg 2.14 is active+degraded, acting [0] pg 0.16 is active+degraded, acting [0] pg 1.17 is active+degraded, acting [0] pg 2.17 is active+degraded, acting [0] pg 0.15 is active+degraded, acting [0] pg 1.14 is active+degraded, acting [0] pg 2.16 is active+degraded, acting [0] pg 0.14 is active+degraded, acting [0] pg 1.15 is active+degraded, acting [0] pg 2.11 is active+degraded, acting [0] pg 0.13 is active+degraded, acting [0] pg 1.12 is active+degraded, acting [0] pg 2.10 is active+degraded, acting [0] pg 0.12 is active+degraded, acting [0] pg 1.13 is active+degraded, acting [0] pg 2.13 is active+degraded, acting [0] pg 0.11 is active+degraded, acting [0] pg 1.10 is active+degraded, acting [0] pg 2.12 is active+degraded, acting [0] pg 0.10 is active+degraded, acting [0] pg 1.11 is active+degraded, acting [0] pg 2.d is active+degraded, acting [0] pg 1.e is active+degraded, acting [0] pg 0.f is active+degraded, acting [0] pg 2.c is active+degraded, acting [0] pg 1.f is active+degraded, acting [0] pg 0.e is active+degraded, acting [0] pg 2.f is active+degraded, acting [0] pg 1.c is active+degraded, acting [0] pg 0.d is active+degraded, acting [0] pg 2.e is active+degraded, acting [0] pg 1.d is active+degraded, acting [0] pg 0.c is active+degraded, acting [0] pg 2.9 is active+degraded, acting [0] pg 1.a is active+degraded, acting [0] pg 0.b is active+degraded, acting [0] pg 2.8 is active+degraded, acting [0] pg 1.b is active+degraded, acting [0] pg 0.a is active+degraded, acting [0] pg 2.b is active+degraded, acting [0] pg 1.8 is active+degraded, acting [0] pg 0.9 is active+degraded, acting [0] pg 2.a is active+degraded, acting [0] pg 1.9 is active+degraded, acting [0] pg 0.8 is active+degraded, acting [0] pg 2.5 is active+degraded, acting [0] pg 1.6 is active+degraded, acting [0] pg 0.7 is active+degraded, acting [0] pg 2.4 is active+degraded, acting [0] pg 1.7 is active+degraded, acting [0] pg 0.6 is active+degraded, acting [0] pg 2.7 is active+degraded, acting [0] pg 1.4 is active+degraded, acting [0] pg 0.5 is active+degraded, acting [0] pg 2.6 is active+degraded, acting [0] pg 1.5 is active+degraded, acting [0] pg 0.4 is active+degraded, acting [0] pg 2.1 is active+degraded, acting [0] pg 0.3 is active+degraded, acting [0] pg 1.2 is active+degraded, acting [0] pg 2.0 is active+degraded, acting [0] pg 1.3 is active+degraded, acting [0] pg 0.2 is active+degraded, acting [0] pg 2.3 is active+degraded, acting [0] pg 0.1 is active+degraded, acting [0] pg 1.0 is active+degraded, acting [0] pg 2.2 is active+degraded, acting [0] pg 0.0 is active+degraded, acting [0] pg 1.1 is active+degraded, acting [0] pg 2.3d is active+degraded, acting [0] pg 1.3e is active+degraded, acting [0] pg 0.3f is active+degraded, acting [0] pg 2.3c is active+degraded, acting [0] pg 1.3f is active+degraded, acting [0] pg 0.3e is active+degraded, acting [0] pg 2.3f is active+degraded, acting [0] pg 1.3c is active+degraded, acting [0] pg 0.3d is active+degraded, acting [0] pg 2.3e is active+degraded, acting [0] pg 1.3d is active+degraded, acting [0] pg 0.3c is active+degraded, acting [0] pg 2.39 is active+degraded, acting [0] pg 1.3a is active+degraded, acting [0] pg 0.3b is active+degraded, acting [0] pg 2.38 is active+degraded, acting [0] pg 1.3b is active+degraded, acting [0] pg 0.3a is active+degraded, acting [0] pg 2.3b is active+degraded, acting [0] pg 1.38 is active+degraded, acting [0] pg 0.39 is active+degraded, acting [0] pg 2.3a is active+degraded, acting [0] pg 1.39 is active+degraded, acting [0] pg 0.38 is active+degraded, acting [0] pg 2.35 is active+degraded, acting [0] pg 1.36 is active+degraded, acting [0] pg 0.37 is active+degraded, acting [0] pg 2.34 is active+degraded, acting [0] pg 1.37 is active+degraded, acting [0] pg 0.36 is active+degraded, acting [0] pg 2.37 is active+degraded, acting [0] pg 1.34 is active+degraded, acting [0] pg 0.35 is active+degraded, acting [0] pg 2.36 is active+degraded, acting [0] pg 1.35 is active+degraded, acting [0] pg 0.34 is active+degraded, acting [0] pg 2.31 is active+degraded, acting [0] pg 1.32 is active+degraded, acting [0] pg 0.33 is active+degraded, acting [0] pg 2.30 is active+degraded, acting [0] pg 1.33 is active+degraded, acting [0] pg 0.32 is active+degraded, acting [0] pg 2.33 is active+degraded, acting [0] pg 1.30 is active+degraded, acting [0] pg 0.31 is active+degraded, acting [0] pg 2.32 is active+degraded, acting [0] pg 1.31 is active+degraded, acting [0] pg 0.30 is active+degraded, acting [0] pg 2.2d is active+degraded, acting [0] pg 1.2e is active+degraded, acting [0] pg 0.2f is active+degraded, acting [0] pg 2.2c is active+degraded, acting [0] pg 1.2f is active+degraded, acting [0] pg 0.2e is active+degraded, acting [0] root@ceph1:~# ceph osd crush dump --format=json-pretty { "devices": [ { "id": 0, "name": "osd.0"}, { "id": 1, "name": "osd.1"}, { "id": 2, "name": "osd.2"}], "types": [ { "type_id": 0, "name": "osd"}, { "type_id": 1, "name": "host"}, { "type_id": 2, "name": "chassis"}, { "type_id": 3, "name": "rack"}, { "type_id": 4, "name": "row"}, { "type_id": 5, "name": "pdu"}, { "type_id": 6, "name": "pod"}, { "type_id": 7, "name": "room"}, { "type_id": 8, "name": "datacenter"}, { "type_id": 9, "name": "region"}, { "type_id": 10, "name": "root"}], "buckets": [ { "id": -1, "name": "default", "type_id": 10, "type_name": "root", "weight": 0, "alg": "straw", "hash": "rjenkins1", "items": [ { "id": -2, "weight": 0, "pos": 0}, { "id": -3, "weight": 0, "pos": 1}, { "id": -4, "weight": 0, "pos": 2}]}, { "id": -2, "name": "ceph1", "type_id": 1, "type_name": "host", "weight": 0, "alg": "straw", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 0, "pos": 0}]}, { "id": -3, "name": "ceph2", "type_id": 1, "type_name": "host", "weight": 0, "alg": "straw", "hash": "rjenkins1", "items": [ { "id": 1, "weight": 0, "pos": 0}]}, { "id": -4, "name": "ceph3", "type_id": 1, "type_name": "host", "weight": 0, "alg": "straw", "hash": "rjenkins1", "items": [ { "id": 2, "weight": 0, "pos": 0}]}], "rules": [ { "rule_id": 0, "rule_name": "replicated_ruleset", "ruleset": 0, "type": 1, "min_size": 1, "max_size": 10, "steps": [ { "op": "take", "item": -1, "item_name": "default"}, { "op": "chooseleaf_firstn", "num": 0, "type": "host"}, { "op": "emit"}]}], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "profile": "bobtail", "optimal_tunables": 0, "legacy_tunables": 0, "require_feature_tunables": 1, "require_feature_tunables2": 1}} Nicolas Zin nicolas.zin@xxxxxxxxxxxxxxxxxxxx Ligne directe: 514-276-5468 poste 135 Fax : 514-276-5465 7275 Saint Urbain Bureau 200 Montréal, QC, H2R 2Y5 _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com