Hi Jogi! The reason this is occurring is due to the single osd node setup. By default Ceph wants to distribute the pgs by host and if only one host is available crush will not be able to place the replica. You can add this to your ceph conf to distribute by device rather then node. osd crush chooseleaf type = 0 This information is also available on the docs :) http://ceph.com/docs/next/start/quick-ceph-deploy/#create-a-cluster On Thu, Oct 3, 2013 at 4:16 AM, Jogi Hofmüller <jogi@xxxxxx> wrote: > Dear all, > > Hope I am not on everyones nerves by now ;) > > Just started over and created a new cluster: > > one monitor (ceph-mon0) > one osd-server (ceph-rd0) > > After activating the two OSDs on ceph-rd0 the cluster reaches a state > active+degraded and never becomes healthy. Unfortunately this > particular state is not documented here [1]. > > Some output: > > ceph@ceph-admin:~/cl0$ ceph -w > cluster 6f1dfb78-e917-4286-a8f0-2e389d295e43 > health HEALTH_WARN 192 pgs degraded; 192 pgs stuck unclean > monmap e1: 1 mons at {ceph-mon0=192.168.122.56:6789/0}, election > epoch 2, quorum 0 ceph-mon0 > osdmap e8: 2 osds: 2 up, 2 in > pgmap v15: 192 pgs: 192 active+degraded; 0 bytes data, 69924 KB > used, 6053 MB / 6121 MB avail > mdsmap e1: 0/0/1 up > > > 2013-10-03 13:09:59.997777 osd.0 [INF] pg has no unfound objects > > ceph@ceph-admin:~/cl0$ ceph health detail > HEALTH_WARN 192 pgs degraded; 192 pgs stuck unclean > pg 0.3f is stuck unclean since forever, current state active+degraded, > last acting [0] > pg 1.3e is stuck unclean since forever, current state active+degraded, > last acting [0] > pg 2.3d is stuck unclean since forever, current state active+degraded, > last acting [0] > (cut some lines) > pg 1.0 is active+degraded, acting [0] > pg 0.1 is active+degraded, acting [0] > pg 2.2 is active+degraded, acting [0] > pg 1.1 is active+degraded, acting [0] > pg 0.0 is active+degraded, acting [0] > > Any idea what went wrong here? > > [1] http://eu.ceph.com/docs/wip-3060/ops/manage/failures/osd/ > > Regards! > -- > j.hofmüller > > Optimism doesn't alter the laws of physics. - Subcommander T'Pol > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com