On Mon, Jul 29, 2013 at 11:36 AM, Don Talton (dotalton) <dotalton@xxxxxxxxx> wrote: > Hello, > > I have a small test cluster that I deploy using puppet-ceph. Both the MON and the OSDs deploy properly, and appear to have all of the correct configurations. However, the OSDs are never marked as up. Any input is appreciated. The daemons are running on each OSD server, the OSDs are listed in the crushmap, and I can see them successfully authenticate with the MON eg. > > 2013-07-29 18:34:19.231905 7fbfeaaa5700 1 -- 2.4.1.7:0/14269 <== mon.0 2.4.1.4:6789/0 8 ==== mon_command_ack([osd,crush,create-or-move,0,0.91,root=default,host=ceph-osd0]=0 create-or-move updated item id 0 name 'osd.0' weight 0.91 at location {host=ceph-osd0,root=default} to crush map v8) v1 ==== 223+0+0 (1170550300 0 0) 0x7fbfe00016d0 con 0x16b1770create-or-move updated item id 0 name 'osd.0' weight 0.91 at location {host=ceph-osd0,root=default} to crush map This is actually not the OSDs doing this, but the ceph admin tool using the bootstrap-osd key. Do you have anything that's from the OSDs? There might be something helpful in the OSD logs; if not you can add "debug ms = 1" and restart them and there certainly will be. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com > > > My ceph.conf > > [global] > auth cluster required = cephx > auth service required = cephx > auth client required = cephx > keyring = /etc/ceph/keyring > > fsid = e80afa94-a64c-486c-9e34-d55e85f26406 > debug ms = 1/5 > > [mon] > mon data = /var/lib/ceph/mon/mon.$id > debug mon = 20 > debug paxos = 1/5 > debug auth = 2 > > [osd] > osd journal size = 4096 > cluster network = 2.4.1.0/24 > public network = 2.4.1.0/24 > filestore flusher = false > osd data = /var/lib/ceph/osd/osd.$id > osd journal = /var/lib/ceph/osd/osd.$id/journal > osd mkfs type = xfs > keyring = /var/lib/ceph/osd/osd.$id/keyring > debug osd = 1/5 > debug filestore = 1/5 > debug journal = 1 > debug monc = 5/20 > > [mds] > mds data = /var/lib/ceph/mds/mds.$id > keyring = /var/lib/ceph/mds/mds.$id/keyring > > [mon.0] > host = ceph-mon0 > mon addr = 2.4.1.4:6789 > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com