On 24/09/14 14:07, Aegeaner wrote: > I turned on the debug option, and this is what I got: > > # ./kv.sh > > removed osd.0 > removed item id 0 name 'osd.0' from crush map > 0 > umount: /var/lib/ceph/osd/ceph-0: not found > updated > add item id 0 name 'osd.0' weight 1 at location > {host=CVM-0-11,root=default} to crush map > meta-data=/dev/hioa isize=256 agcount=4, > agsize=24506368 blks > = sectsz=512 attr=2, projid32bit=0 > data = bsize=4096 blocks=98025472, > imaxpct=25 > = sunit=0 swidth=0 blks > naming =version 2 bsize=4096 ascii-ci=0 > log =internal log bsize=4096 blocks=47864, version=2 > = sectsz=512 sunit=0 blks, > lazy-count=1 > realtime =none extsz=4096 blocks=0, rtextents=0 > 2014-09-24 10:02:21.049162 7fe4cf3aa7a0 0 ceph version 0.80.5 > (38b73c67d375a2552d8ed67843c8a65c2c0feba6), process ceph-osd, pid 10252 > 2014-09-24 10:02:21.055433 7fe4cf3aa7a0 1 mkfs in > /var/lib/ceph/osd/ceph-0 > 2014-09-24 10:02:21.056359 7fe4cf3aa7a0 1 mkfs generated fsid > d613a61d-a1b4-4180-aea2-552944a2f0dc > 2014-09-24 10:02:21.061349 7fe4cf3aa7a0 1 keyvaluestore backend > exists/created > 2014-09-24 10:02:21.061377 7fe4cf3aa7a0 1 mkfs done in > /var/lib/ceph/osd/ceph-0 > 2014-09-24 10:02:21.065679 7fe4cf3aa7a0 -1 created object store > /var/lib/ceph/osd/ceph-0 journal /var/lib/ceph/osd/ceph-0/journal > for osd.0 fsid d90272ca-d8cc-41eb-b525-2cffe734aec0 > 2014-09-24 10:02:21.065776 7fe4cf3aa7a0 -1 auth: error reading file: > /var/lib/ceph/osd/ceph-0/keyring: can't open > /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory > 2014-09-24 10:02:21.065889 7fe4cf3aa7a0 -1 created new key in > keyring /var/lib/ceph/osd/ceph-0/keyring > added key for osd.0 > > # ceph osd tree > > # id weight type name up/down reweight > -1 1 root default > -2 1 host CVM-0-11 > 0 1 osd.0 down 0 > > Also I updated my simple script to create the OSD: > > ceph osd rm 0 > ceph osd crush rm osd.0 > ceph osd create > umount /var/lib/ceph/osd/ceph-0 > rm -rf /var/lib/ceph/osd/ceph-0 > rm -rf /var/lib/ceph/osd/ceph-0 > mkdir /var/lib/ceph/osd/ceph-0 > ceph auth del osd.0 > ceph osd crush add osd.0 1 root=default host=CVM-0-11 > mkfs -t xfs -f /dev/hioa > mount /dev/hioa /var/lib/ceph/osd/ceph-0 > ceph-osd --id 0 -d --mkkey --mkfs --osd-data /var/lib/ceph/osd/ceph-0 > ceph auth add osd.0 osd 'allow *' mon 'allow profile osd' -i > /var/lib/ceph/osd/ceph-0/keyring > /etc/init.d/ceph start osd.0 > From where your log stops at, it would appear that your system start script is not even trying to get osd.0 up at all. Can we see an ls -l of /var/lib/ceph/osd/ceph-0? Also what os are you on? You might need to invoke via: $ service ceph start or similar. Cheers Mark