It doesn't look like your OSD is mounted. What do you have when you run mount? How did you create your OSDs?
Robert LeBlanc
Sent from a mobile device please excuse any typos.
On Mar 25, 2015 1:31 AM, "oyym.mv@xxxxxxxxx" <oyym.mv@xxxxxxxxx> wrote:
Hi,JesusI encountered similar problem.1. shut down one of nodes, but all osds can't reactive on the node after reboot.2. run service ceph restart manually, got the same error message:[root@storage4 ~]# /etc/init.d/ceph start=== osd.15 ===
2015-03-23 14:43:32.399811 7fed0fcf4700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication
2015-03-23 14:43:32.399814 7fed0fcf4700 0 librados: osd.15 initialization error (2) No such file or directory
Error connecting to cluster: ObjectNotFound
failed: 'timeout 30 /usr/bin/ceph -c /etc/ceph/ceph.conf --name=osd.15 --keyring=/var/lib/ceph/osd/ceph-15/keyring osd crush create-or-move -- 15 0.19 host=storage4 root=default'......3. ll /var/lib/ceph/osd/ceph-15/total 0all files disappeared in the /var/lib/ceph/osd/ceph-15/
From: Jesus Chavez (jeschave)Date: 2015-03-24 05:09To: ceph-usersSubject: ERROR: missing keyring, cannot use cephx for authenticationHi all, I did HA failover test shutting down 1 node and I see that only 1 OSD came up after reboot:
[root@geminis ceph]# df -hFilesystem Size Used Avail Use% Mounted on/dev/mapper/rhel-root 50G 4.5G 46G 9% /devtmpfs 126G 0 126G 0% /devtmpfs 126G 80K 126G 1% /dev/shmtmpfs 126G 9.9M 126G 1% /runtmpfs 126G 0 126G 0% /sys/fs/cgroup/dev/sda1 494M 165M 330M 34% /boot/dev/mapper/rhel-home 36G 44M 36G 1% /home/dev/sdc1 3.7T 134M 3.7T 1% /var/lib/ceph/osd/ceph-14
If I run service ceph restart I got this error message…
Stopping Ceph osd.94 on geminis...done=== osd.94 ===2015-03-23 15:05:41.632505 7fe7b9941700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication2015-03-23 15:05:41.632508 7fe7b9941700 0 librados: osd.94 initialization error (2) No such file or directoryError connecting to cluster: ObjectNotFoundfailed: 'timeout 30 /usr/bin/ceph -c /etc/ceph/ceph.conf --name=osd.94 --keyring=/var/lib/ceph/osd/ceph-94/keyring osd crush create-or-move -- 94 0.05 host=geminis root=default
I have ceph.conf and ceph.client.admin.keyring under /etc/ceph:
[root@geminis ceph]# ls /etc/cephceph.client.admin.keyring ceph.conf rbdmap tmp1OqNFi tmptQ0a1P[root@geminis ceph]#
does anybody know what could be wrong?
Thanks
Jesus Chavez
SYSTEMS ENGINEER-C.SALES
jeschave@xxxxxxxxx
Phone: +52 55 5267 3146
Mobile: +51 1 5538883255
CCIE - 44433
Think before you print.
This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.
Please click here for Company Registration Information.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com