On 10/24/2013 03:12 PM, David J F Carradice wrote:
Hi.
I am getting an error on adding monitors to my cluster.
ceph@ceph-deploy:~/my-cluster$ ceph-deploy mon create ceph-osd01
[ceph_deploy.cli][INFO ] Invoked (1.2.7): /usr/bin/ceph-deploy mon
create ceph-osd01
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-osd01
[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-osd01 ...
[ceph_deploy.sudo_pushy][DEBUG ] will use a remote connection with sudo
[ceph_deploy.mon][INFO ] distro info: Ubuntu 13.04 raring
[ceph-osd01][DEBUG ] determining if provided host has same hostname in
remote
[ceph-osd01][DEBUG ] deploying mon to ceph-osd01
[ceph-osd01][DEBUG ] remote hostname: ceph-osd01
[ceph-osd01][INFO ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-osd01][DEBUG ] checking for done path:
/var/lib/ceph/mon/ceph-ceph-osd01/done
[ceph-osd01][INFO ] create a done file to avoid re-doing the mon deployment
[ceph-osd01][INFO ] create the init path if it does not exist
[ceph-osd01][INFO ] locating `service` executable...
[ceph-osd01][INFO ] found `service` executable: /usr/sbin/service
[ceph-osd01][INFO ] Running command: sudo initctl emit ceph-mon
cluster=ceph id=ceph-osd01
[ceph-osd01][INFO ] Running command: sudo ceph --admin-daemon
/var/run/ceph/ceph-mon.ceph-osd01.asok mon_status
[ceph-osd01][ERROR ] admin_socket: exception getting command
descriptions: [Errno 2] No such file or directory
[ceph-osd01][WARNIN] monitor: mon.ceph-osd01, might not be running yet
[ceph-osd01][INFO ] Running command: sudo ceph --admin-daemon
/var/run/ceph/ceph-mon.ceph-osd01.asok mon_status
[ceph-osd01][ERROR ] admin_socket: exception getting command
descriptions: [Errno 2] No such file or directory
[ceph-osd01][WARNIN] ceph-osd01 is not defined in `mon initial members`
[ceph-osd01][WARNIN] monitor ceph-osd01 does not exist in monmap
[ceph-osd01][WARNIN] neither `public_addr` nor `public_network` keys are
defined for monitors
[ceph-osd01][WARNIN] monitors may not be able to form quorum
This is happening after a successful and first add of a monitor,
ceph-mon01. As per the ceph-deploy documentation, I added a single
monitor, then some disk daemons located on ceph-osd01~03, then went to
add more monitors, ceph-osd01 & 02 for a quorum. This is where I get the
issue.
Is the issue related to the WARNING present regarding keys?
That's a warning regarding config options (public_addr/public_network)
and the lack of enough info to generate a monmap.
It appears that when running the ceph-deploy mon create <node> from my
ceph-deploy server, it complains about there not being any
ceph-mon.<node>.asok (which I assume are address sockets). I looked in
the respective directories on the potential monitor nodes (which are
currently also the OSD nodes) and see that there is only an OSD.asok, no
MON.asok
The monitor's .asok (admin socket) will only be created at start. If
the monitor hasn't been run yet, then there's no asok.
I can send my ceph.conf and a brief overview if it helps.
ceph.conf, specially the [global] and [mon]/[mon.foo] sections would be
helpful.
Now to add to the fun, the ceph he alt passes, and I am able to place
an object. It is the fact that I cannot add more than the current single
mon node that I would like to resolve.
Regards
David
PS Extract of ceph.log on my ceph-deploy server (separate from other
nodes… not a mon nor an osd)
SUCCESSFUL INITIAL MON
764 2013-10-22 12:31:11,157 [ceph-mon01][INFO ] Running command: sudo
ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-mon01.asok m 764
on_status
765 2013-10-22 12:31:11,223 [ceph-mon01][DEBUG ]
********************************************************************************
766 2013-10-22 12:31:11,223 [ceph-mon01][DEBUG ] status for
monitor: mon.ceph-mon01
767 2013-10-22 12:31:11,224 [ceph-mon01][DEBUG ] {
768 2013-10-22 12:31:11,224 [ceph-mon01][DEBUG ]
“election_epoch": 2,
FAILED ADD MON
See above in blue.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
--
Joao Eduardo Luis
Software Engineer | http://inktank.com | http://ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
