I've rebuilt my nodes on raring and now I'm hitting the same issue trying
to add the 2nd and 3rd monitors as specified in the quickstart. The
quickstart makes no mention of setting public_addr or public_network to
complete this step. What's the deal?
JL
On 13/10/24 10:23 AM, "Joao Eduardo Luis" <joao.luis@xxxxxxxxxxx> wrote:
>On 10/24/2013 03:12 PM, David J F Carradice wrote:
>> Hi.
>>
>> I am getting an error on adding monitors to my cluster.
>> ceph@ceph-deploy:~/my-cluster$ ceph-deploy mon create ceph-osd01
>> [ceph_deploy.cli][INFO ] Invoked (1.2.7): /usr/bin/ceph-deploy mon
>> create ceph-osd01
>> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-osd01
>> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-osd01 ...
>> [ceph_deploy.sudo_pushy][DEBUG ] will use a remote connection with sudo
>> [ceph_deploy.mon][INFO ] distro info: Ubuntu 13.04 raring
>> [ceph-osd01][DEBUG ] determining if provided host has same hostname in
>> remote
>> [ceph-osd01][DEBUG ] deploying mon to ceph-osd01
>> [ceph-osd01][DEBUG ] remote hostname: ceph-osd01
>> [ceph-osd01][INFO ] write cluster configuration to
>>/etc/ceph/{cluster}.conf
>> [ceph-osd01][DEBUG ] checking for done path:
>> /var/lib/ceph/mon/ceph-ceph-osd01/done
>> [ceph-osd01][INFO ] create a done file to avoid re-doing the mon
>>deployment
>> [ceph-osd01][INFO ] create the init path if it does not exist
>> [ceph-osd01][INFO ] locating `service` executable...
>> [ceph-osd01][INFO ] found `service` executable: /usr/sbin/service
>> [ceph-osd01][INFO ] Running command: sudo initctl emit ceph-mon
>> cluster=ceph id=ceph-osd01
>> [ceph-osd01][INFO ] Running command: sudo ceph --admin-daemon
>> /var/run/ceph/ceph-mon.ceph-osd01.asok mon_status
>> [ceph-osd01][ERROR ] admin_socket: exception getting command
>> descriptions: [Errno 2] No such file or directory
>> [ceph-osd01][WARNIN] monitor: mon.ceph-osd01, might not be running yet
>> [ceph-osd01][INFO ] Running command: sudo ceph --admin-daemon
>> /var/run/ceph/ceph-mon.ceph-osd01.asok mon_status
>> [ceph-osd01][ERROR ] admin_socket: exception getting command
>> descriptions: [Errno 2] No such file or directory
>> [ceph-osd01][WARNIN] ceph-osd01 is not defined in `mon initial members`
>> [ceph-osd01][WARNIN] monitor ceph-osd01 does not exist in monmap
>> [ceph-osd01][WARNIN] neither `public_addr` nor `public_network` keys are
>> defined for monitors
>> [ceph-osd01][WARNIN] monitors may not be able to form quorum
>>
>> This is happening after a successful and first add of a monitor,
>> ceph-mon01. As per the ceph-deploy documentation, I added a single
>> monitor, then some disk daemons located on ceph-osd01~03, then went to
>> add more monitors, ceph-osd01 & 02 for a quorum. This is where I get the
>> issue.
>>
>> Is the issue related to the WARNING present regarding keys?
>
>That's a warning regarding config options (public_addr/public_network)
>and the lack of enough info to generate a monmap.
>
>>
>> It appears that when running the ceph-deploy mon create <node> from my
>> ceph-deploy server, it complains about there not being any
>> ceph-mon.<node>.asok (which I assume are address sockets). I looked in
>> the respective directories on the potential monitor nodes (which are
>> currently also the OSD nodes) and see that there is only an OSD.asok, no
>> MON.asok
>
>The monitor's .asok (admin socket) will only be created at start. If
>the monitor hasn't been run yet, then there's no asok.
>
>>
>> I can send my ceph.conf and a brief overview if it helps.
>
>ceph.conf, specially the [global] and [mon]/[mon.foo] sections would be
>helpful.
>
>>
>> Now to add to the fun, the ceph he alt passes, and I am able to place
>> an object. It is the fact that I cannot add more than the current single
>> mon node that I would like to resolve.
>>
>> Regards
>>
>> David
>>
>> PS Extract of ceph.log on my ceph-deploy server (separate from other
>> nodesŠ not a mon nor an osd)
>>
>> SUCCESSFUL INITIAL MON
>>
>> 764 2013-10-22 12:31:11,157 [ceph-mon01][INFO ] Running command: sudo
>> ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-mon01.asok m 764
>> on_status
>>
>> 765 2013-10-22 12:31:11,223 [ceph-mon01][DEBUG ]
>>
>>*************************************************************************
>>*******
>>
>> 766 2013-10-22 12:31:11,223 [ceph-mon01][DEBUG ] status for
>> monitor: mon.ceph-mon01
>>
>> 767 2013-10-22 12:31:11,224 [ceph-mon01][DEBUG ] {
>>
>> 768 2013-10-22 12:31:11,224 [ceph-mon01][DEBUG ]
>> ³election_epoch": 2,
>>
>>
>> FAILED ADD MON
>>
>> See above in blue.
>>
>>
>>
>>
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@xxxxxxxxxxxxxx
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
>
>--
>Joao Eduardo Luis
>Software Engineer | http://inktank.com | http://ceph.com
>_______________________________________________
>ceph-users mailing list
>ceph-users@xxxxxxxxxxxxxx
>http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
