I might be missing something, but is sounds like you already have a monitor up and running. If you create a new key, the new monitor won't be able to auth to the existing one. You need to get the monitor key from your existing monitor and use that for the second (and third) monitor. Look at step #3 at http://ceph.com/docs/master/rados/operations/add-or-rm-mons/#adding-a-monitor-manual. You only have to build a fresh keyring for your first monitor. Your subsequent monitors will use the first monitor's keyring.
On Thu, Mar 12, 2015 at 11:48 AM, Jesus Chavez (jeschave) <jeschave@xxxxxxxxx> wrote:
Thanks I did everything as you mention and still have the same issue that hangs a lot:
[root@tauro ~]# ceph status2015-03-12 11:40:50.441084 7f6e20336700 0 -- :/1005688 >> 192.168.4.35:6789/0 pipe(0x7f6e1c0239a0 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7f6e1c023c30).fault2015-03-12 11:40:53.441517 7f6e20235700 0 -- :/1005688 >> 192.168.4.35:6789/0 pipe(0x7f6e10000c00 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7f6e10000e90).fault2015-03-12 11:40:57.443038 7f6e20336700 0 -- :/1005688 >> 192.168.4.35:6789/0 pipe(0x7f6e100030e0 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7f6e10003370).fault^CError connecting to cluster: InterruptedOrTimeoutError[root@tauro ~]#
After I saw that my monmap doesn’t have the new entry:
monmaptool: monmap file /tmp/monmapepoch 0fsid ddb39f8d-c30f-4172-aeca-30e553a5e4f1last_changed 2015-03-12 11:22:20.811525created 2015-03-12 11:22:20.8115250: 192.168.4.35:6789/0 mon.aries[root@tauro ~]#
It only has the initial monitor (mon.aries) the new one is called (mon.tauro), the last command before “…ceph-tauro/done” was "sudo ceph-mon --cluster ceph --mkfs -i tauro --keyring /tmp/ceph.mon.keyring --monmap /tmp/monmap” also I have tried to add to monmap with:
[root@tauro ~]# ceph mon add tauro 192.168.4.36:67892015-03-12 11:45:26.807504 7fc53077a700 0 -- :/1007053 >> 192.168.4.35:6789/0 pipe(0x7fc52c023970 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7fc52c023c00).fault2015-03-12 11:45:29.807800 7fc530679700 0 -- :/1007053 >> 192.168.4.35:6789/0 pipe(0x7fc520000c00 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7fc520000e90).fault^CError connecting to cluster: InterruptedOrTimeoutError
and also I tried from the initial monitor:
[root@aries ~]# ceph mon add tauro 192.168.4.36:67892015-03-12 11:46:21.561523 7f7432ffd700 0 monclient: hunting for new mon
and it hangs forever, I tried at the same time to get the service up on tauro (new mon):
[root@tauro ~]# sudo /etc/init.d/ceph start mon.tauro=== mon.tauro ===Starting Ceph mon.tauro on tauro...Running as unit run-7463.service.Starting ceph-create-keys on tauro...[root@tauro ~]#
and of course still have nothing =(
those were my entire lines:
vi /etc/ceph/ceph.conf
i[global]fsid = ddb39f8d-c30f-4172-aeca-30e553a5e4f1mon initial members = ariesmon host = 192.168.4.35
ceph-authtool --create-keyring /tmp/ceph.mon.keyring --gen-key -n mon. --cap mon 'allow *'ceph-authtool --create-keyring /etc/ceph/ceph.client.admin.keyring --gen-key -n client.admin --set-uid=0 --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow'ceph-authtool /tmp/ceph.mon.keyring --import-keyring /etc/ceph/ceph.client.admin.keyringmonmaptool --create --add aries 192.168.4.35 --fsid ddb39f8d-c30f-4172-aeca-30e553a5e4f1 /tmp/monmapsudo mkdir /var/lib/ceph/mon/ceph-ariesceph-mon --mkfs -i aries --monmap /tmp/monmap --keyring /tmp/ceph.mon.keyringsudo touch /var/lib/ceph/mon/ceph-aries/donesudo /etc/init.d/ceph start mon.aries
scp /etc/ceph/ceph.conf root@tauro:/etc/ceph/ceph.confscp /tmp/ceph.mon.keyring root@tauro:/tmp/ceph.mon.keyringscp /tmp/monmap root@tauro:/tmp/monmap
mkdir /var/lib/ceph/mon/ceph-taurosudo ceph-mon --cluster ceph --mkfs -i tauro --keyring /tmp/ceph.mon.keyring --monmap /tmp/monmapsudo ceph-mon -i tauro --mkfs --monmap /tmp/monmap --keyring /tmp/ceph.mon.keyringsudo touch /var/lib/ceph/mon/ceph-tauro/donesudo /etc/init.d/ceph start mon.tauro
=(
Jesus Chavez
SYSTEMS ENGINEER-C.SALES
jeschave@xxxxxxxxx
Phone: +52 55 5267 3146
Mobile: +51 1 5538883255
CCIE - 44433
Think before you print.
This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.
Please click here for Company Registration Information.
On Mar 12, 2015, at 10:33 AM, Jesus Chavez (jeschave) <jeschave@xxxxxxxxx> wrote:
Great!!!! :) so just 1 point more, step 4 in adding monitors (Add the new monitor to the Monitor map.) this command actually runs in the new monitor right?
Thank you so much!
Jesus Chavez
SYSTEMS ENGINEER-C.SALES
jeschave@xxxxxxxxx
Phone: +52 55 5267 3146
Mobile: +51 1 5538883255
CCIE - 44433Add the new monitor to the Monitor map.
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
