Re: Add monitor unsuccesful

["Jesus Chavez (jeschave)" <jeschave@xxxxxxxxx>]

Thats what I thought and did actually the monmap and keyring were copied to the new monitor and there with 2 elements I did the mkfs thing and still have that Messages, do I need osd configured?  Because I have non and I am not sure if it is requiered ... Also is weird that monmap is not taking the new monitor I think I should try to configure the 3 monitors as initial monitors an see how it goes 


Jesus Chavez
SYSTEMS ENGINEER-C.SALES

jeschave@xxxxxxxxx
Phone: +52 55 5267 3146
Mobile: +51 1 5538883255

CCIE - 44433

On Mar 12, 2015, at 12:44 PM, Robert LeBlanc <robert@xxxxxxxxxxxxx> wrote:

I might be missing something, but is sounds like you already have a monitor up and running. If you create a new key, the new monitor won't be able to auth to the existing one. You need to get the monitor key from your existing monitor and use that for the second (and third) monitor. Look at step #3 at http://ceph.com/docs/master/rados/operations/add-or-rm-mons/#adding-a-monitor-manual. You only have to build a fresh keyring for your first monitor. Your subsequent monitors will use the first monitor's keyring.

On Thu, Mar 12, 2015 at 11:48 AM, Jesus Chavez (jeschave) <jeschave@xxxxxxxxx> wrote:

Thanks I did everything as you mention and still have the same issue that hangs a lot:

[root@tauro ~]# ceph status

2015-03-12 11:40:50.441084 7f6e20336700  0 -- :/1005688 >> 192.168.4.35:6789/0 pipe(0x7f6e1c0239a0 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7f6e1c023c30).fault

2015-03-12 11:40:53.441517 7f6e20235700  0 -- :/1005688 >> 192.168.4.35:6789/0 pipe(0x7f6e10000c00 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7f6e10000e90).fault

2015-03-12 11:40:57.443038 7f6e20336700  0 -- :/1005688 >> 192.168.4.35:6789/0 pipe(0x7f6e100030e0 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7f6e10003370).fault

^CError connecting to cluster: InterruptedOrTimeoutError

[root@tauro ~]#

After I saw that my monmap doesn’t have the new entry:

monmaptool: monmap file /tmp/monmap

epoch 0

fsid ddb39f8d-c30f-4172-aeca-30e553a5e4f1

last_changed 2015-03-12 11:22:20.811525

created 2015-03-12 11:22:20.811525

0: 192.168.4.35:6789/0 mon.aries

[root@tauro ~]#

It only has the initial monitor (mon.aries) the new one is called (mon.tauro), the last command before “…ceph-tauro/done” was "sudo ceph-mon --cluster ceph --mkfs -i tauro --keyring /tmp/ceph.mon.keyring --monmap /tmp/monmap” also I have tried to add to monmap with:

[root@tauro ~]# ceph mon add tauro 192.168.4.36:6789

2015-03-12 11:45:26.807504 7fc53077a700  0 -- :/1007053 >> 192.168.4.35:6789/0 pipe(0x7fc52c023970 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7fc52c023c00).fault

2015-03-12 11:45:29.807800 7fc530679700  0 -- :/1007053 >> 192.168.4.35:6789/0 pipe(0x7fc520000c00 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7fc520000e90).fault

^CError connecting to cluster: InterruptedOrTimeoutError

and also I tried from the initial monitor:

[root@aries ~]#  ceph mon add tauro 192.168.4.36:6789

2015-03-12 11:46:21.561523 7f7432ffd700  0 monclient: hunting for new mon

 

and it hangs forever, I tried at the same time to get the service up on tauro (new mon):

[root@tauro ~]# sudo /etc/init.d/ceph start mon.tauro

=== mon.tauro ===

Starting Ceph mon.tauro on tauro...

Running as unit run-7463.service.

Starting ceph-create-keys on tauro...

[root@tauro ~]#

and of course still have nothing =(

those were my entire lines:

vi /etc/ceph/ceph.conf

i[global]

fsid = ddb39f8d-c30f-4172-aeca-30e553a5e4f1

mon initial members = aries

mon host = 192.168.4.35

ceph-authtool --create-keyring /tmp/ceph.mon.keyring --gen-key -n mon. --cap mon 'allow *'

ceph-authtool --create-keyring /etc/ceph/ceph.client.admin.keyring --gen-key -n client.admin --set-uid=0 --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow'

ceph-authtool /tmp/ceph.mon.keyring --import-keyring /etc/ceph/ceph.client.admin.keyring

monmaptool --create --add aries 192.168.4.35 --fsid ddb39f8d-c30f-4172-aeca-30e553a5e4f1 /tmp/monmap

sudo mkdir /var/lib/ceph/mon/ceph-aries

ceph-mon --mkfs -i aries --monmap /tmp/monmap --keyring /tmp/ceph.mon.keyring

sudo touch /var/lib/ceph/mon/ceph-aries/done

sudo /etc/init.d/ceph start mon.aries

scp /etc/ceph/ceph.conf root@tauro:/etc/ceph/ceph.conf

scp /tmp/ceph.mon.keyring root@tauro:/tmp/ceph.mon.keyring

scp /tmp/monmap root@tauro:/tmp/monmap

mkdir /var/lib/ceph/mon/ceph-tauro

sudo ceph-mon --cluster ceph --mkfs -i tauro --keyring /tmp/ceph.mon.keyring --monmap /tmp/monmap

sudo ceph-mon -i tauro --mkfs --monmap /tmp/monmap --keyring /tmp/ceph.mon.keyring

sudo touch /var/lib/ceph/mon/ceph-tauro/done

sudo /etc/init.d/ceph start mon.tauro

=( 

<image005.png>

Jesus Chavez SYSTEMS ENGINEER-C.SALES jeschave@xxxxxxxxx Phone: +52 55 5267 3146 Mobile: +51 1 5538883255 CCIE - 44433	Cisco.com

        

<image006.gif>

  Think before you print.

This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.

Please click here for Company Registration Information.

On Mar 12, 2015, at 10:33 AM, Jesus Chavez (jeschave) <jeschave@xxxxxxxxx> wrote:

Great!!!! :) so just 1 point more, step 4 in adding monitors (Add the new monitor to the Monitor map.) this command actually runs in the new monitor right?

Thank you so much!


Jesus Chavez
SYSTEMS ENGINEER-C.SALES

jeschave@xxxxxxxxx
Phone: +52 55 5267 3146
Mobile: +51 1 5538883255

CCIE - 44433

On Mar 12, 2015, at 10:06 AM, Robert LeBlanc <robert@xxxxxxxxxxxxx> wrote:

Add the new monitor to the Monitor map.

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com