Hi Guys, me again. In the documentation about adding/removing monitors (see here: http://ceph.com/docs/master/rados/operations/add-or-rm-mons/ ) I've found something which should be written somehow noob-safe. I've used ceph version 0.80.2 on three rhel6.5 nodes. At "Adding monitors" in Step 3 and 4 there are mentioned a file called {tmp}/{filename} but in each cases two different files are meant: "ceph auth get mon. -o {tmp}/{filename}" creates a file which contains my keyring sth like this (for noobs like me ): [mon.] key = IDONTSHOWMYKEY/TROLOLOLOL== caps mon = "allow *" and "ceph mon getmap -o {tmp}/{filename}" creates a file with my monmap the file looks like this (again for noobs like me): monmaptool --print /tmp/teporaer/datei monmaptool: monmap file /tmp/teporaer/datei epoch 3 fsid th1sis-n0tr3-all1-1val1d-k3ybutl00ksl1k31 last_changed 2014-07-14 22:33:29.306703 created 0.000000 0: 100.56.389.121:6789/0 mon.node1 1: 100.56.389.123:6789/0 mon.node2 #the node I want to add 2: 100.56.389.124:6789/0 mon.node3 The last command overwrites the first one and so I recieved these messages in mon-Logfile after starting mon-Service: 2014-07-14 21:43:41.315036 7f1cfeb05700 0 cephx: verify_reply couldn't decrypt with error: error decoding block for decryption 2014-07-14 21:43:41.315047 7f1cfeb05700 0 -- 100.56.389.123:6789/0 >> 100.56.389.124:6789/0 pipe(0x2928a00 sd=12 :42522 s=1 pgs=0 cs=0 l=0 c=0x28a18c0).failed verifying authorize reply 2014-07-14 21:43:41.315155 7f1cfec06700 0 cephx: verify_reply couldn't decrypt with error: error decoding block for decryption 2014-07-14 21:43:41.315166 7f1cfec06700 0 -- 100.56.389.123:6789/0 >> 100.56.389.121:6789/0 pipe(0x2928280 sd=14 :32788 s=1 pgs=0 cs=0 l=0 c=0x28a0c60).failed verifying authorize reply By the way: isnt it necessary to add the mon-Host I want to add to the cluster to the monmap file? i.e. executing a command like this: monmaptool --add HOSNTAME HOSTIP --fsid th1sis-n0tr3-all1-1val1d-k3ybutl00ksl1k31 /tmp/teporaer/datei Or is this just unneccessary because of the steps 5-7? I've also tried ceph-deploy to a new host but I ran into this problem: http://tracker.ceph.com/issues/5195 with a perl-rpgram running/hanging "ceph-create-keys -i node2" Having entered "ceph mon add <host> <ip>" didnt help either because of my keyring. Something else which I do not understand is the second note in http://ceph.com/docs/master/rados/deployment/ceph-deploy-mon/#add-a-monitor "add a monitor". Can I really add two public networks to ceph.conf? Isnt it easier to run step 7 from here ( http://ceph.com/docs/master/rados/operations/add-or-rm-mons/#adding-a-monitor-manual )? Please dont feel harrassed by this post. See this as a review for the documentation because I've already deployed my third monitor to my cluster. Have a good night Erik P.S.: yes, the IPs above are not valid -------------------------------------------------------------------------------------------------- Bayerischer Rundfunk; Rundfunkplatz 1; 80335 M?nchen Telefon: +49 89 590001; E-Mail: info at BR.de; Website: http://www.BR.de