Does the MDS have access to a keyring which contains its key, and does that match what's on the monitor? You're just referring to the client.admin one, which it won't use (it's not a client). It certainly looks like there's a mismatch based on the verification error. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Mon, Dec 2, 2013 at 5:31 PM, Luo Shaobo (DSI) <luosb@xxxxxxxxxxxxxxxxx> wrote: > Dear All, > > I have updated a new version of Ceph, but I meet some strange things. It seems that MDS does not join the cluster. > > In the manager node, there no MDS in. and the log of ceph_mds shows error during decoding block for decryption. But all the configuration on all the node are same. > > 1. sudo cat /etc/ceph/ceph.client.admin.keyring > [client.admin] > key = AQADa5xSCNRIIRAA/wPhnf+opgCFfwVFQTI0sg== > > 2. sudo cat /etc/ceph/ceph.conf > [global] > fsid = fc446df6-cc65-4ae8-8508-9eb8db6ad922 > mon_initial_members = ubuntu217 > mon_host = 192.168.36.217 > auth_supported = cephx > osd_journal_size = 1024 > filestore_xattr_use_omap = true > > 3. ceph mds dump. > dumped mdsmap epoch 32 > epoch 32 > flags 0 > created 2013-12-02 19:12:02.932374 > modified 2013-12-03 18:13:03.363896 > tableserver 0 > root 0 > session_timeout 60 > session_autoclose 300 > last_failure 0 > last_failure_osd_epoch 19 > compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding} > max_mds 1 > in 0 > up {0=4322} > failed > stopped > data_pools 0 > metadata_pool 1 > 4322: 192.168.36.217:6800/2507 'ubuntu217' mds.0.6 up:replay seq 1 laggy since 2013-12-03 18:09:18.277255 > > 4. ceph-mds process log. > > ceph@ubuntu217:~$ sudo /usr/bin/ceph-mds --cluster=ceph -i ubuntu217 -d > 2013-12-03 18:08:55.210327 7f30827a5780 0 starting mds.ubuntu217 at :/ceph version 0.72.1 (4d923861868f6a15dcb33fef7f50f674997322de), process ceph-mds, pid 2507 > 0 > 2013-12-03 18:08:55.235122 7f307d838700 1 mds.0.6 handle_mds_map i am now mds.0.6 > 2013-12-03 18:08:55.235125 7f307d838700 1 mds.0.6 handle_mds_map state change up:boot --> up:replay > 2013-12-03 18:08:55.235135 7f307d838700 1 mds.0.6 replay_start > 2013-12-03 18:08:55.235139 7f307d838700 1 mds.0.6 recovery set is > 2013-12-03 18:08:55.235141 7f307d838700 1 mds.0.6 need osdmap epoch 19, have 19 > 2013-12-03 18:08:55.237000 7f307a630700 0 cephx: verify_reply couldn't decrypt with error: error decoding block for decryption > 2013-12-03 18:08:55.237028 7f307a630700 0 -- 192.168.36.217:6800/2507 >> 192.168.35.82:6800/7500 pipe(0x298b500 sd=16 :48150 s=1 pgs=0 cs=0 l=1 c=0x2958840).failed verifying authorize reply > 2013-12-03 18:08:55.237083 7f307a630700 0 -- 192.168.36.217:6800/2507 >> 192.168.35.82:6800/7500 pipe(0x298b500 sd=16 :48150 s=1 pgs=0 cs=0 l=1 c=0x2958840).fault > > ________________________________ > This email and any attachments are confidential and may be privileged. If you are not the intended recipient, please delete it and notify us immediately. Please do not copy or use it for any purpose, or disclose its contents to any other person. This email does not constitute a contract offer, a contract amendment, or an acceptance of a contract offer. Thank you. > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
