Dear All, I have updated a new version of Ceph, but I meet some strange things. It seems that MDS does not join the cluster. In the manager node, there no MDS in. and the log of ceph_mds shows error during decoding block for decryption. But all the configuration on all the node are same. 1. sudo cat /etc/ceph/ceph.client.admin.keyring [client.admin] key = AQADa5xSCNRIIRAA/wPhnf+opgCFfwVFQTI0sg== 2. sudo cat /etc/ceph/ceph.conf [global] fsid = fc446df6-cc65-4ae8-8508-9eb8db6ad922 mon_initial_members = ubuntu217 mon_host = 192.168.36.217 auth_supported = cephx osd_journal_size = 1024 filestore_xattr_use_omap = true 3. ceph mds dump. dumped mdsmap epoch 32 epoch 32 flags 0 created 2013-12-02 19:12:02.932374 modified 2013-12-03 18:13:03.363896 tableserver 0 root 0 session_timeout 60 session_autoclose 300 last_failure 0 last_failure_osd_epoch 19 compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding} max_mds 1 in 0 up {0=4322} failed stopped data_pools 0 metadata_pool 1 4322: 192.168.36.217:6800/2507 'ubuntu217' mds.0.6 up:replay seq 1 laggy since 2013-12-03 18:09:18.277255 4. ceph-mds process log. ceph@ubuntu217:~$ sudo /usr/bin/ceph-mds --cluster=ceph -i ubuntu217 -d 2013-12-03 18:08:55.210327 7f30827a5780 0 starting mds.ubuntu217 at :/ceph version 0.72.1 (4d923861868f6a15dcb33fef7f50f674997322de), process ceph-mds, pid 2507 0 2013-12-03 18:08:55.235122 7f307d838700 1 mds.0.6 handle_mds_map i am now mds.0.6 2013-12-03 18:08:55.235125 7f307d838700 1 mds.0.6 handle_mds_map state change up:boot --> up:replay 2013-12-03 18:08:55.235135 7f307d838700 1 mds.0.6 replay_start 2013-12-03 18:08:55.235139 7f307d838700 1 mds.0.6 recovery set is 2013-12-03 18:08:55.235141 7f307d838700 1 mds.0.6 need osdmap epoch 19, have 19 2013-12-03 18:08:55.237000 7f307a630700 0 cephx: verify_reply couldn't decrypt with error: error decoding block for decryption 2013-12-03 18:08:55.237028 7f307a630700 0 -- 192.168.36.217:6800/2507 >> 192.168.35.82:6800/7500 pipe(0x298b500 sd=16 :48150 s=1 pgs=0 cs=0 l=1 c=0x2958840).failed verifying authorize reply 2013-12-03 18:08:55.237083 7f307a630700 0 -- 192.168.36.217:6800/2507 >> 192.168.35.82:6800/7500 pipe(0x298b500 sd=16 :48150 s=1 pgs=0 cs=0 l=1 c=0x2958840).fault ________________________________ This email and any attachments are confidential and may be privileged. If you are not the intended recipient, please delete it and notify us immediately. Please do not copy or use it for any purpose, or disclose its contents to any other person. This email does not constitute a contract offer, a contract amendment, or an acceptance of a contract offer. Thank you. -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html