3 monitor down and recovery

何涛涛(云平台事业部) <HETAOTAO818@xxxxxxxxxxxxx> · Thu, 6 Apr 2017 06:32:01 +0000

Hello,
I am simulating the recovery when all of our 3 monitors are down in our test environment. I refered to the Ceph mon troubleshoting document, but encourtered the problem that “OSD
 has the store locked”. 
I stop all the 3 mom, and plan to get the monmap from the OSDs. To get the monmap, the command is as following:
for osd in /var/lib/ceph/osd/ceph-*; 

do  ceph-objectstore-tool --data-path $osd --op update-mon-db --mon-store-path /tmp/mon-store;     done
The output:
OSD has the store locked
OSD has the store locked
OSD has the store locked
OSD has the store locked
OSD has the store locked
OSD has the store locked
OSD has the store locked
OSD has the store locked

The Ceph version 10.2.5, OS REHL7.2, 3 hosts for mon and OSD, 4 OSDs in each hosts.

And I searched the problem on the internet, finding that someone says it is required to stop the OSD, but it is not reasonable for us to stop all of OSDs and to get the monmap.
Please give me some suggestions, thank you!

Best regards,
Taotao He
Cloud Storage Engineer
Ping An Technology(shenzhen) Co.,Ltd, Cloud Business Division

********************************************************************************************************************************
The information in this email is confidential and may be legally privileged. If you have received this email in error or are not the intended recipient, please immediately notify the sender and delete this message from your computer. Any use, distribution, or copying of this email other than by the intended recipient is strictly prohibited. All messages sent to and from us may be monitored to ensure compliance with internal policies and to protect our business. 
Emails are not secure and cannot be guaranteed to be error free as they can be intercepted, amended, lost or destroyed, or contain viruses. Anyone who communicates with us by email is taken to accept these risks. 
收发邮件者请注意：
本邮件含涉密信息，请保守秘密，若误收本邮件，请务必通知发送人并直接删去，不得使用、传播或复制本邮件。
进出邮件均受到本公司合规监控。邮件可能发生被截留、被修改、丢失、被破坏或包含计算机病毒等不安全情况。 
********************************************************************************************************************************

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com