Re: Disaster recovery of monitor

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 2013-06-13 20:10, peter@xxxxxxxxx wrote:
On 2013-06-13 18:57, Joao Eduardo Luis wrote:
On 06/13/2013 05:25 PM, peter@xxxxxxxxx wrote:
On 2013-06-13 18:06, Gregory Farnum wrote:
On Thursday, June 13, 2013, wrote:

Hello,
We ran into a problem with our test cluster after adding monitors. It
now seems that our main monitor doesn't want to start anymore. The
logs are flooded with:
2013-06-13 11:41:05.316982 7f7689ca4780 7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:41:05.317043 7f7689ca4780 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:41:05.317064 7f7689ca4780 7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
Is this accurate? It's applying the *same* incremental I've and over
again?
Yes, this is the current state:
Peter,
Can you point me to the full log of the monitor caught in this apparent loop?
-Joao


Hi Joao,

Here it is:

http://www.2force.nl/ceph/ceph-mon.a.log.gz

Thanks,

Peter


Hi Joao,

Did you happen to figure out what is going on? If you need more log files let me know.

Cheers,

Peter


2013-06-13 11:36:45.553793 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.553846 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.553869 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.553922 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.553950 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554002 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554025 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554076 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554098 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554154 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554177 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554228 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554251 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554302 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554325 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554376 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554406 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554459 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554482 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554532 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554555 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554606 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554629 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554682 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554705 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
2013-06-13 11:36:45.554755 7f5894e25700  1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554778 7f5894e25700  7 mon.a@0(leader).osd e2809
update_from_paxos  applying incremental 2810
and many many more. It seems as if the monitor is in a loop.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux