On 06/13/2013 07:10 PM, peter@xxxxxxxxx wrote:
On 2013-06-13 18:57, Joao Eduardo Luis wrote:
On 06/13/2013 05:25 PM, peter@xxxxxxxxx wrote:
On 2013-06-13 18:06, Gregory Farnum wrote:
On Thursday, June 13, 2013, wrote:
Hello,
We ran into a problem with our test cluster after adding monitors. It
now seems that our main monitor doesn't want to start anymore. The
logs are flooded with:
2013-06-13 11:41:05.316982 7f7689ca4780 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:41:05.317043 7f7689ca4780 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:41:05.317064 7f7689ca4780 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
Is this accurate? It's applying the *same* incremental I've and over
again?
Yes, this is the current state:
Peter,
Can you point me to the full log of the monitor caught in this
apparent loop?
-Joao
Hi Joao,
Here it is:
http://www.2force.nl/ceph/ceph-mon.a.log.gz
Thanks,
Peter
Thanks for the log Peter!
Would you by any chance be willing to point us to a copy of your
monitor's store?
-Joao
2013-06-13 11:36:45.553793 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.553846 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.553869 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.553922 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.553950 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554002 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554025 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554076 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554098 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554154 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554177 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554228 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554251 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554302 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554325 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554376 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554406 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554459 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554482 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554532 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554555 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554606 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554629 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554682 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554705 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
2013-06-13 11:36:45.554755 7f5894e25700 1 mon.a@0(leader).osd e2809
e2809: 9 osds: 9 up, 9 in
2013-06-13 11:36:45.554778 7f5894e25700 7 mon.a@0(leader).osd e2809
update_from_paxos applying incremental 2810
and many many more. It seems as if the monitor is in a loop.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
--
Joao Eduardo Luis
Software Engineer | http://inktank.com | http://ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
