Downgraded nodes to .61.3: Mon2 logs: 2013-06-10 15:36:25.175309 7f7a2686e700 1 mon.2@1(probing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:25.175316 7f7a2686e700 1 mon.2@1(probing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:25.175323 7f7a2686e700 1 mon.2@1(probing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:25.175330 7f7a2686e700 1 mon.2@1(probing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:25.175337 7f7a2686e700 1 mon.2@1(probing) e1 discarding message auth(proto 0 26 bytes epoch 1) v1 and sending client elsewhere And lots more of the same Mon1 logs: 2013-06-10 15:36:48.809475 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x23cdb00 10.198.141.31:6800/17996 2013-06-10 15:36:48.809500 7fc34d5ec700 10 mon.1@0(electing) e1 reset/close on session osd.40 10.198.141.31:6800/17996 2013-06-10 15:36:48.809512 7fc34d5ec700 10 mon.1@0(electing) e1 remove_session MonSession: osd.40 10.198.141.31:6800/17996 is open osd.40 10.198.141.31:6800/17996 2013-06-10 15:36:48.877321 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x23cd9a0 10.198.141.25:6801/12417 2013-06-10 15:36:48.877345 7fc34d5ec700 10 mon.1@0(electing) e1 reset/close on session osd.17 10.198.141.25:6801/12417 2013-06-10 15:36:48.877357 7fc34d5ec700 10 mon.1@0(electing) e1 remove_session MonSession: osd.17 10.198.141.25:6801/12417 is open osd.17 10.198.141.25:6801/12417 2013-06-10 15:36:49.047761 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x23cd840 10.198.141.43:6802/23522 2013-06-10 15:36:49.047785 7fc34d5ec700 10 mon.1@0(electing) e1 reset/close on session osd.90 10.198.141.43:6802/23522 2013-06-10 15:36:49.047797 7fc34d5ec700 10 mon.1@0(electing) e1 remove_session MonSession: osd.90 10.198.141.43:6802/23522 is open osd.90 10.198.141.43:6802/23522 2013-06-10 15:36:49.396299 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x32a0420 10.198.141.35:6801/9214 2013-06-10 15:36:49.569858 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x23cd6e0 10.198.141.31:6803/19635 2013-06-10 15:36:49.799167 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x23cd580 10.198.141.23:6803/20236 2013-06-10 15:36:49.862490 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x23cd420 10.198.141.26:6801/10375 2013-06-10 15:36:49.943764 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x23cd2c0 10.198.141.42:6803/9702 2013-06-10 15:36:50.264132 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x23cd000 10.198.141.32:6800/16748 2013-06-10 15:36:50.393093 7fc34d5ec700 10 mon.1@0(electing) e1 ms_handle_reset 0x32a0580 10.198.141.23:6801/18005 2013-06-10 15:36:51.335841 7fc34dded700 11 mon.1@0(electing) e1 tick 2013-06-10 15:36:51.335910 7fc34dded700 20 mon.1@0(electing) e1 have connection 2013-06-10 15:36:51.335917 7fc34dded700 1 mon.1@0(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:51.335923 7fc34dded700 1 -- 10.198.141.201:6789/0 mark_down 0x23cd6e0 -- pipe dne 2013-06-10 15:36:51.335937 7fc34dded700 20 mon.1@0(electing) e1 have connection 2013-06-10 15:36:51.335940 7fc34dded700 1 mon.1@0(electing) e1 discarding message auth(proto 0 26 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:51.335942 7fc34dded700 1 -- 10.198.141.201:6789/0 mark_down 0x23cd580 -- pipe dne 2013-06-10 15:36:51.335950 7fc34dded700 20 mon.1@0(electing) e1 have connection 2013-06-10 15:36:51.335953 7fc34dded700 1 mon.1@0(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:51.335955 7fc34dded700 1 -- 10.198.141.201:6789/0 mark_down 0x23cd420 -- pipe dne 2013-06-10 15:36:51.335961 7fc34dded700 20 mon.1@0(electing) e1 have connection 2013-06-10 15:36:51.335963 7fc34dded700 1 mon.1@0(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:51.335965 7fc34dded700 1 -- 10.198.141.201:6789/0 mark_down 0x23cd2c0 -- pipe dne 2013-06-10 15:36:51.335968 7fc34dded700 20 mon.1@0(electing) e1 have connection 2013-06-10 15:36:51.335970 7fc34dded700 1 mon.1@0(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:51.335972 7fc34dded700 1 -- 10.198.141.201:6789/0 mark_down 0x23cd160 -- pipe dne 2013-06-10 15:36:51.335977 7fc34dded700 20 mon.1@0(electing) e1 have connection 2013-06-10 15:36:51.335979 7fc34dded700 1 mon.1@0(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:51.335981 7fc34dded700 1 -- 10.198.141.201:6789/0 mark_down 0x23cd000 -- pipe dne 2013-06-10 15:36:51.335984 7fc34dded700 20 mon.1@0(electing) e1 have connection 2013-06-10 15:36:51.335986 7fc34dded700 1 mon.1@0(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:51.335988 7fc34dded700 1 -- 10.198.141.201:6789/0 mark_down 0x32a0580 -- pipe dne 2013-06-10 15:36:51.335992 7fc34dded700 20 mon.1@0(electing) e1 have connection 2013-06-10 15:36:51.335993 7fc34dded700 1 mon.1@0(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:36:51.335995 7fc34dded700 1 -- 10.198.141.201:6789/0 mark_down 0x32a0420 -- pipe dne 2013-06-10 15:36:51.425388 7fc34dded700 5 mon.1@0(electing).elector(19081) election timer expired 2013-06-10 15:36:51.425405 7fc34dded700 10 mon.1@0(electing).elector(19081) bump_epoch 19081 to 19082 2013-06-10 15:36:51.462962 7fc34dded700 10 mon.1@0(electing) e1 reset 2013-06-10 15:36:51.462977 7fc34dded700 10 mon.1@0(electing) e1 timecheck_finish 2013-06-10 15:36:51.462995 7fc34dded700 1 -- 10.198.141.201:6789/0 --> mon.1 10.198.141.202:6789/0 -- election(c5344dc8-b390-420a-bc1c-8b3ba4d9d5eb victory 19082) v4 -- ?+0 0x29906c0 2013-06-10 15:36:51.463018 7fc34dded700 10 mon.1@0(leader) e1 win_election, epoch 19082 quorum is 0,1 features are 4294967295 2013-06-10 15:36:51.463031 7fc34dded700 0 log [INF] : mon.1@0 won leader election with quorum 0,1 2013-06-10 15:36:51.463054 7fc34dded700 1 -- 10.198.141.201:6789/0 --> mon.0 10.198.141.201:6789/0 -- log(2 entries) v1 -- ?+0 0x1fe1d80 2013-06-10 15:36:51.463160 7fc34d5ec700 1 -- 10.198.141.201:6789/0 <== mon.0 10.198.141.201:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x1fe1d80 con 0x2f79160 |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
