Forgot to stop the service Mon3 2013-06-10 15:05:27.245156 7f9898aad700 11 mon.3@2(electing) e1 tick 2013-06-10 15:05:28.289125 7f9898aad700 5 mon.3@2(electing).elector(19067) election timer expired 2013-06-10 15:05:28.289140 7f9898aad700 5 mon.3@2(electing).elector(19067) start -- can i be leader? 2013-06-10 15:05:28.289198 7f9898aad700 1 mon.3@2(electing).elector(19067) init, last seen epoch 19067 2013-06-10 15:05:28.289218 7f9898aad700 1 -- 10.198.141.203:6789/0 --> mon.0 10.198.141.201:6789/0 -- election(c5344dc8-b390-420a-bc1c-8b3ba4d9d5eb propose 19067) v4 -- ?+0 0x333ed80 2013-06-10 15:05:28.289310 7f9898aad700 1 -- 10.198.141.203:6789/0 --> mon.1 10.198.141.202:6789/0 -- election(c5344dc8-b390-420a-bc1c-8b3ba4d9d5eb propose 19067) v4 -- ?+0 0x333eb40 2013-06-10 15:05:32.245356 7f9898aad700 11 mon.3@2(electing) e1 tick 2013-06-10 15:05:33.289452 7f9898aad700 5 mon.3@2(electing).elector(19067) election timer expired 2013-06-10 15:05:33.289465 7f9898aad700 5 mon.3@2(electing).elector(19067) start -- can i be leader? 2013-06-10 15:05:33.289524 7f9898aad700 1 mon.3@2(electing).elector(19067) init, last seen epoch 19067 2013-06-10 15:05:33.289547 7f9898aad700 1 -- 10.198.141.203:6789/0 --> mon.0 10.198.141.201:6789/0 -- election(c5344dc8-b390-420a-bc1c-8b3ba4d9d5eb propose 19067) v4 -- ?+0 0x3936900 2013-06-10 15:05:33.289582 7f9898aad700 1 -- 10.198.141.203:6789/0 --> mon.1 10.198.141.202:6789/0 -- election(c5344dc8-b390-420a-bc1c-8b3ba4d9d5eb propose 19067) v4 -- ?+0 0x3936480 2013-06-10 15:05:37.245493 7f9898aad700 11 mon.3@2(electing) e1 tick 2013-06-10 15:05:38.289734 7f9898aad700 5 mon.3@2(electing).elector(19067) election timer expired 2013-06-10 15:05:38.289748 7f9898aad700 5 mon.3@2(electing).elector(19067) start -- can i be leader? 2013-06-10 15:05:38.289807 7f9898aad700 1 mon.3@2(electing).elector(19067) init, last seen epoch 19067 2013-06-10 15:05:38.289829 7f9898aad700 1 -- 10.198.141.203:6789/0 --> mon.0 10.198.141.201:6789/0 -- election(c5344dc8-b390-420a-bc1c-8b3ba4d9d5eb propose 19067) v4 -- ?+0 0x3936240 2013-06-10 15:05:38.289869 7f9898aad700 1 -- 10.198.141.203:6789/0 --> mon.1 10.198.141.202:6789/0 -- election(c5344dc8-b390-420a-bc1c-8b3ba4d9d5eb propose 19067) v4 -- ?+0 0x39366c0 Mon2 2013-06-10 15:03:42.829482 7fbf5aa21700 1 mon.2@1(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:03:42.829489 7fbf5aa21700 1 mon.2@1(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:03:42.829496 7fbf5aa21700 1 mon.2@1(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:03:42.829505 7fbf5aa21700 1 mon.2@1(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:03:42.829512 7fbf5aa21700 1 mon.2@1(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:03:42.829519 7fbf5aa21700 1 mon.2@1(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:03:42.829551 7fbf5aa21700 1 mon.2@1(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:03:42.829580 7fbf5aa21700 1 mon.2@1(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:03:42.829593 7fbf5aa21700 1 mon.2@1(electing) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere 2013-06-10 15:03:56.981399 7fbf57a06700 0 -- 10.198.141.202:6789/0 >> 10.198.141.201:6789/0 pipe(0x1abbc80 sd=35 :51049 s=2 pgs=17614 cs=1 l=0).fault with nothing to send, going to standby 2013-06-10 15:04:04.399466 7fbf563f0700 0 -- 10.198.141.202:6789/0 >> 10.198.141.201:6789/0 pipe(0x2f3a000 sd=314 :6789 s=0 pgs=0 cs=0 l=0).accept connect_seq 0 vs existing 1 state standby 2013-06-10 15:04:04.399489 7fbf563f0700 0 -- 10.198.141.202:6789/0 >> 10.198.141.201:6789/0 pipe(0x2f3a000 sd=314 :6789 s=0 pgs=0 cs=0 l=0).accept peer reset, then tried to connect to us, replacing 2013-06-10 15:05:06.710731 7fbf59a1f700 0 accepter.accepter no incoming connection? sd = -1 errno 24 Too many open files 2013-06-10 15:05:06.710770 7fbf59a1f700 0 accepter.accepter no incoming connection? sd = -1 errno 24 Too many open files 2013-06-10 15:05:06.710777 7fbf59a1f700 0 accepter.accepter no incoming connection? sd = -1 errno 24 Too many open files 2013-06-10 15:05:06.710781 7fbf59a1f700 0 accepter.accepter no incoming connection? sd = -1 errno 24 Too many open files 2013-06-10 15:05:06.710831 7fbf59a1f700 0 accepter.accepter no incoming connection? sd = -1 errno 24 Too many open files Mon1 2013-06-10 15:05:25.681813 7fb8b418e700 1 -- 10.198.141.201:6789/0 >> :/0 pipe(0x3478a00 sd=59 :6789 s=0 pgs=0 cs=0 l=0).accept sd=59 10.198.141.21:49487/0 2013-06-10 15:05:25.682101 7fb8b418e700 10 mon.1@0(probing) e1 ms_verify_authorizer 10.198.141.21:6800/28221 osd protocol 0 2013-06-10 15:05:25.682633 7fb8b5b9a700 1 -- 10.198.141.201:6789/0 <== osd.0 10.198.141.21:6800/28221 1 ==== auth(proto 0 26 bytes epoch 1) v1 ==== 56+0+0 (2276488189 0 0) 0x446f240 con 0x3de6b00 2013-06-10 15:05:25.682661 7fb8b5b9a700 20 mon.1@0(probing) e1 have connection 2013-06-10 15:05:25.682667 7fb8b5b9a700 5 mon.1@0(probing) e1 waitlisting message auth(proto 0 26 bytes epoch 1) v1 2013-06-10 15:05:25.815172 7fb8afb48700 1 -- 10.198.141.201:6789/0 >> :/0 pipe(0x3aae280 sd=61 :6789 s=0 pgs=0 cs=0 l=0).accept sd=61 10.198.141.23:35663/0 2013-06-10 15:05:25.815431 7fb8afb48700 10 mon.1@0(probing) e1 ms_verify_authorizer 10.198.141.23:6800/17532 osd protocol 0 2013-06-10 15:05:25.815859 7fb8b5b9a700 1 -- 10.198.141.201:6789/0 <== osd.10 10.198.141.23:6800/17532 1 ==== auth(proto 0 27 bytes epoch 1) v1 ==== 57+0+0 (3953728182 0 0) 0x446f480 con 0x3de69a0 2013-06-10 15:05:25.815886 7fb8b5b9a700 20 mon.1@0(probing) e1 have connection 2013-06-10 15:05:25.815893 7fb8b5b9a700 5 mon.1@0(probing) e1 waitlisting message auth(proto 0 27 bytes epoch 1) v1 2013-06-10 15:05:25.847392 7fb8b4693700 1 -- 10.198.141.201:6789/0 >> :/0 pipe(0x3aae780 sd=62 :6789 s=0 pgs=0 cs=0 l=0).accept sd=62 10.198.141.38:33015/0 2013-06-10 15:05:25.847624 7fb8b4693700 10 mon.1@0(probing) e1 ms_verify_authorizer 10.198.141.38:6801/30800 osd protocol 0 2013-06-10 15:05:25.848231 7fb8b5b9a700 1 -- 10.198.141.201:6789/0 <== osd.69 10.198.141.38:6801/30800 1 ==== auth(proto 0 27 bytes epoch 1) v1 ==== 57+0+0 (4137984247 0 0) 0x3daa480 con 0x3de6840 2013-06-10 15:05:25.848259 7fb8b5b9a700 20 mon.1@0(probing) e1 have connection 2013-06-10 15:05:25.848266 7fb8b5b9a700 5 mon.1@0(probing) e1 waitlisting message auth(proto 0 27 bytes epoch 1) v1 2013-06-10 15:05:25.903432 7fb8b5b9a700 10 mon.1@0(probing) e1 ms_handle_reset 0x3c4ac60 10.198.141.22:0/11207 2013-06-10 15:05:26.005579 7fb8b0b58700 1 -- 10.198.141.201:6789/0 >> :/0 pipe(0x3aaea00 sd=48 :6789 s=0 pgs=0 cs=0 l=0).accept sd=48 10.198.141.41:59626/0 2013-06-10 15:05:26.005796 7fb8b0b58700 10 mon.1@0(probing) e1 ms_verify_authorizer 10.198.141.41:6802/3952 osd protocol 0 2013-06-10 15:05:26.006232 7fb8b5b9a700 1 -- 10.198.141.201:6789/0 <== osd.82 10.198.141.41:6802/3952 1 ==== auth(proto 0 27 bytes epoch 1) v1 ==== 57+0+0 (309165234 0 0) 0x3daab40 con 0x3de66e0 2013-06-10 15:05:26.006261 7fb8b5b9a700 20 mon.1@0(probing) e1 have connection 2013-06-10 15:05:26.006267 7fb8b5b9a700 5 mon.1@0(probing) e1 waitlisting message auth(proto 0 27 bytes epoch 1) v1 2013-06-10 15:05:26.051107 7fb8b5b9a700 10 mon.1@0(probing) e1 ms_handle_reset 0x45b6580 10.198.141.32:6800/16748 2013-06-10 15:05:26.128585 7fb8b024f700 1 -- 10.198.141.201:6789/0 >> :/0 pipe(0x3aae500 sd=52 :6789 s=0 pgs=0 cs=0 l=0).accept sd=52 10.198.141.29:37225/0 2013-06-10 15:05:26.128896 7fb8b024f700 10 mon.1@0(probing) e1 ms_verify_authorizer 10.198.141.29:6803/19104 osd protocol 0 2013-06-10 15:05:26.129273 7fb8b5b9a700 1 -- 10.198.141.201:6789/0 <== osd.35 10.198.141.29:6803/19104 1 ==== auth(proto 0 27 bytes epoch 1) v1 ==== 57+0+0 (3841326661 0 0) 0x3daad80 con 0x3de6580 2013-06-10 15:05:26.129300 7fb8b5b9a700 20 mon.1@0(probing) e1 have connection 2013-06-10 15:05:26.129306 7fb8b5b9a700 5 mon.1@0(probing) e1 waitlisting message auth(proto 0 27 bytes epoch 1) v1 Nelson Jeppesen Disney Technology Solutions and Services Phone 206-588-5001 |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
