Dear Cephers:
I meet a problem now:
my cluster has 3 servers, each server has 1mon and 1osd
node0(mon0+osd0)、node1（mon1+osd1）、node2（mon2+osd2）
3 mon(mon0 192.168.202.35/24, mon1 192.168.202.36/24, mon2 192.168.202.37/24)
public network 192.168.2.*/24
cluster network 172.16.2.*/24
operation:
1.ifdown node0 public network interface for 30s
2.on node1, netstat -apn-c 1 |grep 6789, you can see the sendQ of tcp connection (src: mon1 ->
dst:
mon0) would be up to several hundred or several thousand ;
3.ifup node0's public network interface, use netstat again on node1 ,suddenly the sendQ can be up to 100 thousand or more; this will lead to in the following several seconds, mon1 can not send defer message to mon0(because of tcp sendQ block), this time "ceph -s" will display mon1 is down;
until sendQ of mon1 back to zero, 3 mon can finish election;
my questions:
1.why tcp sendQ(mon1 prepare to send to mon0) suddenly increase sharply when ifup mon0's public network?
2.when ifdown node0 net interface, state of the tcp conn (between mon0 and mon1) still be ESTABLISHED, after 900s ,conn close;
but if I down cluster network interface of node0, tcp conn (between osd0 and osd1) almost turn to be TIME_WAIT1;
why mon-mon tcp conn policy is different from osd-osd tcp conn?
Looking forward to your reply，thanks！
Best regards！
-------------------------------------------------------------------------------------------------------------------------------------
本邮件及其附件含有新华三技术有限公司的保密信息，仅限于发送给上面地址中列出
的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
邮件！
This e-mail and its attachments contain confidential information from New H3C, which is
intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender
by phone or email immediately and delete it!
|
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
