Re: [Openstack] nova-network and corosync

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




Il giorno 19/lug/2012, alle ore 09:55, Alessandro Tagliapietra ha scritto:


Il giorno 19/lug/2012, alle ore 09:40, Alessandro Tagliapietra ha scritto:


Il giorno 19/lug/2012, alle ore 00:52, Steven Dake ha scritto:

On 07/18/2012 06:51 AM, Alessandro Tagliapietra wrote:
Hi Steve,

the problem is not that it's not listening on the correct interface, as lsof shows

corosync 1485 root    9u  IPv4              14890      0t0       UDP 226.94.1.1:5405
corosync 1485 root   10u  IPv4              14891      0t0       UDP server1:5404
corosync 1485 root   11u  IPv4              14892      0t0       UDP server1:5405

where server1 is 10.8.0.1, which is correct because it's the eth1 address.

The problem is that for some reason, the packets it sends to eth1 has as source ip the ip of eth0, which is the public internet connected interface, so like:

15:44:34.135411 IP 5.9.x.x.5404 > 226.94.1.1.5405: UDP, length 82
15:44:34.238762 IP 5.9.x.x.5404 > 226.94.1.1.5405: UDP, length 82

which is wrong. my ip r is this:

default via 5.9.x.x dev eth0  metric 100
5.9.x.x/27 via 5.9.x.x dev eth0
5.9.x.x/27 dev eth0  proto kernel  scope link  src 5.9.x.x
10.0.0.0/16 dev eth2  proto kernel  scope link  src 10.0.0.1
10.8.0.0/16 dev eth1  proto kernel  scope link  src 10.8.0.1
192.168.122.0/24 dev virbr0  proto kernel  scope link  src 192.168.122.1

As you can see packets to eth1 should have 10.8.0.1 as source, not eth0 ip.


Odd - Are you using udpu mode?  Which version?  Can you subscribe to the
corosync list and we can follow-up there?


When starting this discussion i was using ubuntu 12.04 repositories so 1.4.2, today i've installed 2.0.1, i've added corosync mailing list in cc. I have to specify that this problem happens only when i've installed nova network on both nodes (i'm using multi-host).

I've tried with udpu mode specifying the nodelist and it works fine. I'm going to switch back to 1.4.2 to use regular ubuntu packages and updates and see if that works too.


An update, i've removed eth2 (which was just a virtual interface) and set back flat_interface to eth1, now after a reboot i've got the same issue as before, packets are sent using public ip, but if a do a corosync restart after loggin in it works normally. Maybe it needs some delay to work?

Regards


Regards

Let me paste some configs:

nova.conf: http://pastie.org/private/c5tcutro6tp0s1te5yq (i've tried with flat_interface eth1 and eth2)
corosync.conf: http://pastie.org/private/cjrtqx9bspgmff7rlye6ew (tried with 10.8.0.0 also as bindnetaddr)
iptables-save: http://pastie.org/private/yvypgi5ovs2rtcingrq5iw (all generated by nova-network)

If you need any other things just ask.

Btw, i'm going to try with udpu now.

Regards

http://lists.corosync.org/mailman/listinfo/discuss

thanks
-steve

Regards

Il giorno 18/lug/2012, alle ore 15:18, Steven Dake ha scritto:

On 07/18/2012 03:50 AM, Alessandro Tagliapietra wrote:
Hello,

i've 2 machines, running ubuntu 12.04, i've installed corosync +
pacemaker and it was working fine.

Corosync is using eth1 with 10.8.0.1 and 10.8.0.2 as ip of the hosts,
i've got keystone, glance, nova api-cert-scheduler, mysql, rabbitmq
working in HA with pacemaker.

The problem comes after installing nova-network and nova-compute, i've
used this nova.conf:

http://pastie.org/private/ddwva8kvaypqrxk7rifvba

and after nova-compute started and hosts rebooted i can't get to work
corosync,

the problem seems that when hosts send packets in eth1 to multicast
address, the source ip is the public one, not the 10.8.0.x one. After
disabling nova-network on boot everything works.

I've also tried to create a virtual eth2 device and set flat_interface
to eth2, but it seems that still nova-network break the configuration as
corosync still uses public ip for private lan.

Any idea?


Corosync goes to great pains to route packets across the interface
identified in the corosync.conf file.  If you are using a subnet
definition ie:
bindnetaddr: 10.8.0.0, it may be that the interface's netmask is causing
a rebind to the new interface when nova network starts.

One way to force binding to a specific interface when your network is
not configured in a typical fashion is to identify the bindnetaddr exactly:

ie: bindnetaddr: 10.8.0.1

Regards
-steve

Best Regards

--
Alessandro Tagliapietra | VISup srl
piazza 4 novembre 7
20124 Milano

http://www.visup.it


_______________________________________________
Mailing list: https://launchpad.net/~openstack
Post to     : openstack@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp







-- 
Alessandro Tagliapietra | VISup srl
piazza 4 novembre 7
20124 Milano


-- 
Alessandro Tagliapietra | VISup srl
piazza 4 novembre 7
20124 Milano


-- 
Alessandro Tagliapietra | VISup srl
piazza 4 novembre 7
20124 Milano


_______________________________________________
discuss mailing list
discuss@xxxxxxxxxxxx
http://lists.corosync.org/mailman/listinfo/discuss

[Index of Archives]     [Linux Clusters]     [Corosync Project]     [Linux USB Devel]     [Linux Audio Users]     [Photo]     [Yosemite News]    [Yosemite Photos]    [Linux Kernel]     [Linux SCSI]     [X.Org]

  Powered by Linux