Re: [Q] Successful Gluster Peer Probe via GRE tunnel, but State returns Accepted peer request (Connected/Disconnected)

[Tohru_Kao <jacoder@xxxxxxxxx>]

Hi Atin,

Looks like Humble is busy currently,

Could you share the workaround that you may know.

Thanks,

-Tohru

On Monday, September 7, 2015 9:43 PM, Atin Mukherjee <amukherj@xxxxxxxxxx> wrote:

+ Humble

Considering you had recently faced a similar problem, you could share
the work around.

On 09/08/2015 09:15 AM, Tohru_Kao wrote:
> Hi all,
>
> This is regarding using Gluster 3.7.4 with GRE tunnel between 2 Ubuntu
> (14.04.3) VMs.
>
> ### Observation
>
> After Gluster Peer Probe success, Status returns few thing strange:
>
> #1: the State as "Accepted peer request (Connected/Disconnected)”.
> #2: IP address return is the Tunnel IP, not probed host IP.
>
> * Environments and GRE commands I applied are listed below.
> * GRE tunnel settings are done by
> referring http://ask.xmodulo.com/create-gre-tunnel-linux.html
>
> ### Questions
>
> Q1:
>  Do I need to add/set additional parameters in glusterd.vol  because of
> GRE ?
>
> Q2:
>  Are my GRE tunnel command settings wrong ? or missing some commands?
>
> Any idea?
>
> Appreciate any comments or pointers.
>
> ### Note:
> * Peer Probe via external IPs works properly.
>
> Thank in Advance.
> -JaCoder
>
> ##############  Environment and Commands ##############
> Environment:
>  U1: external ip address:  172.16.213.128  internal network:
> 169.254.0.0/24
>  U2: external ip address:  172.16.213.129  internal network:
> 169.254.1.0/24
>
> ### Output of ‘gluster peer probe’ and status
>
> On U1
> # gluster peer probe 169.254.1.1
> peer probe: success.
>
> # gluster peer status
> Number of Peers: 1
>
> Hostname: 169.254.1.1
> Uuid: b6519618-e3aa-4307-afce-8f3d0dae39fc
> State: Accepted peer request (Connected)
> ---
> On U2
>
> # gluster peer status
> Number of Peers: 1
>
> Hostname: 10.10.10.1
> Uuid: 2306591b-25d6-41cf-ba50-db30ef0687bb
> State: Accepted peer request (Disconnected)
>
>
> ### glusterd.vol Files
> On U1
>
> # cat /etc/glusterfs/glusterd.vol
> volume management
>    type mgmt/glusterd
>    option working-directory /var/lib/glusterd
>    option transport.socket.bind-address 169.254.0.1
>    option transport-type socket,rdma
>    option transport.socket.keepalive-time 10
>    option transport.socket.keepalive-interval 2
>    option transport.socket.read-fail-log off
>    option ping-timeout 30
> #  option base-port 49152
> end-volume
>
> ---
> On U2
>
> # cat /etc/glusterfs/glusterd.vol
> volume management
>    type mgmt/glusterd
>    option working-directory /var/lib/glusterd
>    option transport.socket.bind-address 169.254.1.1
>    option transport-type socket,rdma
>    option transport.socket.keepalive-time 10
>    option transport.socket.keepalive-interval 2
>    option transport.socket.read-fail-log off
>    option ping-timeout 30
> #  option base-port 49152
> end-volume
>
> ### Output of ‘ifconfig | inet'
>
> On U1
> # ifconfig | grep inet
>          inet addr:172.16.213.128  Bcast:172.16.213.255  Mask:255.255.255.0
>          inet addr:169.254.0.1  Bcast:169.254.0.255  Mask:255.255.255.0
>          inet addr:127.0.0.1  Mask:255.0.0.0
>          inet addr:10.10.10.1  P-t-P:10.10.10.1  Mask:255.255.255.0
>
> On U2
> # ifconfig | grep inet
>          inet addr:172.16.213.129  Bcast:172.16.213.255  Mask:255.255.255.0
>          inet addr:169.254.1.1  Bcast:169.254.1.255  Mask:255.255.255.0
>          inet addr:127.0.0.1  Mask:255.0.0.0
>          inet addr:10.10.10.2  P-t-P:10.10.10.2  Mask:255.255.255.0
>
>
> ### Applied GRE Tunnel Commands
> On U1
>
> modprobe ip_gre
> ip tunnel add test-gre mode gre remote 172.16.213.129
> local 172.16.213.128 ttl 255
> ip link set test-gre up
> ip addr add 10.10.10.1/24 dev test-gre
> ip route add 169.254.1.0/24 dev test-gre
>
> On U2
>
> modprobe ip_gre
> ip tunnel add test-gre mode gre remote 172.16.213.128
> local 172.16.213.129 ttl 255
> ip link set test-gre up
> ip addr add 10.10.10.2/24 dev test-gre
> ip route add 169.254.0.0/24 dev test-gre
>
> ### Output of 'ip route show'
> On U1
>
> # ip route show
> default via 172.16.213.2 dev eth0
> 10.10.10.0/24 dev test-gre  proto kernel  scope link  src 10.10.10.1
> 169.254.0.0/24 dev ux-br0  proto kernel  scope link  src 169.254.0.1
> 169.254.1.0/24 dev test-gre  scope link
> 172.16.213.0/24 dev eth0  proto kernel  scope link  src 172.16.213.128
>
> # ping 169.254.1.1
> PING 169.254.1.1 (169.254.1.1) 56(84) bytes of data.
> 64 bytes from 169.254.1.1: icmp_seq=1 ttl=64 time=0.340 ms
> 64 bytes from 169.254.1.1: icmp_seq=2 ttl=64 time=0.305 ms
>
> ---
> On U2
>
> # ip route show
> default via 172.16.213.2 dev eth0
> 10.10.10.0/24 dev test-gre  proto kernel  scope link  src 10.10.10.2
> 169.254.0.0/24 dev test-gre  scope link
> 169.254.1.0/24 dev ux-br0  proto kernel  scope link  src 169.254.1.1
> 172.16.213.0/24 dev eth0  proto kernel  scope link  src 172.16.213.100
>
> # ping 169.254.0.1
> PING 169.254.0.1 (169.254.0.1) 56(84) bytes of data.
> 64 bytes from 169.254.0.1: icmp_seq=1 ttl=64 time=0.720 ms
> 64 bytes from 169.254.0.1: icmp_seq=2 ttl=64 time=0.298 ms
>
>
> === End ===

>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users@xxxxxxxxxxx
> http://www.gluster.org/mailman/listinfo/gluster-users

>

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users