On 06/15/2018 03:37 PM, Jim Kinney wrote: > YAY!!! > > Glad to see this! > > Now for a specific use case question: > > I have a 3-node gluster service in replica 3. Each node has multiple > network interfaces: a 40G ethernet and a 40G Infiniband with TCP. The > infiniband is a separate IP network from the 40G ethernet. There is no > (known) way to bridge the two networks. > > How do I get the HA to work with dual (or more) networks? The CTDB docs (https://wiki.samba.org/index.php/Adding_public_IP_addresses) seem to suggest you can have multiple IPs per node, i.e. on multiple NICs, managed by CTDB. I'd guess that the /etc/ctdb/public_addresses file might look something like this: 192.168.122.85 eth0 192.168.123.85 ib0 192.168.122.86 eth0 192.168.123.86 ib0 192.168.122.87 eth0 192.168.123.87 ib0 This might be a better question to ask in a Samba/CTDB forum. Or perhaps Günther or Michael can point to some better documentation than what I was able to find. > > ascii art: > _________ ________________ > | |--- ib connection -- gluster storage node 1 -- ethernet connection > ----| | > IB cluster gluster clients ---| IB switch |--- ib connection -- gluster > storage node 2 -- ethernet connection ----| big ethernet switch |--- > large number of gluster clients > |________|--- ib connection -- gluster storage node 3 -- ethernet > connection ----|________________| > > > > > On Fri, 2018-06-15 at 11:39 -0400, Kaleb S. KEITHLEY wrote: >> storhaug-1.0 is available now. Packages for Fedora[1], RHEL/CentOS[2], >> and SUSE/OpenSUSE[3] are available now. Packages for Debian and Ubuntu >> are coming soon¹. >> >> storhaug uses CTDB to to monitor the ganesha.nfsds in a cluster and >> manage the associated floating IP addresses (VIPs). storhaug is a >> replacement for the old ganesha-ha utility that was in GlusterFS-3.10 >> and earlier. storhaug may be used with GlusterFS-3.12 and later and any >> version of NFS-Ganesha. >> >> storhaug is much easier to set up than the old ganesha-ha utility. There >> is a write-up describing how to set it up and use it at [4]. >> >> Open issues for storhaug at [5]. Pull requests at [6]. Ask questions >> here on the lists or on IRC in #gluster or #gluster-dev. >> >> [1] Fedora Updates-Testing and Updates repos. >> [2] https://wiki.centos.org/SpecialInterestGroup/Storage >> [3] https://build.opensuse.org/project/subprojects/home:glusterfs >> [4] https://github.com/gluster/storhaug/wiki >> [5] https://github.com/gluster/storhaug/issues >> [6] https://github.com/gluster/storhaug/pulls >> >> ¹ For some definition of soon. >> >> >> > -- > > James P. Kinney III > > Every time you stop a school, you will have to build a jail. What you > gain at one end you lose at the other. It's like feeding a dog on his > own tail. It won't fatten the dog. > - Speech 11/23/1900 Mark Twain > > http://heretothereideas.blogspot.com/ > -- Kaleb _______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx http://lists.gluster.org/mailman/listinfo/gluster-devel
