Hello Digimer.
Thank you for your information.
This is the document that I'm looking for!!.
This doc is very very usuful. Thanks!!.
I want to ask one thing.
Please take a look my cluster configration again.
Mainly I want to use GNBD on gfs_clientX.
GNBD server is gfs2, and gfs3.
And gfs_client's hardwhere does not support IPMI, iLO...,
Because That machine is Desktop computers.
And no APC like UPS.
The desktop machine is just support Wake On LAN.
What fence device should I use??
I'm thinking fence_wake_on_lan is proper fence device.
but that is nothing..
Thank you for your advice.
<?xml version="1.0"?>
<cluster name="arch_gfs1" config_version="21">
<clusternodes>
<clusternode name="gfs1.archsystem.com" votes="1" nodeid="5">
<fence>
<method name="single">
<device name="manual" nodename="gfs1.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs2.archsystem.com" votes="1" nodeid="6">
<fence>
<method name="single">
<device name="manual" nodename="gfs2.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs3.archsystem.com" votes="1" nodeid="7">
<fence>
<method name="single">
<device name="manual" nodename="gfs3.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client1.archsystem.com" votes="1" nodeid="21">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client1.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client2.archsystem.com" votes="1" nodeid="22">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client2.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client3.archsystem.com" votes="1" nodeid="23">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client3.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client4.archsystem.com" votes="1" nodeid="24">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client4.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client5.archsystem.com" votes="1" nodeid="25">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client5.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client6.archsystem.com" votes="1" nodeid="26">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client6.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client7.archsystem.com" votes="1" nodeid="27">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client7.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client8.archsystem.com" votes="1" nodeid="28">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client8.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client9.archsystem.com" votes="1" nodeid="29">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client9.archsystem.com"/>
</method>
</fence>
</clusternode>
<clusternode name="gfs_client10.archsystem.com" votes="1" nodeid="30">
<fence>
<method name="single">
<device name="manual" nodename="gfs_client10.archsystem.com"/>
</method>
</fence>
</clusternode>
</clusternodes>
<fencedevices>
<fencedevice name="manual" agent="fence_manual"/>
</fencedevices>
<rm>
<failoverdomains/>
<resources/>
</rm>
</cluster>
Regards.
2011/5/29 Digimer <linux@xxxxxxxxxxx>:
> On 05/28/2011 08:39 AM, Hiroyuki Sato wrote:
>>
>> Dear members.
>>
>> I'm newbie Red Hat cluster.
>
> Welcome!
>
>> Could you point me to good documentation about command line interface??
>
>> ( cman_tool, css_tool, ccs_test, fence_ack_manual ..)
>
> The man pages for these tools are well documented.
>
>> fence_ack_manual
>
> <Digimer rolls up her sleeves and grabs her you-need-a-real-fence-device
> bat>
>
> This is not supported in any way, shape or form. You *must* use a proper
> fence device. Do your servers have IPMI (or OEM version like DRAC, iLO,
> etc?).
>
> Please read this:
>
> http://wiki.alteeve.com/index.php/Red_Hat_Cluster_Service_2_Tutorial#Concept.3B_Virtual_Synchrony
>
> Specifically; "Concept; Virtual Synchrony" and "Concept; Fencing"
>
>> Especially the following topics.
>>
>> * How to rejoin to node.
>> * How to leave from node.
>
> Starting and stopping the cman service will cause the node to join and
> leave, respectively. You can do it manually if you wish, please check the
> man pages.
>
>> * How to use fence_ack_manual
>
> Again, you can't. It is not supported.
>
>> * How to manage cluster with command line tools.
>
> ccs_tool is the main program to look at.
>
>> One of my problem is here.
>>
>> The status of gfs3 which in my test cluster is JOIN_STOP_WAIT.
>> I don't know how to re-join it.
>>
>> # /usr/sbin/cman_tool services
>> type level name id state
>> fence 0 default 00000000 JOIN_STOP_WAIT
>
> Without a working fence device, the cluster will block forever. As far as I
> know, once a fence call has been issued, there is nothing that can be done
> to abort it. I'd suggest pulling the power on the node, boot it cleanly and
> start cman.
>
>> I found a keyword 'fenced_override'. This file. should be named pipe.
>> Howevre I can't find that file in /var/run/cluter directory in my
>> clusters.
>> fenced working on all of clusters.
>
> Again, it's not supported.
>
>> Sincerely.
>>
>>
>> * Environment
>>
>> CentOS 5.6
>>
>>
>> * Configurations
>>
>> <?xml version="1.0"?>
>> <cluster name="arch_gfs1" config_version="21">
>> <cman expected_votes="1">
>
> This is wrong, 'expected_votes' is the number of nodes in the cluster (plus
> qdisk votes, if you are using it).
>
>> </cman>
>> <clusternodes>
>> <clusternode name="gfs1.doma.in" votes="1" nodeid="5">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs1.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs2.doma.in" votes="1" nodeid="6">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs2.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs3.doma.in" votes="1" nodeid="7">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs3.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client1.doma.in" votes="1" nodeid="21">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client1.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client2.doma.in" votes="1" nodeid="22">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client2.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client3.doma.in" votes="1" nodeid="23">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client3.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client4.doma.in" votes="1" nodeid="24">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client4.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client5.doma.in" votes="1" nodeid="25">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client5.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client6.doma.in" votes="1" nodeid="26">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client6.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client7.doma.in" votes="1" nodeid="27">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client7.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client8.doma.in" votes="1" nodeid="28">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client8.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client9.doma.in" votes="1" nodeid="29">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client9.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> <clusternode name="gfs_client10.doma.in" votes="1" nodeid="30">
>> <fence>
>> <method name="single">
>> <device name="manual" nodename="gfs_client10.doma.in"/>
>> </method>
>> </fence>
>> </clusternode>
>> </clusternodes>
>> <fencedevices>
>> <fencedevice name="manual" agent="fence_manual"/>
>> </fencedevices>
>> <rm>
>> <failoverdomains/>
>> <resources/>
>> </rm>
>> </cluster>
>
> If you are on IRC, join #linux-cluster, it is also a great place to get
> help. I am usually there and will be happy to help you get a) fencing
> working and b) get the rest working.
>
> Welcome to clustering! :)
>
> --
> Digimer
> E-Mail: digimer@xxxxxxxxxxx
> AN!Whitepapers: http://alteeve.com
> Node Assassin: http://nodeassassin.org
> "I feel confined, only free to expand myself within boundaries."
>
--
Hiroyuki Sato
--
Linux-cluster mailing list
Linux-cluster@xxxxxxxxxx
https://www.redhat.com/mailman/listinfo/linux-cluster
