Getting closer. The modules load and run, and after a few minutes GFS
will work. The problem is ccsd logs this error "Cluster is not
quorate. Refusing connection. Error while processing connect:
Connection refused" in syslog. This error will be generated by ccsd
every second for 5 minutes, then fence_tool will exit, fenced starts up
and I can mount file systems.
Cman on the other node will generate this log messages: CMAN: WARNING no
listener for port 11 on node fiveoften.
This is a 2 node cluster using SCSI disks on Fedora Core 3 and Linux
2.6.9 from kernel.org. I have attached the logs from both hosts and the
cluter.conf.
Any ideas?
The source code was pulled from CVS on Monday.
Thank you for your help.
Matt
mbrookov@xxxxxxxxx
Logs from fiveoften:
Dec 9 09:00:28 fiveoften kernel: Lock_Harness <CVS> (built Dec 6 2004
16:42:08) installed
Dec 9 09:00:28 fiveoften kernel: GFS <CVS> (built Dec 6 2004 16:41:25)
installed
Dec 9 09:00:28 fiveoften kernel: CMAN <CVS> (built Dec 7 2004
08:47:39) installed
Dec 9 09:00:28 fiveoften kernel: NET: Registered protocol family 30
Dec 9 09:00:28 fiveoften kernel: DLM <CVS> (built Dec 7 2004 08:48:06)
installed
Dec 9 09:00:28 fiveoften kernel: Lock_DLM (built Dec 6 2004 16:41:47)
installed
Dec 9 09:00:29 fiveoften kernel: CMAN: Waiting to join or form a
Linux-cluster
Dec 9 09:01:01 fiveoften kernel: CMAN: forming a new cluster
Dec 9 09:01:01 fiveoften kernel: CMAN: quorum regained, resuming
activity
Dec 9 09:01:01 fiveoften kernel: CMAN: got node fouroften
Dec 9 09:01:01 fiveoften ccsd[3417]: Cluster is not quorate. Refusing
connection.
Dec 9 09:01:01 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec 9 09:01:01 fiveoften crond(pam_unix)[3454]: session opened for user
root by (uid=0)
Dec 9 09:01:01 fiveoften crond(pam_unix)[3454]: session closed for user
root
Dec 9 09:01:02 fiveoften ccsd[3417]: Cluster is not quorate. Refusing
connection.
Dec 9 09:01:02 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec 9 09:01:03 fiveoften ccsd[3417]: Cluster is not quorate. Refusing
connection.
Dec 9 09:01:03 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec 9 09:01:04 fiveoften ccsd[3417]: Cluster is not quorate. Refusing
connection.
Dec 9 09:01:04 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec 9 09:01:05 fiveoften ccsd[3417]: Cluster is not quorate. Refusing
connection.
.
.
.
.
Dec 9 09:05:59 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec 9 09:06:00 fiveoften ccsd[3417]: Cluster is not quorate. Refusing
connection.
Dec 9 09:06:00 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec 9 09:06:01 fiveoften kernel: dlm: clvmd: recover event 2 (first)
Dec 9 09:06:01 fiveoften kernel: dlm: clvmd: add nodes
Dec 9 09:06:01 fiveoften kernel: dlm: connecting to 2
Dec 9 09:06:01 fiveoften kernel: dlm: clvmd: total nodes 2
Dec 9 09:06:01 fiveoften kernel: dlm: clvmd: rebuild resource directory
Dec 9 09:06:01 fiveoften kernel: dlm: clvmd: rebuilt 1 resources
Dec 9 09:06:02 fiveoften kernel: dlm: clvmd: recover event 2 done
Dec 9 09:06:02 fiveoften kernel: dlm: clvmd: process held requests
Dec 9 09:06:02 fiveoften kernel: dlm: clvmd: processed 0 requests
Dec 9 09:06:02 fiveoften kernel: dlm: clvmd: recover event 2 finished
Logs from fouroften:
Dec 9 09:00:28 fouroften kernel: Lock_Harness <CVS> (built Dec 6 2004
16:42:08) installed
Dec 9 09:00:28 fouroften kernel: GFS <CVS> (built Dec 6 2004 16:41:25)
installed
Dec 9 09:00:28 fouroften kernel: CMAN <CVS> (built Dec 7 2004
08:47:39) installed
Dec 9 09:00:28 fouroften kernel: NET: Registered protocol family 30
Dec 9 09:00:28 fouroften kernel: DLM <CVS> (built Dec 7 2004 08:48:06)
installed
Dec 9 09:00:28 fouroften kernel: Lock_DLM (built Dec 6 2004 16:41:47)
installed
Dec 9 09:00:29 fouroften kernel: CMAN: Waiting to join or form a
Linux-cluster
Dec 9 09:00:58 fouroften kernel: CMAN: sending membership request
Dec 9 09:00:58 fouroften kernel: CMAN: got node fiveoften
Dec 9 09:00:58 fouroften kernel: CMAN: quorum regained, resuming
activity
Dec 9 09:01:00 fouroften kernel: dlm: clvmd: recover event 2 (first)
Dec 9 09:01:00 fouroften kernel: dlm: clvmd: add nodes
Dec 9 09:01:01 fouroften crond(pam_unix)[3198]: session opened for user
root by (uid=0)
Dec 9 09:01:01 fouroften crond(pam_unix)[3198]: session closed for user
root
Dec 9 09:01:02 fouroften kernel: dlm: clvmd: total nodes 1
Dec 9 09:01:02 fouroften kernel: dlm: clvmd: rebuild resource directory
Dec 9 09:01:02 fouroften kernel: dlm: clvmd: rebuilt 0 resources
Dec 9 09:01:02 fouroften kernel: dlm: clvmd: recover event 2 done
Dec 9 09:01:02 fouroften kernel: CMAN: WARNING no listener for port 11
on node fiveoften
Dec 9 09:01:03 fouroften kernel: dlm: clvmd: process held requests
Dec 9 09:01:03 fouroften kernel: dlm: clvmd: processed 0 requests
Dec 9 09:01:03 fouroften kernel: dlm: clvmd: recover event 2 finished
.
.
.
.
Dec 9 09:05:58 fouroften kernel: dlm: got connection from 1
Dec 9 09:05:58 fouroften kernel: dlm: clvmd: recover event 4
Dec 9 09:05:58 fouroften kernel: dlm: clvmd: add node 1
Dec 9 09:05:59 fouroften kernel: dlm: clvmd: total nodes 2
Dec 9 09:05:59 fouroften kernel: dlm: clvmd: rebuild resource directory
Dec 9 09:05:59 fouroften kernel: dlm: clvmd: rebuilt 2 resources
Dec 9 09:05:59 fouroften kernel: dlm: clvmd: purge requests
Dec 9 09:05:59 fouroften kernel: dlm: clvmd: purged 0 requests
Dec 9 09:05:59 fouroften kernel: dlm: clvmd: mark waiting requests
Dec 9 09:05:59 fouroften kernel: dlm: clvmd: marked 0 requests
Dec 9 09:05:59 fouroften kernel: dlm: clvmd: recover event 4 done
Dec 9 09:06:00 fouroften kernel: dlm: clvmd: process held requests
Dec 9 09:06:00 fouroften kernel: dlm: clvmd: processed 1 requests
Dec 9 09:06:00 fouroften kernel: dlm: clvmd: resend marked requests
Dec 9 09:06:00 fouroften kernel: dlm: clvmd: resent 0 requests
Dec 9 09:06:00 fouroften kernel: dlm: clvmd: recover event 4 finished
Cluster.conf:
<?xml version="1.0"?>
<cluster name="CSMTEST" config_version="6">
<cman two_node="1" expected_votes="1">
</cman>
<clusternodes>
<clusternode name="fouroften" votes="1">
<fence>
<method name="cascade1">
<device name="human"
ipaddr="fouroften"/>
</method>
</fence>
</clusternode>
<clusternode name="fiveoften" votes="1">
<fence>
<method name="cascade1">
<device name="human"
ipaddr="fiveoften"/>
</method>
</fence>
</clusternode>
</clusternodes>
<fencedevices>
<fencedevice name="human" agent="fence_manual"/>
</fencedevices>
</cluster>
