[Linux-cluster] cluster is not quorate. refusing connection

Matthew B. Brookover mbrookov at mines.edu
Thu Dec 9 17:08:41 UTC 2004 

Getting closer.  The modules load and run, and after a few minutes GFS
will work.  The problem is ccsd logs this error "Cluster is not
quorate.  Refusing connection. Error while processing connect:
Connection refused" in syslog.  This error will be generated by ccsd
every second for 5 minutes, then fence_tool will exit, fenced starts up
and I can mount file systems.

Cman on the other node will generate this log messages: CMAN: WARNING no
listener for port 11 on node fiveoften.

This is a 2 node cluster using SCSI disks on Fedora Core 3 and Linux
2.6.9 from kernel.org.  I have attached the logs from both hosts and the
cluter.conf.

Any ideas?

The source code was pulled from CVS on Monday.

Thank you for your help.

Matt
mbrookov at mines.edu

Logs from fiveoften:
Dec  9 09:00:28 fiveoften kernel: Lock_Harness <CVS> (built Dec  6 2004
16:42:08) installed
Dec  9 09:00:28 fiveoften kernel: GFS <CVS> (built Dec  6 2004 16:41:25)
installed
Dec  9 09:00:28 fiveoften kernel: CMAN <CVS> (built Dec  7 2004
08:47:39) installed
Dec  9 09:00:28 fiveoften kernel: NET: Registered protocol family 30
Dec  9 09:00:28 fiveoften kernel: DLM <CVS> (built Dec  7 2004 08:48:06)
installed
Dec  9 09:00:28 fiveoften kernel: Lock_DLM (built Dec  6 2004 16:41:47)
installed
Dec  9 09:00:29 fiveoften kernel: CMAN: Waiting to join or form a
Linux-cluster
Dec  9 09:01:01 fiveoften kernel: CMAN: forming a new cluster
Dec  9 09:01:01 fiveoften kernel: CMAN: quorum regained, resuming
activity
Dec  9 09:01:01 fiveoften kernel: CMAN: got node fouroften
Dec  9 09:01:01 fiveoften ccsd[3417]: Cluster is not quorate.  Refusing
connection.
Dec  9 09:01:01 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec  9 09:01:01 fiveoften crond(pam_unix)[3454]: session opened for user
root by (uid=0)
Dec  9 09:01:01 fiveoften crond(pam_unix)[3454]: session closed for user
root
Dec  9 09:01:02 fiveoften ccsd[3417]: Cluster is not quorate.  Refusing
connection.
Dec  9 09:01:02 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec  9 09:01:03 fiveoften ccsd[3417]: Cluster is not quorate.  Refusing
connection.
Dec  9 09:01:03 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec  9 09:01:04 fiveoften ccsd[3417]: Cluster is not quorate.  Refusing
connection.
Dec  9 09:01:04 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec  9 09:01:05 fiveoften ccsd[3417]: Cluster is not quorate.  Refusing
connection.
.
.
.
.
Dec  9 09:05:59 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec  9 09:06:00 fiveoften ccsd[3417]: Cluster is not quorate.  Refusing
connection.
Dec  9 09:06:00 fiveoften ccsd[3417]: Error while processing connect:
Connection refused
Dec  9 09:06:01 fiveoften kernel: dlm: clvmd: recover event 2 (first)
Dec  9 09:06:01 fiveoften kernel: dlm: clvmd: add nodes
Dec  9 09:06:01 fiveoften kernel: dlm: connecting to 2
Dec  9 09:06:01 fiveoften kernel: dlm: clvmd: total nodes 2
Dec  9 09:06:01 fiveoften kernel: dlm: clvmd: rebuild resource directory
Dec  9 09:06:01 fiveoften kernel: dlm: clvmd: rebuilt 1 resources
Dec  9 09:06:02 fiveoften kernel: dlm: clvmd: recover event 2 done
Dec  9 09:06:02 fiveoften kernel: dlm: clvmd: process held requests
Dec  9 09:06:02 fiveoften kernel: dlm: clvmd: processed 0 requests
Dec  9 09:06:02 fiveoften kernel: dlm: clvmd: recover event 2 finished

Logs from fouroften:
Dec  9 09:00:28 fouroften kernel: Lock_Harness <CVS> (built Dec  6 2004
16:42:08) installed
Dec  9 09:00:28 fouroften kernel: GFS <CVS> (built Dec  6 2004 16:41:25)
installed
Dec  9 09:00:28 fouroften kernel: CMAN <CVS> (built Dec  7 2004
08:47:39) installed
Dec  9 09:00:28 fouroften kernel: NET: Registered protocol family 30
Dec  9 09:00:28 fouroften kernel: DLM <CVS> (built Dec  7 2004 08:48:06)
installed
Dec  9 09:00:28 fouroften kernel: Lock_DLM (built Dec  6 2004 16:41:47)
installed
Dec  9 09:00:29 fouroften kernel: CMAN: Waiting to join or form a
Linux-cluster
Dec  9 09:00:58 fouroften kernel: CMAN: sending membership request
Dec  9 09:00:58 fouroften kernel: CMAN: got node fiveoften
Dec  9 09:00:58 fouroften kernel: CMAN: quorum regained, resuming
activity
Dec  9 09:01:00 fouroften kernel: dlm: clvmd: recover event 2 (first)
Dec  9 09:01:00 fouroften kernel: dlm: clvmd: add nodes
Dec  9 09:01:01 fouroften crond(pam_unix)[3198]: session opened for user
root by (uid=0)
Dec  9 09:01:01 fouroften crond(pam_unix)[3198]: session closed for user
root
Dec  9 09:01:02 fouroften kernel: dlm: clvmd: total nodes 1
Dec  9 09:01:02 fouroften kernel: dlm: clvmd: rebuild resource directory
Dec  9 09:01:02 fouroften kernel: dlm: clvmd: rebuilt 0 resources
Dec  9 09:01:02 fouroften kernel: dlm: clvmd: recover event 2 done
Dec  9 09:01:02 fouroften kernel: CMAN: WARNING no listener for port 11
on node fiveoften
Dec  9 09:01:03 fouroften kernel: dlm: clvmd: process held requests
Dec  9 09:01:03 fouroften kernel: dlm: clvmd: processed 0 requests
Dec  9 09:01:03 fouroften kernel: dlm: clvmd: recover event 2 finished
.
.
.
.
Dec  9 09:05:58 fouroften kernel: dlm: got connection from 1
Dec  9 09:05:58 fouroften kernel: dlm: clvmd: recover event 4
Dec  9 09:05:58 fouroften kernel: dlm: clvmd: add node 1
Dec  9 09:05:59 fouroften kernel: dlm: clvmd: total nodes 2
Dec  9 09:05:59 fouroften kernel: dlm: clvmd: rebuild resource directory
Dec  9 09:05:59 fouroften kernel: dlm: clvmd: rebuilt 2 resources
Dec  9 09:05:59 fouroften kernel: dlm: clvmd: purge requests
Dec  9 09:05:59 fouroften kernel: dlm: clvmd: purged 0 requests
Dec  9 09:05:59 fouroften kernel: dlm: clvmd: mark waiting requests
Dec  9 09:05:59 fouroften kernel: dlm: clvmd: marked 0 requests
Dec  9 09:05:59 fouroften kernel: dlm: clvmd: recover event 4 done
Dec  9 09:06:00 fouroften kernel: dlm: clvmd: process held requests
Dec  9 09:06:00 fouroften kernel: dlm: clvmd: processed 1 requests
Dec  9 09:06:00 fouroften kernel: dlm: clvmd: resend marked requests
Dec  9 09:06:00 fouroften kernel: dlm: clvmd: resent 0 requests
Dec  9 09:06:00 fouroften kernel: dlm: clvmd: recover event 4 finished

Cluster.conf:
<?xml version="1.0"?>
<cluster name="CSMTEST" config_version="6">
 
<cman two_node="1" expected_votes="1">
</cman>
 
<clusternodes>
        <clusternode name="fouroften" votes="1">
                <fence>
                        <method name="cascade1">
                                <device name="human"
ipaddr="fouroften"/>
                        </method>
                </fence>
        </clusternode>
 
        <clusternode name="fiveoften" votes="1">
                <fence>
                        <method name="cascade1">
                                <device name="human"
ipaddr="fiveoften"/>
                        </method>
                </fence>
        </clusternode>
 
</clusternodes>
 
<fencedevices>
        <fencedevice name="human" agent="fence_manual"/>
</fencedevices>
 
</cluster>

More information about the Linux-cluster mailing list