[Linux-cluster] Problem starting cluster

[isplist at logicore.net]

On Tue, 17 Oct 2006 22:13:58 -0400, Josef Whiter wrote:
> The membership requests are getting rejected, what do the other nodes say
> during the same time?

Hi there,

The other machines are in various states of trying to join but here's the 
output of one for example;

Failed to create lockfile.
Hint: ccsd is already running.
Timed-out waiting for cluster
fence_tool: cluster is not active
clvmd could not connect to cluster manager
Consult syslog for more information
  connect() failed on local socket: Connection refused
  Locking type 2 initialisation failed.

PS: Seems to be a typo in the above? :).

And the output of logging;

Oct 17 21:17:57 cweb92 kernel: CMAN: Cluster membership rejected
Oct 17 21:17:57 cweb92 ccsd[2330]: Cluster manager shutdown.  Attemping to 
reconnect...
Oct 17 21:17:57 cweb92 kernel: CMAN: Waiting to join or form a Linux-cluster
Oct 17 21:17:58 cweb92 kernel: CMAN: sending membership request
Oct 17 21:17:58 cweb92 kernel: CMAN: Cluster membership rejected
Oct 17 21:17:58 cweb92 kernel: CMAN: Waiting to join or form a Linux-cluster
Oct 17 21:17:58 cweb92 ccsd[2330]: Connected to cluster infrastruture via: 
CMAN/SM Plugin v1.1.7.1
Oct 17 21:17:58 cweb92 ccsd[2330]: Initial status:: Inquorate
Oct 17 21:18:02 cweb92 kernel: CMAN: sending membership request
Oct 17 21:18:02 cweb92 kernel: CMAN: Cluster membership rejected
Oct 17 21:18:02 cweb92 ccsd[2330]: Cluster manager shutdown.  Attemping to 
reconnect...
Oct 17 21:18:02 cweb92 kernel: CMAN: Waiting to join or form a Linux-cluster
Oct 17 21:18:03 cweb92 kernel: CMAN: sending membership request
Oct 17 21:18:03 cweb92 kernel: CMAN: Cluster membership rejected
Oct 17 21:18:03 cweb92 kernel: CMAN: Waiting to join or form a Linux-cluster
Oct 17 21:18:03 cweb92 ccsd[2330]: Connected to cluster infrastruture via: 
CMAN/SM Plugin v1.1.7.1
Oct 17 21:18:03 cweb92 ccsd[2330]: Initial status:: Inquorate
Oct 17 21:18:06 cweb92 sshd(pam_unix)[3232]: session opened for user root by 
root(uid=0)
Oct 17 21:18:07 cweb92 kernel: CMAN: sending membership request
Oct 17 21:18:07 cweb92 ccsd[2330]: Cluster manager shutdown.  Attemping to 
reconnect...
Oct 17 21:18:07 cweb92 kernel: CMAN: Cluster membership rejected
Oct 17 21:18:07 cweb92 kernel: CMAN: Waiting to join or form a Linux-cluster
Oct 17 21:18:08 cweb92 kernel: CMAN: sending membership request
Oct 17 21:18:08 cweb92 kernel: CMAN: Cluster membership rejected
Oct 17 21:18:08 cweb92 kernel: CMAN: Waiting to join or form a Linux-cluster
Oct 17 21:18:08 cweb92 ccsd[2330]: Connected to cluster infrastruture via: 
CMAN/SM Plugin v1.1.7.1
Oct 17 21:18:08 cweb92 ccsd[2330]: Initial status:: Inquorate
Oct 17 21:18:12 cweb92 kernel: CMAN: sending membership request
Oct 17 21:18:12 cweb92 kernel: CMAN: Cluster membership rejected
Oct 17 21:18:12 cweb92 ccsd[2330]: Cluster manager shutdown.  Attemping to 
reconnect...
Oct 17 21:18:12 cweb92 kernel: CMAN: Waiting to join or form a Linux-cluster
Oct 17 21:18:13 cweb92 kernel: CMAN: sending membership request
Oct 17 21:18:13 cweb92 kernel: CMAN: Cluster membership rejected
Oct 17 21:18:13 cweb92 kernel: CMAN: Waiting to join or form a Linux-cluster
Oct 17 21:18:13 cweb92 ccsd[2330]: Connected to cluster infrastruture via: 
CMAN/SM Plugin v1.1.7.1
Oct 17 21:18:13 cweb92 ccsd[2330]: Initial status:: Inquorate
Oct 17 21:18:17 cweb92 kernel: CMAN: sending membership request
Oct 17 21:18:17 cweb92 kernel: CMAN: Cluster membership rejected
Oct 17 21:18:17 cweb92 ccsd[2330]: Cluster manager shutdown.  Attemping to 
reconnect...
Oct 17 21:18:17 cweb92 clvmd: Can't open cluster manager socket: Network is 
down
Oct 17 21:18:26 cweb92 ccsd[2330]: Unable to connect to cluster infrastructure 
after 11130 seconds.
Oct 17 21:18:56 cweb92 ccsd[2330]: Unable to connect to cluster infrastructure 
after 11160 seconds.

Mike

 
> Josef
> 
> On Tue, Oct 17, 2006 at 09:09:11PM -0500, isplist at logicore.net wrote:
>> After changing over to a McData FC switch, I cannot seem to start my
>> cluster
>> anymore. Can someone give me some input, ideas?
>> 
>> After loading all appropriate items;
>> 
>> [root at dev new]# cman_tool -t 30 join -w
>> Timed-out waiting for cluster
>> 
>> [root at dev new]# tail -20 /var/log/messages
>> Oct 17 20:59:00 dev ccsd[2537]: Connected to cluster infrastruture via:
>> CMAN/SM Plugin v1.1.7.1
>> Oct 17 20:59:00 dev ccsd[2537]: Initial status:: Inquorate
>> Oct 17 20:59:04 dev kernel: CMAN: sending membership request
>> Oct 17 20:59:04 dev kernel: CMAN: Cluster membership rejected
>> Oct 17 20:59:04 dev ccsd[2537]: Cluster manager shutdown.  Attemping to
>> reconnect...
>> Oct 17 20:59:25 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9660 seconds.
>> Oct 17 20:59:55 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9690 seconds.
>> Oct 17 21:00:25 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9720 seconds.
>> Oct 17 21:00:55 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9750 seconds.
>> Oct 17 21:01:25 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9780 seconds.
>> Oct 17 21:01:55 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9810 seconds.
>> Oct 17 21:02:25 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9840 seconds.
>> Oct 17 21:02:55 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9870 seconds.
>> Oct 17 21:03:26 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9900 seconds.
>> Oct 17 21:03:56 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9930 seconds.
>> Oct 17 21:04:26 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9960 seconds.
>> Oct 17 21:04:56 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 9990 seconds.
>> Oct 17 21:05:26 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 10020 seconds.
>> Oct 17 21:05:56 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 10050 seconds.
>> Oct 17 21:06:26 dev ccsd[2537]: Unable to connect to cluster
>> infrastructure
>> after 10080 seconds.
>> 
>> 
>> --
>> Linux-cluster mailing list
>> Linux-cluster at redhat.com
>> https://www.redhat.com/mailman/listinfo/linux-cluster