[Linux-cluster] cannot add 3rd node to running cluster

[Christine Caulfield]

On 31/12/09 16:13, Terry wrote:
> On Wed, Dec 30, 2009 at 10:13 AM, Terry<td3201 at gmail.com>  wrote:
>> On Tue, Dec 29, 2009 at 5:20 PM, Jason W.<jwellband at gmail.com>  wrote:
>>> On Tue, Dec 29, 2009 at 2:30 PM, Terry<td3201 at gmail.com>  wrote:
>>>> Hello,
>>>>
>>>> I have a working 2 node cluster that I am trying to add a third node
>>>> to.   I am trying to use Red Hat's conga (luci) to add the node in but
>>>
>>> If you have two node cluster with two_node=1 in cluster.conf - such as
>>> two nodes with no quorum device to break a tie - you'll need to bring
>>> the cluster down, change two_node to 0 on both nodes (and rev the
>>> cluster version at the top of cluster.conf), bring the cluster up and
>>> then add the third node.
>>>
>>> For troubleshooting any cluster issue, take a look at syslog
>>> (/var/log/messages by default). It can help to watch it on a
>>> centralized syslog server that all of your nodes forward logs to.
>>>
>>> --
>>> HTH, YMMV, HANW :)
>>>
>>> Jason
>>>
>>> The path to enlightenment is /usr/bin/enlightenment.
>>
>> Thank you for the response.  /var/log/messages doesn't have any
>> errors.  It says cman started then says can't connect to cluster
>> infrastructure after a few seconds.  My cluster does not have the
>> two_node=1 config now.  Conga took that out for me.  That bit me last
>> night because I needed to put that back in.
>>
>
> CMAN still will not start and gives no debug information.  Anyone know
> why cman_tool -d join would not print any output at all?
> Troubleshooting this is kind of a nightmare.  I verified that two_node
> is not in play.


If cman_tool join -d doesn't produce any output then the most likely 
problem is a mismatch between the cman and openais versions. Because 
cman is a configuration module for openais it loads very early in the 
initialisation sequence.

If you are sure the versions are right (ie they match those on the 
running nodes of the cluster) then do

# strace -f cman_tool join -d


and post the results here and I'll have a look for you.

Chrisie