<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv=Content-Type content="text/html; charset=us-ascii"> <meta name=Generator content="Microsoft Word 11 (filtered medium)"> <style>  </style>  </head> <body lang=EN-US link=blue vlink=purple> <div class=Section1> I have two nodes on the same subnet, can ping each other, are both alive, both are members of a two-node cluster. When I start cman on both nodes at the same time it says “X not a cluster member after 60 sec post_join_delay”. The output of clustat shows that the other node is “Offline” and the first node is “Online, local”. The nodes are fencing each other and powering each other off. <o:p></o:p> <o:p> </o:p> Please help determine why I cannot get these nodes to join. Below is some information from my systems. RedHat Support is not getting anywhere. <o:p></o:p> <o:p> </o:p> Thanks<o:p></o:p> <o:p> </o:p> ----------------------------------<o:p></o:p> <o:p> </o:p> Node1: bplmft11<o:p></o:p> Node2: bplmft12<o:p></o:p> <o:p> </o:p> uname –a -> Linux bplmft11 2.6.18-8.1.10.el5 #1 SMP Thu Aug 30 20:43:28 EDT 2007 x86_64 x86_64 x86_64 GNU/Linux<o:p></o:p> <o:p> </o:p> [root@bplmft11 ~]# clustat<o:p></o:p> msg_open: No such file or directory<o:p></o:p> Member Status: Quorate<o:p></o:p> <o:p> </o:p> Member Name ID Status<o:p></o:p> ------ ---- ---- ------<o:p></o:p> bplmft12 1 Offline<o:p></o:p> bplmft11 2 Online, Local<o:p></o:p> <o:p> </o:p> <o:p> </o:p> /etc/cluster/cluster.conf file (with the fencing levels removed):<o:p></o:p> <o:p> </o:p> <?xml version="1.0" ?><o:p></o:p> <cluster alias="plm_test" config_version="16" name="plm_test"><o:p></o:p> <fence_daemon post_fail_delay="0" post_join_delay="60"/><o:p></o:p> <clusternodes><o:p></o:p> <clusternode name="bplmft12" nodeid="1" votes="1"><o:p></o:p> <fence><o:p></o:p> <method name="1"/><o:p></o:p> </fence><o:p></o:p> </clusternode><o:p></o:p> <clusternode name="bplmft11" nodeid="2" votes="1"><o:p></o:p> <fence><o:p></o:p> <method name="1"/><o:p></o:p> </fence><o:p></o:p> </clusternode><o:p></o:p> </clusternodes><o:p></o:p> <cman expected_votes="1" two_node="1"/><o:p></o:p> <fencedevices><o:p></o:p> <fencedevice agent="fence_ilo" hostname="ilo-bplmft12" login="redhat_cluster_user" name="ilo-bplmft12" passwd="PASSWORD"/><o:p></o:p> <fencedevice agent="fence_ilo" hostname="ilo-bplmft11" login="redhat_cluster_user" name="ilo-bplmft11" passwd="PASSWORD"/><o:p></o:p> </fencedevices><o:p></o:p> <rm><o:p></o:p> <failoverdomains/><o:p></o:p> <resources/><o:p></o:p> </rm><o:p></o:p> </cluster><o:p></o:p> <o:p> </o:p> <o:p> </o:p> /var/log/messages after doing a “service cman start” on both nodes:<o:p></o:p> <o:p> </o:p> ep 26 13:33:04 bplmft11 ccsd[31407]: Cluster is not quorate. Refusing connection.<o:p></o:p> Sep 26 13:33:04 bplmft11 ccsd[31407]: Error while processing connect: Connection refused<o:p></o:p> Sep 26 13:33:04 bplmft11 ccsd[31407]: Initial status:: Quorate<o:p></o:p> Sep 26 13:33:10 bplmft11 snmpd[2616]: Connection from UDP: [127.0.0.1]:32771<o:p></o:p> Sep 26 13:33:10 bplmft11 snmpd[2616]: Received SNMP packet(s) from UDP: [127.0.0.1]:32771<o:p></o:p> Sep 26 13:33:25 bplmft11 snmpd[2616]: Connection from UDP: [127.0.0.1]:32771<o:p></o:p> Sep 26 13:33:55 bplmft11 last message repeated 2 times<o:p></o:p> Sep 26 13:34:06 bplmft11 fenced[31436]: bplmft12 not a cluster member after 60 sec post_join_delay<o:p></o:p> Sep 26 13:34:06 bplmft11 fenced[31436]: fencing node "bplmft12"<o:p></o:p> Sep 26 13:34:06 bplmft11 fenced[31436]: fence "bplmft12" failed<o:p></o:p> </div> </body> </html> <HTML><BODY><hr size=1> This message is intended only for the individual or entity to which it is addressed and contains information that is proprietary to The Babcock & Wilcox Company and/or its affiliates, or may be otherwise confidential. If the reader of this message is not the intended recipient, or the employee agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify the sender immediately by return e-mail and delete this message from your computer. Thank you. </BODY></HTML>