<html><head><style type="text/css"></style></head><body><div style="font-family:times new roman, new york, times, serif;font-size:12pt"><DIV>I have two node cluster .</DIV> <DIV> </DIV> <DIV> </DIV> <DIV>/etc/cluster/cluster.conf</DIV> <DIV> </DIV> <DIV> <?xml version="1.0"?><BR><cluster alias="saza" config_version="38" name="saza"><BR> <fence_daemon post_fail_delay="0" post_join_delay="3"/><BR> <clusternodes><BR> <clusternode name="node1.network.com" nodeid="1" votes="1"><BR> <fence/><BR> </clusternode><BR> <clusternode name="node2.network.com" nodeid="2" votes="1"><BR> <fence/><BR> </clusternode><BR> </clusternodes><BR> <cman expected_votes="1" two_node="1"/><BR> <fencedevices/><BR> <rm><BR> <failoverdomains><BR> <failoverdomain name="cenall" ordered="1" restricted="1"><BR> <failoverdomainnode name="node1.network.com" priority="1"/><BR> <failoverdomainnode name="node2.network.com" priority="1"/><BR> </failoverdomain><BR> </failoverdomains><BR> <resources><BR> <script file="/etc/init.d/httpd" name="httpd"/><BR> <fs device="/dev/sda3" force_fsck="0" force_unmount="0" fsid="6443" fstype="ext3" mountpoint="/var/www/html" name="httpd-content" options="" self_fence="0"/><BR> <ip address="10.28.99.81" monitor_link="1"/><BR> </resources><BR> <service autostart="1" domain="cenall" name="webserver"><BR> <script ref="httpd"/><BR> <fs ref="httpd-content"/><BR> <ip ref="10.28.99.81"/><BR> </service><BR> </rm><BR></cluster></DIV> <DIV> </DIV> <DIV>when i restart network on node2. </DIV> <DIV>service network shutdown</DIV> <DIV>service network start.</DIV> <DIV> </DIV> <DIV>and then</DIV> <DIV> </DIV> <DIV>on node2</DIV> <DIV>i can't start cman .</DIV> <DIV> </DIV> <DIV>start fencing ... failed</DIV> <DIV> </DIV> <DIV>Message log on node2</DIV> <DIV> </DIV> <DIV><BR>openais[22433]: [SYNC ] Not using a virtual synchrony filter. <BR>Jan 12 02:05:02 clus2 groupd[22442]: found uncontrolled kernel object rgmanager in /sys/kernel/dlm<BR>Jan 12 02:05:02 clus2 openais[22433]: [TOTEM] Creating commit token because I am the rep. <BR>Jan 12 02:05:02 clus2 groupd[22442]: local node must be reset to clear 1 uncontrolled instances of gfs and/or dlm<BR>Jan 12 02:05:02 clus2 openais[22433]: [TOTEM] Saving state aru 0 high seq received 0 <BR>Jan 12 02:05:02 clus2 fence_node[22467]: Fence of "node2.network.com" was unsuccessful <BR>Jan 12 02:05:02 clus2 openais[22433]: [TOTEM] entering COMMIT state. <BR>Jan 12 02:05:02 clus2 gfs_controld[22460]: groupd_dispatch error -1 errno 104<BR>Jan 12 02:05:02 clus2 dlm_controld[22454]: groupd is down, exiting<BR>Jan 12 02:05:02 clus2 fenced[22448]: groupd is down, exiting<BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] entering RECOVERY state. <BR>Jan 12 02:05:03 clus2 gfs_controld[22460]: groupd connection died<BR>Jan 12 02:05:03 clus2 kernel: dlm: closing connection to node 2<BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] position [0] member 192.168.100.2: <BR>Jan 12 02:05:03 clus2 gfs_controld[22460]: cluster is down, exiting<BR>Jan 12 02:05:03 clus2 kernel: dlm: closing connection to node 1<BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] previous ring seq 0 rep 192.168.100.2 <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] aru 0 high delivered 0 received flag 0 <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] Did not need to originate any messages in recovery. <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] Storing new sequence id for ring 4 <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] Sending initial ORF token <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] CLM CONFIGURATION CHANGE <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] New Configuration: <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] Members Left: <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] Members Joined: <BR>Jan 12 02:05:03 clus2 openais[22433]: [SYNC ] This node is within the primary component and will provide service. <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] CLM CONFIGURATION CHANGE <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] New Configuration: <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] r(0) ip(192.168.100.2) <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] Members Left: <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] Members Joined: <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] r(0) ip(192.168.100.2) <BR>Jan 12 02:05:03 clus2 openais[22433]: [SYNC ] This node is within the primary component and will provide service. <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] entering OPERATIONAL state. <BR>Jan 12 02:05:03 clus2 openais[22433]: [CMAN ] quorum regained, resuming activity <BR>Jan 12 02:05:03 clus2 openais[22433]: [CLM ] got nodejoin message 192.168.100.2 <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] entering GATHER state from 11. <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] Saving state aru 9 high seq received 9 <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] entering COMMIT state. <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] entering RECOVERY state. <BR>Jan 12 02:05:03 clus2 openais[22433]: [TOTEM] position [0] member 192.168.100.1: <BR>Jan 12 02:05:04 clus2 openais[22433]: [TOTEM] previous ring seq 132 rep 192.168.100.1 <BR>Jan 12 02:05:04 clus2 openais[22433]: [TOTEM] aru c high delivered c received flag 0 <BR>Jan 12 02:05:04 clus2 openais[22433]: [TOTEM] position [1] member 192.168.100.2: <BR>Jan 12 02:05:04 clus2 openais[22433]: [TOTEM] previous ring seq 4 rep 192.168.100.2 <BR>Jan 12 02:05:04 clus2 openais[22433]: [TOTEM] aru 9 high delivered 9 received flag 0 <BR>Jan 12 02:05:04 clus2 openais[22433]: [TOTEM] Did not need to originate any messages in recovery. <BR>Jan 12 02:05:04 clus2 openais[22433]: [TOTEM] Storing new sequence id for ring 88 <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] CLM CONFIGURATION CHANGE <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] New Configuration: <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] r(0) ip(192.168.100.2) <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] Members Left: <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] Members Joined: <BR>Jan 12 02:05:04 clus2 openais[22433]: [SYNC ] This node is within the primary component and will provide service. <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] CLM CONFIGURATION CHANGE <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] New Configuration: <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] r(0) ip(192.168.100.1) <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] r(0) ip(192.168.100.2) <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] Members Left: <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] Members Joined: <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] r(0) ip(192.168.100.1) <BR>Jan 12 02:05:04 clus2 openais[22433]: [SYNC ] This node is within the primary component and will provide service. <BR>Jan 12 02:05:04 clus2 openais[22433]: [TOTEM] entering OPERATIONAL state. <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] got nodejoin message 192.168.100.1 <BR>Jan 12 02:05:04 clus2 openais[22433]: [CLM ] got nodejoin message 192.168.100.2 <BR>Jan 12 02:05:04 clus2 openais[22433]: [CPG ] got joinlist message from node 1 <BR>Jan 12 02:05:04 clus2 openais[22433]: [CMAN ] cman killed by node 2 for reason 2 <BR>Jan 12 02:05:32 clus2 ccsd[22427]: Unable to connect to cluster infrastructure after 30 seconds. </DIV> <DIV> </DIV> <DIV> </DIV> <DIV>but on node1 can restart cman. but message log show </DIV> <DIV>fence node2.network.com failed.</DIV> <DIV> </DIV> <DIV>how to join member again ?</DIV></div><br> <hr size=1>Be a better friend, newshound, and know-it-all with Yahoo! Mobile. <a href="http://us.rd.yahoo.com/evt=51733/*http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ "> Try it now.</a></body></html>