[Linux-cluster] Two nodes don't see each other

[Larvoire, Jean-Francois]

Hello,

I'm experimenting with a 2-nodes cluster, based on RHEL4.
The goal is to manage a service failover, I don't need GFS for now.
I think the following packages are sufficient:

ccs           Manage the cluster configuration file
cman          Symmetric Cluster Manager
cman-kernel   Back end behind cman
dlm           Distributed Lock Manager
dlm-kernel    Back end behind dlm
fence         Power control
magma         cluster-abstraction library
magma-plugins Maybe we need the sm plugin?

Is this correct?

Anyway I've built and installed these 1.01 packages on the two nodes.
But when I start the cluster, both nodes seem to think they're the only node in town.
Any clue welcome!


# Startup procedure I used on both nodes:
depmod -a
modprobe cman
modprobe dlm
ccsd
cman_tool join

# What node 1 sees:
[root at eiros3 ~]# cman_tool status
Protocol version: 5.0.1
Config version: 2
Cluster name: eiros
Cluster ID: 3249
Cluster Member: Yes
Membership state: Cluster-Member
Nodes: 1
Expected_votes: 1
Total_votes: 1
Quorum: 1
Active subsystems: 0
Node name: eiros3
Node addresses: 192.168.8.73
[root at eiros3 ~]# cman_tool nodes
Node  Votes Exp Sts  Name
   1    1    1   M   eiros3

# What node 2 sees:
[root at eiros4 ~]# cman_tool status
Protocol version: 5.0.1
Config version: 2
Cluster name: eiros
Cluster ID: 3249
Cluster Member: Yes
Membership state: Cluster-Member
Nodes: 1
Expected_votes: 1
Total_votes: 1
Quorum: 1
Active subsystems: 0
Node name: eiros4
Node addresses: 192.168.8.74
[root at eiros4 ~]# cman_tool nodes
Node  Votes Exp Sts  Name
   2    1    1   M   eiros4

# Here's the cluster.conf file:
<?xml version="1.0"?>
<cluster name="eiros" config_version="2">
  <fencedevices>
    <fencedevice name="eiros3-ilo" agent="fence_ilo"
      hostname="eiros3-mp" login="login" passwd="passwd"/>
    <fencedevice name="eiros4-ilo" agent="fence_ilo"
      hostname="eiros4-mp" login="login" passwd="passwd"/>
    <fencedevice name="last_resort" agent="fence_manual"/>
  </fencedevices>

  <clusternodes>
    <clusternode name="eiros3" nodeid="1" votes="1">
      <fence>
        <!-- "power" method is tried before all others -->
        <method name="power">
          <device name="eiros3-ilo"/>
        </method>
        <method name="human">
          <device name="last_resort" ipaddr="eiros3"/>
        </method>
      </fence>
    </clusternode>

    <clusternode name="eiros4" nodeid="2" votes="1">
      <fence>
        <!-- "power" method is tried before all others -->
        <method name="power">
          <device name="eiros4-ilo"/>
        </method>
        <method name="human">
          <device name="last_resort" ipaddr="eiros4"/>
        </method>
      </fence>
    </clusternode>
  </clusternodes>

  <!-- 2-nodes clusters need this special quorum adjustment -->
  <cman port="6809"
    two_node="1" expected_votes="1">
  </cman>
</cluster>

========================================================================
= Jean-François Larvoire                 =========   _/      ===========
= Hewlett-Packard                        =======    _/           =======
= 5 Avenue Raymond Chanas, Eybens        =====     _/_/_/  _/_/_/  =====
= 38053 Grenoble Cedex 9, FRANCE         =====    _/  _/  _/  _/   =====
= Phone: +33 476 14 13 38                =====   _/  _/  _/_/_/    =====
= Fax:   +33 476 14 45 19                =======        _/       =======
= Email: jean-francois.larvoire at hp.com   ==========    _/     ==========
========================================================================