[Linux-cluster] Basic Clustering Help

Tristram Cheer tristram at ubernet.co.nz
Sun Dec 18 21:07:49 UTC 2005

Good Morning All,

We are trialing XEN/GFS in a dev network before moving it to a live 
server base, the following outlines what we are doing and what we are 
tring to achive

We have 4 physical Server, 1 of which has a 50gb Raid5 Array we wish to 
export via GNBD, this is a simple scsi array and is not shared storage.
On top of this we have 8 "Xen Virtual Servers" They all need shared 
access to this 50gb Array and have block level access via GNBD.

Right now the cluster is running as shown by

/root at chessmaster:~# cat /proc/cluster/status
Protocol version: 5.0.1
Config version: 3
Cluster name: ubernet
Cluster ID: 13910
Cluster Member: Yes
Membership state: Cluster-Member
Nodes: 5
Expected_votes: 5
Total_votes: 5
Quorum: 3
Active subsystems: 1
Node name: chessmaster
Node addresses: 202.xxx.132.12/

This is done by booting up all machines then doing the following in 
order on all of them
cman_tool join -w
/etc/init.d/gnbd-client restart/

On the server with the 50gb array i also run

//etc/init.d/gnbd-server restart/

This allows me to see /dev/gnbd/50gb on all 8 servers, I then ran

/gfs_mkfs -p lock_dlm -t ubernet:50gbFS -j 10 /dev/gnbd/50gb/

Which completed fine, however attempting to mount it is proving tricky, 
when i try and do the following

/ mount -t gfs /dev/gnbd/50gb /users//

I get

/mount: permission denied/

and in /var/log/messages i see

/Dec 19 09:58:16 asimov kernel: Lock_Harness <CVS> (built Dec 17 2005 
13:55:10) installed
Dec 19 09:58:16 asimov kernel: GFS <CVS> (built Dec 17 2005 13:56:56) 
Dec 19 09:58:16 asimov kernel: GFS: Trying to join cluster "lock_dlm", 
Dec 19 09:58:16 asimov kernel: Lock_DLM (built Dec 17 2005 13:56:21) 
Dec 19 09:58:16 asimov kernel: lock_dlm: fence domain not found; check 
Dec 19 09:58:16 asimov kernel: GFS: can't mount proto = lock_dlm, table 
= ubernet:50gbFS, hostdata =
when i try and run fence_tool join -w i get this

/fenced: local cman node name "asimov" not found in cluster.conf/

Is anyone able to point me in the right direction, i really need to get 
this dev network runnning asap.All we need is a basic GFS system so that 
all our servers can access user's e-mails no matter what server they 
connect to. Nothing fancy or full blown cluster, just a Shared Filesystem.
Here is my cluster.conf file

<?xml version="1.0" ?>
<cluster config_version="3" name="ubernet">
        <fence_daemon clean_start="1" post_fail_delay="0" 
                <clusternode name="chessmaster.ubernet.co.nz" votes="1">
                                <method name="1">
ipaddress="202.XXX.132.12" name="gnbd"/>
                <clusternode name="asimov.ubernet.co.nz" votes="1">
                                <method name="1">
ipaddress="202.XXX.132.2" name="gnbd"/>
                <clusternode name="abdul.ubernet.co.nz" votes="1">
                                <method name="1">
ipaddress="202.XXX.132.3" name="gnbd"/>
                <clusternode name="faye.ubernet.co.nz" votes="1">
                                <method name="1">
ipaddress="202.XXX.132.4" name="gnbd"/>
                <clusternode name="maria.ubernet.co.nz" votes="1">
                                <method name="1">
ipaddress="202.XXX.132.5" name="gnbd"/>
                <fencedevice agent="fence_gnbd" name="gnbd" 


Tristram Cheer

More information about the Linux-cluster mailing list