[Linux-cluster] Add a fence device of type SUN ILOM

Brieseneck, Arne, VF-Group Arne.Brieseneck at vodafone.com
Tue Aug 21 13:03:00 UTC 2007


Hi*,

I have tried to set up this configfile here:

                <clusternode name="box1" nodeid="1" votes="1">
                        <multicast addr="224.0.0.1" interface="eth0"/>
                        <fence>
                                <method name="1">
                                        <device name="box1_IPMI"/>
                                </method>
                                <method name="2">
                                        <device name="manual" nodename="box1"/>
                                </method>
                        </fence>
                </clusternode>
                <clusternode name="box2" nodeid="2" votes="1">
                        <multicast addr="224.0.0.1" interface="eth0"/>
                        <fence>
                                <method name="1">
                                        <device name="box2_IPMI"/>
                                </method>
                                <method name="2">
                                        <device name="manual" nodename="box2"/>
                                </method>
                        </fence>
                </clusternode>
                <clusternode name="box3" nodeid="3" votes="1">
                        <multicast addr="224.0.0.1" interface="eth0"/>
                        <fence>
                                <method name="1">
                                        <device name="box3_IPMI"/>
                                </method>
                                <method name="2">
                                        <device name="manual" nodename="box3"/>
                                </method>
                        </fence>
                </clusternode>
                <clusternode name="box4" nodeid="4" votes="1">
                        <multicast addr="224.0.0.1" interface="eth0"/>
                        <fence>
                                <method name="1">
                                        <device name="box4_IPMI"/>
                                </method>
                                <method name="2">
                                        <device name="manual" nodename="box4"/>
                                </method>
                        </fence>
                </clusternode>
        </clusternodes>
        <fencedevices>
                <fencedevice agent="fence_ipmilan" auth="none" ipaddr="10.0.0.2" login="power" name="box1_IPMI" passwd="powerpower"/>
                <fencedevice agent="fence_ipmilan" auth="none" ipaddr="10.0.0.3" login="power" name="box2_IPMI" passwd="powerpower"/>
                <fencedevice agent="fence_ipmilan" auth="none" ipaddr="10.0.0.4" login="power" name="box3_IPMI" passwd="powerpower"/>
                <fencedevice agent="fence_ipmilan" auth="none" ipaddr="10.0.0.5" login="power" name="box4_IPMI" passwd="powerpower"/>
                <fencedevice agent="fence_manual" name="manual"/>
        </fencedevices>
        <rm>
                <failoverdomains/>
                <resources>
                        <ip address="192.168.50.6" monitor_link="1"/>
                </resources>
        </rm>
</cluster>





The cluster is coming up without errors. But when I shutdown the network on one node nothing happens. The only message I get is 

dlm: closing connection to node 4 

On node 2 and 3.


Any suggestions?
Is there a timeout I have to wait for?

Why I can not ping my cluster address 192.168.50.6????
-----Original Message-----
From: linux-cluster-bounces at redhat.com [mailto:linux-cluster-bounces at redhat.com] On Behalf Of brad at bradandkim.net
Sent: Montag, 13. August 2007 18:25
To: linux clustering
Subject: RE: [Linux-cluster] Add a fence device of type SUN ILOM


>
> Dear list members,
>
> If I understand well, here are the steps I have to follow to configure 
> a fence device that will use SUN ILOM interface :
>
> 1. Ensure that OpenIPMI and OpenIPMI-tools packages are installed on 
> the cluster nodes.
> 2. With system-config-cluster tool, add a new fence device of type 
> "IPMI Lan". Fill the form with the ILOM IP address, the name of the 
> administrator user and his password. Then associate the fence device 
> with the cluster node.
> 3. Repeat the step above for the SUN ILOM interface of each node.
> 4. Send the new configuration to the cluster 5. That's all and 
> everything will be handle correctly by the cluster.
>
> Am I ok?
>
> Best regards
> __________________
>
> Stephanie Lanthier
>
> Analyste de l'informatique
> Universite du Quebec a Montreal
> Service de l'informatique et des telecommunications 
> lanthier.stephanie at uqam.ca Téléphone : 514-987-3000 poste 6106 Bureau 
> : PK-M535
>
>
>
>
>
>
> ------------------------------
>
> Message: 13
> Date: Fri, 10 Aug 2007 14:21:31 -0500 (CDT)
> From: brad at bradandkim.net
> Subject: Re: [Linux-cluster] Add a fence device of type SUN ILOM
> To: "linux clustering" <linux-cluster at redhat.com>
> Message-ID:
> 	<56032.129.237.174.144.1186773691.squirrel at webmail.bradandkim.net>
> Content-Type: text/plain;charset=iso-8859-1
>
>
>> brad at bradandkim.net wrote:
>>
>>>>brad at bradandkim.net wrote:
>>>>
>>>>
>>>>>>Quentin Arce wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>>>>My machines are SUN Fire X4100. I see that we can define a 
>>>>>>>>>fence device of type HP ILO. I would like to know if I can use 
>>>>>>>>>the HP  ILO form in system-config-cluster tool to enter and use 
>>>>>>>>>a SUN ILOM as fence device?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>How does ILOM work? telnet or ssh? Is there an snmp interface to 
>>>>>>>>ILOM?
>>>>>>>>If so, there might be a way...by hacking on another agent.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>So, I'm a lurker on this list as I no longer have a cluster up...
>>>>>>> but
>>>>>>>I work on ILOM and I would love to see this work.  This isn't  
>>>>>>>official support, I'm a developer not a customer support person.  
>>>>>>>So, it's  more on my time.  If there is anything I can do... 
>>>>>>>Please let me know.
>>>>>>>Questions on this problem, regarding what ILOM can / can't do, 
>>>>>>>how  to check state of the server via ILOM, etc.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>Quentin! That is very kind of you. If you help with the ILOM  
>>>>>>protocol, I'll help with the agent/script. This thread could form 
>>>>>>a document on how to write an arbitrary fence agent for use with 
>>>>>>rhcs.
>>>>>>
>>>>>>Where is documentation available? Generally, three things are 
>>>>>>needed from a baseboard management device in order to use it for 
>>>>>>fencing: 1)  A way to shut the system down, 2) a way to power the 
>>>>>>system up, and 3)  a way to check if it is up or down.
>>>>>>
>>>>>>What means can a script use to communicate with the ILOM card? Are 
>>>>>>there big delta's in the protocol between different ILOM versions?
>>>>>>
>>>>>>I look forward to hearing from you.
>>>>>>
>>>>>>-J
>>>>>>
>>>>>>
>>>>>>
>>>>>I am interested in seeing this thread play out as well since I have 
>>>>>26 SUN servers I am beginning to cluster.  My question is why use 
>>>>>SNMP over IPMI v2.0.  I can do the above three things with:
>>>>>
>>>>>/usr/bin/ipmitool -U <user> -P <password> -H <ilom IP> chassis 
>>>>>power  off /usr/bin/ipmitool -U <user> -P <password> -H <ilom IP> 
>>>>>chassis power  on /usr/bin/ipmitool -U <user> -P <password> -H 
>>>>><ilom IP> chassis power status
>>>>>
>>>>>I don't need any MIB's for this either.  It seems to me this might 
>>>>>be  an easier solution than snmp, but I may be missing something.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>Oh make sure you are using lanplus mode for this.
>>>>
>>>>
>>>>
>>>
>>>Will do, and thanks.
>>>
>>>
>> That is a nice solution. There is a fence_ipmilan agent in the red 
>> hat cluster distibution...how are you invoking the above for fencing?  
>> To check if the rh agent works, here is the command line you would 
>> use (it installs into /sbin...):
>>
>> /sbin/fence_ipmilan -a <ilom IP> -l <user> -p <password> -P -o 
>> [off,on,reboot,status]
>>
>> There is a man page for fence_ipmilan that details some extra params.
>>
>> Well, I guess that solves the issue...if anyone would use an 
>> snmp-based ILOM agent, we could talk about how to construct 
>> that...otherwise, so much for my idea of this thread being 
>> instructions for creating arbitrary agents! ;)
>>
>> -J
>>
>
> I just tested it and it seems to work perfectly.  Sorry for bringing 
> the thread to a premature end  :)
>
> Brad Crotchett
> brad at bradandkim.net
> http://www.bradandkim.net
>
>
> --
> Linux-cluster mailing list
> Linux-cluster at redhat.com
> https://www.redhat.com/mailman/listinfo/linux-cluster
>

I believe that will do it.  I just tested shutting down the network interfaces on one node and fenced successfully used the ipmilan fencing agent to reboot the node.

Brad Crotchett
brad at bradandkim.net
http://www.bradandkim.net

--
Linux-cluster mailing list
Linux-cluster at redhat.com
https://www.redhat.com/mailman/listinfo/linux-cluster




More information about the Linux-cluster mailing list