[Linux-cluster] [Q] Good documentation about command line interface??

Hiroyuki Sato hiroysato at gmail.com
Sun May 29 10:14:41 UTC 2011


Hello Digimer.

Thank you for your information.

This is the document that I'm looking for!!.
This doc is very very usuful. Thanks!!.


I want to ask one thing.

Please take a look my cluster configration again.

Mainly I want to use GNBD on gfs_clientX.
GNBD server is gfs2, and gfs3.

And gfs_client's hardwhere does not support IPMI, iLO...,
Because That machine is Desktop computers.

And no APC like UPS.

The desktop machine is just support Wake On LAN.

What fence device should I use??
I'm thinking fence_wake_on_lan is proper fence device.
but that is nothing..

Thank you for your advice.

<?xml version="1.0"?>
<cluster name="arch_gfs1" config_version="21">
  <clusternodes>
    <clusternode name="gfs1.archsystem.com" votes="1" nodeid="5">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs1.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs2.archsystem.com" votes="1" nodeid="6">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs2.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs3.archsystem.com" votes="1" nodeid="7">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs3.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client1.archsystem.com" votes="1" nodeid="21">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client1.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client2.archsystem.com" votes="1" nodeid="22">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client2.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client3.archsystem.com" votes="1" nodeid="23">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client3.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client4.archsystem.com" votes="1" nodeid="24">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client4.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client5.archsystem.com" votes="1" nodeid="25">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client5.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client6.archsystem.com" votes="1" nodeid="26">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client6.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client7.archsystem.com" votes="1" nodeid="27">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client7.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client8.archsystem.com" votes="1" nodeid="28">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client8.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client9.archsystem.com" votes="1" nodeid="29">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client9.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="gfs_client10.archsystem.com" votes="1" nodeid="30">
      <fence>
        <method name="single">
          <device name="manual" nodename="gfs_client10.archsystem.com"/>
        </method>
      </fence>
    </clusternode>
  </clusternodes>
  <fencedevices>
    <fencedevice name="manual" agent="fence_manual"/>
  </fencedevices>
  <rm>
    <failoverdomains/>
    <resources/>
  </rm>
</cluster>





Regards.


2011/5/29 Digimer <linux at alteeve.com>:
> On 05/28/2011 08:39 AM, Hiroyuki Sato wrote:
>>
>> Dear members.
>>
>> I'm newbie Red Hat cluster.
>
> Welcome!
>
>> Could you point me to good documentation about command line interface??
>
>>   ( cman_tool, css_tool, ccs_test, fence_ack_manual ..)
>
> The man pages for these tools are well documented.
>
>>  fence_ack_manual
>
> <Digimer rolls up her sleeves and grabs her you-need-a-real-fence-device
> bat>
>
> This is not supported in any way, shape or form. You *must* use a proper
> fence device. Do your servers have IPMI (or OEM version like DRAC, iLO,
> etc?).
>
> Please read this:
>
> http://wiki.alteeve.com/index.php/Red_Hat_Cluster_Service_2_Tutorial#Concept.3B_Virtual_Synchrony
>
> Specifically; "Concept; Virtual Synchrony" and "Concept; Fencing"
>
>> Especially the following topics.
>>
>>   * How to rejoin to node.
>>   * How to leave from node.
>
> Starting and stopping the cman service will cause the node to join and
> leave, respectively. You can do it manually if you wish, please check the
> man pages.
>
>>   * How to use fence_ack_manual
>
> Again, you can't. It is not supported.
>
>>   * How to manage cluster with command line tools.
>
> ccs_tool is the main program to look at.
>
>> One of my problem is here.
>>
>> The status of gfs3 which in my test cluster is JOIN_STOP_WAIT.
>> I don't know how to re-join it.
>>
>> # /usr/sbin/cman_tool services
>> type             level name     id       state
>> fence            0     default  00000000 JOIN_STOP_WAIT
>
> Without a working fence device, the cluster will block forever. As far as I
> know, once a fence call has been issued, there is nothing that can be done
> to abort it. I'd suggest pulling the power on the node, boot it cleanly and
> start cman.
>
>> I found a keyword 'fenced_override'. This file. should be named pipe.
>> Howevre I can't find that file in /var/run/cluter directory in my
>> clusters.
>> fenced working on all of clusters.
>
> Again, it's not supported.
>
>> Sincerely.
>>
>>
>> * Environment
>>
>>   CentOS 5.6
>>
>>
>> * Configurations
>>
>> <?xml version="1.0"?>
>> <cluster name="arch_gfs1" config_version="21">
>>   <cman expected_votes="1">
>
> This is wrong, 'expected_votes' is the number of nodes in the cluster (plus
> qdisk votes, if you are using it).
>
>>   </cman>
>>   <clusternodes>
>>     <clusternode name="gfs1.doma.in" votes="1" nodeid="5">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs1.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs2.doma.in" votes="1" nodeid="6">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs2.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs3.doma.in" votes="1" nodeid="7">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs3.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client1.doma.in" votes="1" nodeid="21">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client1.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client2.doma.in" votes="1" nodeid="22">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client2.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client3.doma.in" votes="1" nodeid="23">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client3.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client4.doma.in" votes="1" nodeid="24">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client4.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client5.doma.in" votes="1" nodeid="25">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client5.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client6.doma.in" votes="1" nodeid="26">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client6.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client7.doma.in" votes="1" nodeid="27">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client7.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client8.doma.in" votes="1" nodeid="28">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client8.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client9.doma.in" votes="1" nodeid="29">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client9.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>     <clusternode name="gfs_client10.doma.in" votes="1" nodeid="30">
>>       <fence>
>>         <method name="single">
>>           <device name="manual" nodename="gfs_client10.doma.in"/>
>>         </method>
>>       </fence>
>>     </clusternode>
>>   </clusternodes>
>>   <fencedevices>
>>     <fencedevice name="manual" agent="fence_manual"/>
>>   </fencedevices>
>>   <rm>
>>     <failoverdomains/>
>>     <resources/>
>>   </rm>
>> </cluster>
>
> If you are on IRC, join #linux-cluster, it is also a great place to get
> help. I am usually there and will be happy to help you get a) fencing
> working and b) get the rest working.
>
> Welcome to clustering! :)
>
> --
> Digimer
> E-Mail: digimer at alteeve.com
> AN!Whitepapers: http://alteeve.com
> Node Assassin:  http://nodeassassin.org
> "I feel confined, only free to expand myself within boundaries."
>



-- 
Hiroyuki Sato




More information about the Linux-cluster mailing list