<div dir="ltr">Thank you for the reply...<div>but i am new to cluster configuration but both node were running fine before reboot.</div><div><br></div><div>Can u guide how to configure a fence device in this server. will be highly appreciated .</div><div><br></div><div>Thanks,</div><div>Shreekanta Jena </div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Mar 5, 2016 at 11:48 PM, Digimer <span dir="ltr"><<a href="mailto:lists@alteeve.ca" target="_blank">lists@alteeve.ca</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Working fencing is required. The rgmanager component waits for a<br>
successful fence message before beginning recovery (to prevent<br>
split-brains).<br>
<div><div class="h5"><br>
On 05/03/16 04:47 AM, Shreekant Jena wrote:<br>
> secondary node<br>
><br>
> --------------------------------------<br>
> [root@Node2 ~]# cat /etc/cluster/cluster.conf<br>
> <?xml version="1.0"?><br>
> <cluster alias="IVRS_DB" config_version="166" name="IVRS_DB"><br>
>         <fence_daemon clean_start="0" post_fail_delay="0"<br>
> post_join_delay="3"/><br>
>         <clusternodes><br>
>                 <clusternode name="Node1" nodeid="1" votes="1"><br>
>                         <fence/><br>
>                 </clusternode><br>
>                 <clusternode name="Node2" nodeid="2" votes="1"><br>
>                         <fence/><br>
>                 </clusternode><br>
>         </clusternodes><br>
>         <cman expected_votes="1" two_node="1"/><br>
>         <fencedevices/><br>
>         <rm><br>
>                 <failoverdomains><br>
>                         <failoverdomain name="Package1" ordered="1"<br>
> restricted="1"><br>
>                                 <failoverdomainnode name="Node1"<br>
> priority="1"/><br>
>                                 <failoverdomainnode name="Node2"<br>
> priority="1"/><br>
>                         </failoverdomain><br>
>                 </failoverdomains><br>
>                 <resources><br>
>                         <ip address="10.199.214.64" monitor_link="1"/><br>
>                 </resources><br>
>                 <service autostart="1" domain="PE51SPM1" exclusive="1"<br>
> name="PE51SPM1"><br>
>                         <fs device="/dev/EI51SPM_DATA/SPIM_admin"<br>
> force_fsck="1" force_unmount="1" fsid="3446" fstype="ext3"<br>
> mountpoint="/SPIM/admin" name="admin" options="" self_fence="1"/><br>
>                         <fs device="/dev/EI51SPM_DATA/flatfile_upload"<br>
> force_fsck="1" force_unmount="1" fsid="17646" fstype="ext3"<br>
> mountpoint="/flatfile_upload" name="flatfile_upload" options=""<br>
> self_fence="1"/><br>
>                         <fs device="/dev/EI51SPM_DATA/oracle"<br>
> force_fsck="1" force_unmount="1" fsid="64480" fstype="ext3"<br>
> mountpoint="/oracle" name="oracle" options="" self_fence="1"/><br>
>                         <fs device="/dev/EI51SPM_DATA/SPIM_datafile_01"<br>
> force_fsck="1" force_unmount="1" fsid="60560" fstype="ext3"<br>
> mountpoint="/SPIM/datafile_01" name="datafile_01" options=""<br>
> self_fence="1"/><br>
>                         <fs device="/dev/EI51SPM_DATA/SPIM_datafile_02"<br>
> force_fsck="1" force_unmount="1" fsid="48426" fstype="ext3"<br>
> mountpoint="/SPIM/datafile_02" name="datafile_02" options=""<br>
> self_fence="1"/><br>
>                         <fs device="/dev/EI51SPM_DATA/SPIM_redolog_01"<br>
> force_fsck="1" force_unmount="1" fsid="54326" fstype="ext3"<br>
> mountpoint="/SPIM/redolog_01" name="redolog_01" options="" self_fence="1"/><br>
>                         <fs device="/dev/EI51SPM_DATA/SPIM_redolog_02"<br>
> force_fsck="1" force_unmount="1" fsid="23041" fstype="ext3"<br>
> mountpoint="/SPIM/redolog_02" name="redolog_02" options="" self_fence="1"/><br>
>                         <fs device="/dev/EI51SPM_DATA/SPIM_redolog_03"<br>
> force_fsck="1" force_unmount="1" fsid="46362" fstype="ext3"<br>
> mountpoint="/SPIM/redolog_03" name="redolog_03" options="" self_fence="1"/><br>
>                         <fs device="/dev/EI51SPM_DATA/SPIM_archives_01"<br>
> force_fsck="1" force_unmount="1" fsid="58431" fstype="ext3"<br>
> mountpoint="/SPIM/archives_01" name="archives_01" options=""<br>
> self_fence="1"/><br>
>                         <script file="/etc/cluster/dbstart" name="dbstart"/><br>
>                         <ip ref="10.199.214.64"/><br>
>                 </service><br>
>         </rm><br>
> </cluster><br>
><br>
><br>
> [root@Node2 ~]# clustat<br>
> msg_open: Invalid argument<br>
> Member Status: Inquorate<br>
><br>
> Resource Group Manager not running; no service information available.<br>
><br>
> Membership information not available<br>
><br>
><br>
><br>
> Primary Node<br>
><br>
> -----------------------------------------<br>
> [root@Node1 ~]# clustat<br>
> Member Status: Quorate<br>
><br>
>   Member Name                              Status<br>
>   ------ ----                              ------<br>
>   Node1                 Online, Local, rgmanager<br>
>   Node2                 Offline<br>
><br>
>   Service Name         Owner (Last)                   State<br>
>   ------- ----         ----- ------                   -----<br>
>   Package1             Node1    started<br>
><br>
><br>
> On Sat, Mar 5, 2016 at 12:17 PM, Digimer <<a href="mailto:lists@alteeve.ca">lists@alteeve.ca</a><br>
</div></div><div><div class="h5">> <mailto:<a href="mailto:lists@alteeve.ca">lists@alteeve.ca</a>>> wrote:<br>
><br>
>     Please share your cluster.conf (only obfuscate passwords please) and the<br>
>     output of 'clustat' from each node.<br>
><br>
>     digimer<br>
><br>
>     On 05/03/16 01:46 AM, Shreekant Jena wrote:<br>
>     > Dear All,<br>
>     ><br>
>     > I have a 2 node cluster but after reboot secondary node is showing<br>
>     > offline . And cman failed to start .<br>
>     ><br>
>     > Please find below logs on secondary node:-<br>
>     ><br>
>     > root@EI51SPM1 cluster]# clustat<br>
>     > msg_open: Invalid argument<br>
>     > Member Status: Inquorate<br>
>     ><br>
>     > Resource Group Manager not running; no service information available.<br>
>     ><br>
>     > Membership information not available<br>
>     > [root@EI51SPM1 cluster]# tail -10 /var/log/messages<br>
>     > Feb 24 13:36:23 EI51SPM1 ccsd[25487]: Error while processing connect:<br>
>     > Connection refused<br>
>     > Feb 24 13:36:23 EI51SPM1 kernel: CMAN: sending membership request<br>
>     > Feb 24 13:36:27 EI51SPM1 ccsd[25487]: Cluster is not quorate.<br>
>     Refusing<br>
>     > connection.<br>
>     > Feb 24 13:36:27 EI51SPM1 ccsd[25487]: Error while processing connect:<br>
>     > Connection refused<br>
>     > Feb 24 13:36:28 EI51SPM1 kernel: CMAN: sending membership request<br>
>     > Feb 24 13:36:32 EI51SPM1 ccsd[25487]: Cluster is not quorate.<br>
>     Refusing<br>
>     > connection.<br>
>     > Feb 24 13:36:32 EI51SPM1 ccsd[25487]: Error while processing connect:<br>
>     > Connection refused<br>
>     > Feb 24 13:36:32 EI51SPM1 ccsd[25487]: Cluster is not quorate.<br>
>     Refusing<br>
>     > connection.<br>
>     > Feb 24 13:36:32 EI51SPM1 ccsd[25487]: Error while processing connect:<br>
>     > Connection refused<br>
>     > Feb 24 13:36:33 EI51SPM1 kernel: CMAN: sending membership request<br>
>     > [root@EI51SPM1 cluster]#<br>
>     > [root@EI51SPM1 cluster]# cman_tool status<br>
>     > Protocol version: 5.0.1<br>
>     > Config version: 166<br>
>     > Cluster name: IVRS_DB<br>
>     > Cluster ID: 9982<br>
>     > Cluster Member: No<br>
>     > Membership state: Joining<br>
>     > [root@EI51SPM1 cluster]# cman_tool nodes<br>
>     > Node  Votes Exp Sts  Name<br>
>     > [root@EI51SPM1 cluster]#<br>
>     > [root@EI51SPM1 cluster]#<br>
>     ><br>
>     ><br>
>     > Thanks & regards<br>
>     > SHREEKANTA JENA<br>
>     ><br>
>     ><br>
>     ><br>
><br>
><br>
>     --<br>
>     Digimer<br>
>     Papers and Projects: <a href="https://alteeve.ca/w/" rel="noreferrer" target="_blank">https://alteeve.ca/w/</a><br>
>     What if the cure for cancer is trapped in the mind of a person without<br>
>     access to education?<br>
><br>
>     --<br>
>     Linux-cluster mailing list<br>
</div></div>>     <a href="mailto:Linux-cluster@redhat.com">Linux-cluster@redhat.com</a> <mailto:<a href="mailto:Linux-cluster@redhat.com">Linux-cluster@redhat.com</a>><br>
>     <a href="https://www.redhat.com/mailman/listinfo/linux-cluster" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br>
<div class="HOEnZb"><div class="h5">><br>
><br>
><br>
><br>
<br>
<br>
--<br>
Digimer<br>
Papers and Projects: <a href="https://alteeve.ca/w/" rel="noreferrer" target="_blank">https://alteeve.ca/w/</a><br>
What if the cure for cancer is trapped in the mind of a person without<br>
access to education?<br>
<br>
--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br>
</div></div></blockquote></div><br></div>