<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style></style></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1>Hi,<o:p></o:p><o:p> </o:p>On my two node cluster which got configured inRHEL 6.2 (with ctdb + gfs2 + rgmanager + cman), primary node fences the secondary node automatically ( in random). During this fence the message appears in the primary server is as follows:<o:p></o:p><o:p> </o:p>Dec 30 05:23:49 filesrv1 corosync[9065]: [TOTEM ] A processor failed, forming new configuration.<o:p></o:p>Dec 30 05:23:51 filesrv1 corosync[9065]: [QUORUM] Members[1]: 1<o:p></o:p>Dec 30 05:23:51 filesrv1 corosync[9065]: [TOTEM ] A processor joined or left the membership and a new membership was formed.<o:p></o:p>Dec 30 05:23:51 filesrv1 kernel: dlm: closing connection to node 2<o:p></o:p>Dec 30 05:23:51 filesrv1 corosync[9065]: [CPG ] chosen downlist: sender r(0) ip(10.0.0.10) ; members(old:2 left:1)<o:p></o:p>Dec 30 05:23:51 filesrv1 corosync[9065]: [MAIN ] Completed service synchronization, ready to provide service.<o:p></o:p>Dec 30 05:23:51 filesrv1 rgmanager[12491]: State change: clustsrv2 DOWN<o:p></o:p>Dec 30 05:23:51 filesrv1 fenced[9122]: fencing node clustsrv2<o:p></o:p>Dec 30 05:23:51 filesrv1 kernel: GFS2: fsid=samba:ctdb.1: jid=0: Trying to acquire journal lock...<o:p></o:p>Dec 30 05:23:51 filesrv1 kernel: GFS2: fsid=samba:gen01.1: jid=0: Trying to acquire journal lock...<o:p></o:p>Dec 30 05:23:57 filesrv1 kernel: bnx2 0000:04:00.0: eth4: NIC Copper Link is Down<o:p></o:p>Dec 30 05:23:57 filesrv1 kernel: bnx2 0000:03:00.1: eth3: NIC Copper Link is Down<o:p></o:p>Dec 30 05:23:57 filesrv1 kernel: bonding: bond1: link status definitely down for interface eth3, disabling it<o:p></o:p>Dec 30 05:23:57 filesrv1 kernel: bonding: bond1: now running without any active interface !<o:p></o:p>Dec 30 05:23:57 filesrv1 kernel: bonding: bond1: link status definitely down for interface eth4, disabling it<o:p></o:p>Dec 30 05:23:58 filesrv1 kernel: bnx2 0000:03:00.1: eth3: NIC Copper Link is Up, 100 Mbps full duplex, receive & transmit flow control ON<o:p></o:p>Dec 30 05:23:58 filesrv1 kernel: bnx2 0000:04:00.0: eth4: NIC Copper Link is Up, 100 Mbps full duplex, receive & transmit flow control ON<o:p></o:p>Dec 30 05:23:58 filesrv1 kernel: bond1: link status definitely up for interface eth3, 100 Mbps full duplex.<o:p></o:p>Dec 30 05:23:58 filesrv1 kernel: bonding: bond1: making interface eth3 the new active one.<o:p></o:p>Dec 30 05:23:58 filesrv1 kernel: bonding: bond1: first active interface up!<o:p></o:p>Dec 30 05:23:58 filesrv1 kernel: bond1: link status definitely up for interface eth4, 100 Mbps full duplex.<o:p></o:p>Dec 30 05:23:59 filesrv1 kernel: bnx2 0000:04:00.0: eth4: NIC Copper Link is Down<o:p></o:p>Dec 30 05:23:59 filesrv1 kernel: bnx2 0000:03:00.1: eth3: NIC Copper Link is Down<o:p></o:p>Dec 30 05:23:59 filesrv1 kernel: bonding: bond1: link status definitely down for interface eth3, disabling it<o:p></o:p>Dec 30 05:23:59 filesrv1 kernel: bonding: bond1: now running without any active interface !<o:p></o:p>Dec 30 05:23:59 filesrv1 kernel: bonding: bond1: link status definitely down for interface eth4, disabling it<o:p></o:p>Dec 30 05:24:00 filesrv1 fenced[9122]: fence clustsrv2 success<o:p></o:p><o:p> </o:p>Can anyone please help why this is happening.<o:p></o:p><o:p> </o:p><o:p> </o:p>Thanks<o:p></o:p><o:p> </o:p>Sathya Narayanan V<o:p></o:p>Solution Architect <o:p></o:p>M +91 9940680173 |T +91 44 42199500 | Service Desk +91 44 42199521 SERVICE - In PRECISION IT is a PASSION --------------------------------------------------------------------------------------------------------- Precision Infomatic (M) Pvt Ltd 22, 1st Floor, Habibullah Road, T. Nagar, Chennai - 600 017. India. <a href="http://www.precisionit.co.in/">www.precisionit.co.in</a><o:p></o:p><o:p> </o:p></div> This communication may contain confidential information. If you are not the intended recipient it may be unlawful for you to read, copy, distribute, disclose or otherwise use the information contained within this communication.. Errors and Omissions may occur in the contents of this Email arising out of or in connection with data transmission, network malfunction or failure, machine or software error, malfunction, or operator errors by the person who is sending the email. Precision Group accepts no responsibility for any such errors or omissions. The information, views and comments within this communication are those of the individual and not necessarily those of Precision Group. All email that is sent from/to Precision Group is scanned for the presence of computer viruses, security issues and inappropriate content. However, it is the recipient's responsibility to check any attachments for viruses before use. </body></html>