<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv=Content-Type content="text/html; charset=us-ascii"> <meta name=Generator content="Microsoft Word 12 (filtered medium)">  <style>  </style>  </head> <body lang=EN-US link=blue vlink=purple> <div class=Section1> Hi Dominic,<o:p></o:p> <o:p> </o:p> Below is my cluster.conf:<o:p></o:p> ===================================<o:p></o:p> <?xml version="1.0"?><o:p></o:p> <cluster alias="rhel5_cluster" config_version="21" name="rhel5_cluster"><o:p></o:p> <fence_daemon post_fail_delay="0" post_join_delay="3"/><o:p></o:p> <clusternodes><o:p></o:p> <clusternode name="rhel5cln1.home.com" nodeid="1" votes="1"><o:p></o:p> <fence><o:p></o:p> <method name="1"><o:p></o:p> <device name="manual_fence" nodename="rhel5cln1.home.com"/><o:p></o:p> </method><o:p></o:p> </fence><o:p></o:p> </clusternode><o:p></o:p> <clusternode name="rhel5cln2.home.com" nodeid="2" votes="1"><o:p></o:p> <fence><o:p></o:p> <method name="1"><o:p></o:p> <device name="manual_fence" nodename="rhel5cln2.home.com"/><o:p></o:p> </method><o:p></o:p> </fence><o:p></o:p> </clusternode><o:p></o:p> </clusternodes><o:p></o:p> <cman expected_votes="1" two_node="1"/><o:p></o:p> <fencedevices><o:p></o:p> <fencedevice agent="fence_manual" name="manual_fence"/><o:p></o:p> </fencedevices><o:p></o:p> <rm log_level="7" log_facility="local3"><o:p></o:p> <failoverdomains/><o:p></o:p> <resources><o:p></o:p> <script file="/usr/local/httpd2.2.16/bin/apachectl" name="Apache_Script"/><o:p></o:p> <ip address="192.168.30.137" monitor_link="1"/><o:p></o:p> <clusterfs device="/dev/sdc" force_unmount="0" fsid="22440" fstype="gfs2" mountpoint="/usr/local/httpd2.2.16/htdocs/" name="gfs2share" options=""/><o:p></o:p> </resources><o:p></o:p> <service autostart="1" name="Apache_Service" recovery="restart"><o:p></o:p> <ip ref="192.168.30.137"/><o:p></o:p> <script ref="Apache_Script"/><o:p></o:p> </service><o:p></o:p> <service autostart="1" name="gfs2share" recovery="relocate"><o:p></o:p> <clusterfs ref="gfs2share"/><o:p></o:p> </service><o:p></o:p> </rm><o:p></o:p> <logging to_syslog="yes" to_logfile="yes" syslog_facility="local3"><o:p></o:p> <logging_daemon name="corosync" logfile="/var/log/cluster.log"/><o:p></o:p> </logging><o:p></o:p> </cluster><o:p></o:p> =================================<o:p></o:p> <o:p> </o:p> One thing which I noticed is when I move the service on other node, it generates the following logs:<o:p></o:p> <o:p> </o:p> Feb 20 21:50:48 rhel5cln1 clurgmgrd[13764]: <notice> Stopping service service:gfs2share<o:p></o:p> Feb 20 21:50:48 rhel5cln1 clurgmgrd: [13764]: <debug> Not umounting /dev/sdc (clustered file system)<o:p></o:p> Feb 20 21:50:48 rhel5cln1 clurgmgrd[13764]: <notice> Service service:gfs2share is stopped<o:p></o:p> <o:p> </o:p> Cluster is configured in such that only one node should be mounting the GFS2 FS. When I start the cluster only one node mounts GFS2, however when service is moved GFS2 gets mounted on both the node but it is still accessible. It hangs when the owner node goes down and services move to other node automatically.<o:p></o:p> <o:p> </o:p> <o:p> </o:p> <div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'> From: linux-cluster-bounces@redhat.com [mailto:linux-cluster-bounces@redhat.com] On Behalf Of dOminic Sent: Sunday, February 13, 2011 8:03 PM To: linux clustering Subject: Re: [Linux-cluster] Cluster node hangs<o:p></o:p> </div> <o:p> </o:p> <div> Hi,<o:p></o:p> </div> <div> <o:p> </o:p> </div> <div> Whats the msg you are getting in logs ?. It would be great if you could attach log mesgs along with cluster.conf <o:p></o:p> </div> <div> <o:p> </o:p> </div> <div> -dominic <o:p></o:p> </div> <o:p> </o:p> <div> On Sun, Feb 13, 2011 at 3:49 PM, Sachin Bhugra <<a href="mailto:sachinbhugra@hotmail.com">sachinbhugra@hotmail.com</a>> wrote:<o:p></o:p> <div> Thank for the reply and link. However, GFS2 is not listed in fstab, it is only handled by cluster config.<o:p></o:p> <div class=MsoNormal align=center style='text-align:center'> <hr size=2 width="100%" align=center> </div> Date: Sun, 13 Feb 2011 10:52:51 +0100 From: <a href="mailto:ekuric@redhat.com" target="_blank">ekuric@redhat.com</a> To: <a href="mailto:linux-cluster@redhat.com" target="_blank">linux-cluster@redhat.com</a> Subject: Re: [Linux-cluster] Cluster node hangs<o:p></o:p> <div> <div> On 02/13/2011 10:41 AM, Elvir Kuric wrote: <o:p></o:p> On 02/13/2011 10:14 AM, Sachin Bhugra wrote: <o:p></o:p> Hi , I have setup a two node cluster in lab, with Vmware Server, and hence used manual fencing. It includes a iSCSI GFS2 partition and it service Apache in Active/Passive mode. Cluster works and I am able to relocate service between nodes with no issues. However, the problem comes when I shutdown the node, for testing, which is presently holding the service. When the node becomes unavailable, service gets relocated and GFS partition gets mounted on the other node, however it is not accessible. If I try to do a "ls/du" on GFS partition, the command hangs. On the other hand the node which was shutdown gets stuck at "unmounting file system". I tried using fence_manual -n nodename and then fence_ack_manual -n nodename, however it still remains the same. Can someone please help me is what I am doing wrong? Thanks, <o:p></o:p> <pre> -- Linux-cluster mailing list <a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a> <a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><o:p></o:p></pre> <tt>It would be good to see /etc/fstab configuration used on cluster nodes. If /gfs partition is mounted manually it will not be unmounted correctly in case you restart node ( and not executing umount prior restart ), and will hang during shutdown/reboot process.</tt> <tt>More at: <a href="http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html-single/Global_File_System_2/index.html" target="_blank">http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html-single/Global_File_System_2/index.html</a></tt><o:p></o:p> <tt>Edit: above link, section 3.4 Special Considerations when Mounting GFS2 File Systems</tt> <o:p></o:p> <tt>Regards, </tt> <tt>Elvir </tt><o:p></o:p> <blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'> <o:p> </o:p> <o:p> </o:p> <pre> -- Linux-cluster mailing list <a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a> <a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><o:p></o:p></pre></blockquote> <o:p> </o:p> </div> </div> -- Linux-cluster mailing list <a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a> <a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a> <o:p></o:p> </div> -- Linux-cluster mailing list <a href="mailto:Linux-cluster@redhat.com">Linux-cluster@redhat.com</a> <a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><o:p></o:p> </div> <o:p> </o:p> </div> </body> </html>