<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
color:black;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";
color:black;
mso-fareast-language:EN-US;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;
mso-fareast-language:EN-US;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle22
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle23
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle24
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body bgcolor=white lang=EN-AU link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><b><span style='color:#1F497D'>Yes it starts if I do manually:<o:p></o:p></span></b></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>[root@atp-wwdev1 ~]# mount -t nfs 10.26.240.190:/nfs/mysql /var/lib/mysql/<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>[root@atp-wwdev1 ~]# /etc/init.d/mysqld start<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>Starting mysqld: [ OK ]<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>[root@atp-wwdev1 ~]# cat /var/log/mysqld.log<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>120112 15:28:57 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>120112 15:28:58 InnoDB: Started; log sequence number 0 44233<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>120112 15:28:58 [Note] Event Scheduler: Loaded 0 events<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>120112 15:28:58 [Note] /usr/libexec/mysqld: ready for connections.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>Version: '5.1.52' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>[root@atp-wwdev1 ~]# /etc/init.d/mysqld stop<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>Stopping mysqld: [ OK ]<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>root@atp-wwdev1 ~]# cat /var/log/mysqld.log<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>120112 15:29:39 [Note] /usr/libexec/mysqld: Normal shutdown<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>120112 15:29:39 [Note] Event Scheduler: Purging the queue. 0 events<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>120112 15:29:39 InnoDB: Starting shutdown...<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>120112 15:29:43 InnoDB: Shutdown completed; log sequence number 0 44233<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>120112 15:29:43 [Note] /usr/libexec/mysqld: Shutdown complete<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><b><span style='color:#1F497D;mso-fareast-language:EN-AU'>But if I start with cluster, it doesnot give any error message in /var/log/mysqld.log<o:p></o:p></span></b></p><p class=MsoNormal><b><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></b></p><p class=MsoNormal><b><span style='color:#1F497D;mso-fareast-language:EN-AU'>Once again my cluster.conf is follows:<o:p></o:p></span></b></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><?xml version="1.0"?><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><cluster config_version="39" name="atp_mysql"><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <clusternodes><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <clusternode name="atp-wwdev1.test1.com.au" nodeid="1"><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <fence/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <multicast addr="239.192.200.1"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </clusternode><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <clusternode name="atp-wwdev2.test1.com.au" nodeid="2" votes="1"><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <fence/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <multicast addr="239.192.200.1"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </clusternode><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </clusternodes><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <fencedevices><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <fencedevice agent="fence_xvm" name="fence"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </fencedevices><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <rm><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <failoverdomains><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <failoverdomain name="atp_failover" nofailback="0" ordered="1" restricted="0"><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <failoverdomainnode name="atp-wwdev1.test1.com.au" priority="2"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <failoverdomainnode name="atp-wwdev2.test1.com.au" priority="5"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </failoverdomain><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </failoverdomains><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <resources><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <ip address="10.26.240.95/24" monitor_link="on" sleeptime="2"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <mysql config_file="/etc/my.cnf" listen_address="10.26.24.95" name="mysql" shutdown_wait="60" startup_wait="60"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <netfs export="/nfs/mysql" force_unmount="on" fstype="nfs" host="10.26.240.190" mountpoint="/var/lib/mysql" name="storage" no_unmount="on"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </resources><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <service autostart="1" domain="atp_failover" exclusive="0" name="mysql" recovery="relocate"><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <ip ref="10.26.240.95/24"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <netfs ref="storage"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <mysql ref="mysql"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </service><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </rm><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <fence_daemon clean_start="0" post_fail_delay="0" post_join_delay="3"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <cman expected_votes="1" two_node="1"><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <multicast addr="239.192.200.1"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> </cman><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <totem/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'> <logging debug="off"/><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'></cluster><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><b><span style='color:#1F497D;mso-fareast-language:EN-AU'>And my.cnf is follows:<o:p></o:p></span></b></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>[mysqld]<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>datadir=/var/lib/mysql<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>socket=/var/lib/mysql/mysql.sock<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>user=mysql<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'># Disabling symbolic-links is recommended to prevent assorted security risks<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>symbolic-links=0<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>[mysqld_safe]<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>log-error=/var/log/mysqld.log<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>pid-file=/var/run/cluster/mysql/mysql.pid<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>If you need any more info, please let me know.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'>Thanks<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D;mso-fareast-language:EN-AU'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext;mso-fareast-language:EN-AU'>From:</span></b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext;mso-fareast-language:EN-AU'> linux-cluster-bounces@redhat.com [mailto:linux-cluster-bounces@redhat.com] <b>On Behalf Of </b>Ryan Mitchell<br><b>Sent:</b> Thursday, 12 January 2012 3:01 PM<br><b>To:</b> linux-cluster@redhat.com<br><b>Subject:</b> Re: [Linux-cluster] Issue with mysql service in RHEL6.2 cluster<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>On 01/12/2012 01:11 PM, Roka, Rajendra wrote: <o:p></o:p></p><p class=MsoNormal><span style='color:#1F497D'>Any more suggestions on this?</span><o:p></o:p></p><p class=MsoNormal><span style='font-size:12.0pt;font-family:"Times New Roman","serif";mso-fareast-language:EN-AU'>According to the new log, it still timed out after 60 seconds, so either that wasn't long enough either, or there is a misconfiguration and the database can't start because of it:<br><br><o:p></o:p></span></p><div><p class=MsoNormal><span style='color:#1F497D'>Jan 10 11:42:57 atp-wwdev1 modcluster: Starting service: mysql on node </span><o:p></o:p></p><p class=MsoNormal><span style='color:#1F497D'>Jan 10 11:42:57 atp-wwdev1 rgmanager[1690]: Starting stopped service service:mysql</span><o:p></o:p></p><p class=MsoNormal><span style='color:#1F497D'>Jan 10 11:42:58 atp-wwdev1 rgmanager[5252]: Adding IPv4 address 10.26.240.95/24 to eth0</span><o:p></o:p></p><p class=MsoNormal><span style='color:#1F497D'>Jan 10 11:43:01 atp-wwdev1 rgmanager[5401]: Starting Service mysql:mysql</span><o:p></o:p></p><p class=MsoNormal><span style='color:#1F497D'>Jan 10 11:44:01 atp-wwdev1 rgmanager[5657]: Starting Service mysql:mysql > Failed - Timeout Error</span><o:p></o:p></p><p class=MsoNormal><span style='color:#1F497D'>Jan 10 11:44:01 atp-wwdev1 rgmanager[1690]: start on mysql "mysql" returned 1 (generic error)</span><o:p></o:p></p><p class=MsoNormal><span style='color:#1F497D'>Jan 10 11:44:02 atp-wwdev1 rgmanager[1690]: #68: Failed to start service:mysql; return value: 1</span><o:p></o:p></p></div><p class=MsoNormal style='margin-bottom:12.0pt'><span style='font-size:12.0pt;font-family:"Times New Roman","serif";mso-fareast-language:EN-AU'><br>What does it say in your mysql log? The resource script runs the command to start the database and then waits for it to return success. It waited 60 seconds, and hadn't received any notice that the database started or not, so it gave up.<br><br>Look in the logs to see if there is any indication as to why the database won't start. It could be because you have the wrong configuration in /etc/my.cnf, no permissions on some critical directories, or the resource script is misconfigured. Also, you should investigate whether you can manually start the database (after mounting the NFS mount and adding the VIP of course) outside of cluster (and compare working and failing mysql logs).<br><br>Regards,<br><br>Ryan Mitchell<br>Software Maintenance Engineer<br>Support Engineering Group<br>Red Hat, Inc.<o:p></o:p></span></p></div></body></html>
<pre>Important Notice:
This message and its attachments are confidential and may contain information which is protected by copyright. It is intended solely for the named addressee. If you are not the authorised recipient (or responsible for delivery of the message to the authorised recipient), you must not use, disclose, print, copy or deliver this message or its attachments to anyone. If you receive this email in error, please contact the sender immediately and permanently delete this message and its attachments from your system.
Any content of this message and its attachments that does not relate to the official business of Pacific Magazines Pty Limited must be taken not to have been sent or endorsed by it. No representation is made that this email or its attachments are without defect or that the contents express views other than those of the sender.
Please consider the environment - do you really need to print this email?