<div dir="ltr">Yeah they work fine . This started when we had a network problem.<div><br></div><div>I see this:</div><div><br></div><div>
<p class=""><span style="font-family:arial,sans-serif;font-size:13px">dlm_tool lockdebug rgmanager </span><br></p><p class="">can't open /sys/kernel/debug/dlm/rgmanager_locks: No such file or directory</p><div><br></div>
<div><br></div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, May 7, 2014 at 4:34 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">dlm_tool lockdebug rgmanager or dlm_tool lockdump rgmanager, anyway you can tell me when this problem started to happen? are you sure your fencing is working ok?<br>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">
2014-05-07 23:01 GMT+02:00 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span>:<div><div class="h5"><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">"dlm_tools ls lockdebug" you mean?<div><br></div><div>"dlm_tool ls" returns</div><div><br></div><div>--</div><div>
<p>Usage:</p>
<p><br></p>
<p>dlm_tool [options] [join|leave|lockdump|lockdebug]</p>
<p><br></p>
<p>Options:</p>
<p> -v Verbose output</p>
<p> -d <n> Resource directory off/on (0/1), default 0</p>
<p> -m <mode> Permission mode for lockspace device (octal), default 0600</p>
<p> -M Print MSTCPY locks in lockdump (remote locks, locally mastered)</p>
<p> -h Print this help, then exit</p>
<p> -V Print program version information, then exit</p>
<p>-</p><p><br></p><p><br></p></div></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, May 7, 2014 at 3:40 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">dlm_tool ls ?<br></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">
2014-05-07 21:05 GMT+02:00 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Well I have a qdisk with vote 3 . Thats why it is 6.<div><br></div><div>Here is the log. I see some GFS hung but no issue with GFS mounts at this time.</div>
<div><br></div><div><a href="http://pastebin.com/MP4BF86c" target="_blank">http://pastebin.com/MP4BF86c</a><br>
</div><div><br></div><div>I am seeing this at clumond.log not sure if this is related and what is it.</div><div><br></div><div>
<p>Mon May 5 21:58:20 2014 clumond: Peer (vprd3.domain): pruning queue 23340->11670</p>
<p>Tue May 6 01:38:57 2014 clumond: Peer (vprd3.domain): pruning queue 23340->11670</p>
<p>Tue May 6 01:39:02 2014 clumond: Peer (vprd1.domain): pruning queue 23340->11670</p></div><div><br></div><div>Thanks</div><span><font color="#888888"><div>Paras</div></font></span></div><div>
<div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, May 7, 2014 at 1:51 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>where is your log?<br><br></div><div>I don't think this is the problem, but anyway from your config i saw <cman expected_votes="6"......<br>
</div><br></div>from man cman<br><br>
Expected votes<br> The expected votes value is used by cman to determine quorum. The cluster is quorate if the sum of votes of existing members is<br> over half of the expected votes value. By default, cman sets the expected votes value to be the sum of votes of all nodes listed in<br>
cluster.conf. This can be overriden by setting an explicit expected_votes value as follows:<br><br></div>If you remove this expected_votes="6", the cluster will set this parameter to 3<br><div><br></div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-05-07 20:38 GMT+02:00 emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span>:<div><div>
<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">from your previous outpout of cman_tool services <br><div><p>[1 2 3]</p>
dlm 1 rgmanager 00030001 none </div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-05-07 20:24 GMT+02:00 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span>:<div>
<div><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Oh. How did you see that?<div><br></div><div>Here is the cluster.conf <a href="http://pastebin.com/DveLMGXT" target="_blank">http://pastebin.com/DveLMGXT</a></div>
<div><br></div><div>Thanks!</div><span><font color="#888888"><div>-Paras.</div></font></span></div><div><div><div class="gmail_extra">
<br><br><div class="gmail_quote">On Wed, May 7, 2014 at 1:07 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">i saw your rgmanager lockspace is there, you see any error in your msg? can show your cluster config?<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-05-07 19:52 GMT+02:00 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span>:<div>
<div><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thats looks good.<div><br></div><div>#cman_tool services<div>
<p>type level name id state </p>
<p>fence 0 default 00010001 none </p>
<p>[1 2 3]</p>
<p>dlm 1 clvmd 00020001 none </p>
<p>[1 2 3]</p>
<p>dlm 1 guest_comp_vms1 00020003 none </p>
<p>[1 2 3]</p>
<p>dlm 1 guest_comp_vms2 00040003 none </p>
<p>[1 2 3]</p>
<p>dlm 1 guest_comp_vms3 00060003 none </p>
<p>[1 2 3]</p>
<p>dlm 1 rgmanager 00030001 none </p>
<p>[1 2 3]</p>
<p>gfs 2 guest_comp_vms1 00010003 none </p>
<p>[1 2 3]</p>
<p>gfs 2 guest_comp_vms2 00030003 none </p>
<p>[1 2 3]</p>
<p>gfs 2 guest_comp_vms3 00050003 none </p>
<p>[1 2 3]</p></div></div></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, May 7, 2014 at 12:46 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">cman_tool services?<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-05-07 19:28 GMT+02:00 hugo aldunce <span dir="ltr"><<a href="mailto:haldunce@gmail.com" target="_blank">haldunce@gmail.com</a>></span>:<div>
<div><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">ohh good luck!</div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-05-07 11:14 GMT-04:00 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hi,<div>We had some network problem the other day and today I noticed the clusvcadm commands are not working. For example: it does not want to stop the service, migrate a vm etc etc. On one of the nodes clustat does not show any running services. I should restart the rgmanager?</div>
<div><br></div><div>This is RHEL 5.</div><div><br></div><div>Thanks</div><span><font color="#888888"><div>Paras.</div>
</font></span></div>
<br></div></div><div>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></div></blockquote></div><span><font color="#888888"><br><br clear="all">
<div><br></div>-- <br><div dir="ltr"><div>
---------------------------------------------------------------------------------------------------------------------<br>Hugo Aldunce E<br>Tel. <a href="tel:09%2082121045" value="+49982121045" target="_blank">09 82121045</a></div>
<div>mail: <a href="mailto:haldunce@gmail.com" target="_blank">haldunce@gmail.com</a><br>---------------------------------------------------------------------------------------------------------------------</div></div>
</font></span></div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div></div></div><br><br clear="all"><br>-- <br><div>esta es mi vida e me la vivo hasta que dios quiera
</div></div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div></div></div><div><div><br><br clear="all"><br>-- <br>
esta es mi vida e me la vivo hasta que dios quiera
</div></div></div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div></div></div><div><div><br><br clear="all"><br>-- <br>
esta es mi vida e me la vivo hasta que dios quiera
</div></div></div>
</blockquote></div></div></div><div><div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div></div></div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div></div></div><div><div class="h5"><br><br clear="all"><br>-- <br>
esta es mi vida e me la vivo hasta que dios quiera
</div></div></div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>