<div dir="ltr">?<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/12/19 YB Tan Sri Dato Sri' Adli a.k.a Dell <span dir="ltr"><<a href="mailto:white.heron@yahoo.com" target="_blank">white.heron@yahoo.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><table border="0" cellpadding="0" cellspacing="0"><tbody><tr><td valign="top">please call me 60173623661 for linux system configuration.<a href="http://overview.mail.yahoo.com?.src=iOS" target="_blank"><br>
<br>Sent from Yahoo Mail for iPhone</a></td></tr></tbody></table> <div>
<div>
<br>
<div>
<div style="font-size:0.9em">
<hr size="1">
<b>
<span style="font-weight:bold">From:</span>
</b>
emmanuel segura <<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>>; <br>
<b>
<span style="font-weight:bold">To:</span>
</b>
linux clustering <<a href="mailto:linux-cluster@redhat.com" target="_blank">linux-cluster@redhat.com</a>>; <br>
<b>
<span style="font-weight:bold">Subject:</span>
</b>
Re: [Linux-cluster] failover domain and service start <br>
<b>
<span style="font-weight:bold">Sent:</span>
</b>
Thu, Dec 19, 2013 9:05:18 AM <br>
</div><div><div class="h5">
<br>
<table border="0" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td valign="top"><div dir="ltr">other thing, change the rgmanager loglevel, for more information you can use this link <a rel="nofollow" shape="rect" href="https://fedorahosted.org/cluster/wiki/RGManager" target="_blank">https://fedorahosted.org/cluster/wiki/RGManager</a><br clear="none">
</div><div class="gmail_extra">
<br clear="none"><br clear="none"><div class="gmail_quote">2013/12/19 emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span><br clear="none"><div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">grep "/vms_c" /proc/mounts in every node<br clear="none"></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">2013/12/18 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I see this:<div><br clear="none"></div><div><div>Dec 18 16:17:18 cvtst3 clurgmgrd[13935]: <notice> Starting stopped service vm:guest1 </div>
<div>Dec 18 16:17:19 cvtst3 clurgmgrd[13935]: <notice> start on vm "guest1" returned 1 (generic error) </div>
<div>Dec 18 16:17:19 cvtst3 clurgmgrd[13935]: <warning> #68: Failed to start vm:guest1; return value: 1 </div><div>Dec 18 16:17:19 cvtst3 clurgmgrd[13935]: <notice> Stopping service vm:guest1 </div></div><div>
<br clear="none"></div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Wed, Dec 18, 2013 at 4:39 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">can you show the log?<br clear="none"></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none">
<div class="gmail_quote">
2013/12/18 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Added but same problem. vm does not start.<span><font color="#888888"></font></span><div><br clear="none">
</div><div>
-Paras.</div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Wed, Dec 18, 2013 at 1:13 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">from script vm.sh i saw it try to discovery the hypervisor you are using, with <span style="font-family:arial,sans-serif;font-size:13px"></span><span style="font-family:arial,sans-serif;font-size:13px">hypervisor="xen" you force the script to use xen<br clear="none">
</span></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">2013/12/18 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div>The only parameter I don't have is: <span style="font-family:arial,sans-serif;font-size:13px"> </span><span style="font-family:arial,sans-serif;font-size:13px">hypervisor="xen"</span></div>
<div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none"></span></div><div><span style="font-family:arial,sans-serif;font-size:13px">Does it matter?</span></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none">
</span></div><div><span style="font-family:arial,sans-serif;font-size:13px">This is what i have:</span></div><div><div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none"></span></div><div><vm autostart="1" domain="myfd1" exclusive="0" max_restarts="0" name="guest1" path="/vms_c" recovery="restart" restart_expire_time="0" use_virsh="0"/><br clear="none">
</div><div><br clear="none"></div></div><span><font color="#888888"></font></span><div>-Paras.</div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Wed, Dec 18, 2013 at 12:24 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><vm name="guest1" hypervisor="xen" path="/vms_c" use_virsh="0"><br clear="none">
<br clear="none"></div>Incriment the config version of cluster.conf and ccs_tool update /etc/cluster/cluster.conf<br clear="none">
</div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">2013/12/18 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Emmauel,<div><br clear="none"></div><div>With export OCF_RESKEY_name="guest1" ; export OCF_RESKEY_path="/vms_c" ; export OCF_RESKEY_use_virsh=0</div><div><br clear="none"></div><div>, I can start the vm using : /usr/share/cluster/vm.sh</div>
<div><br clear="none"></div><div>I am wondering how to make the changes to cluser.conf or other files so that we can start the vm using clucvcsadm.</div><div><br clear="none"></div><div>-Thanks</div><div>sorry for the delay.</div>
<span><font color="#888888"></font></span><div>
<br clear="none"></div><div>
Paras.</div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Thu, Dec 5, 2013 at 12:36 PM, Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Emmanue no.l I was busy on some other things I will test and let you know asap !</div><div>
<div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Thu, Dec 5, 2013 at 12:26 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>Hello Paras<br clear="none"><br clear="none"></div>did you solved the problem?<br clear="none">
<br clear="none"></div>Thanks<span><font color="#888888"><br clear="none">
Emmanuel<br clear="none"></font></span></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">2013/11/25 emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>Hello Paras<br clear="none"><br clear="none"></div>Maybe i found the solution, in function validate_all we got <br clear="none">
<br clear="none"> if [ -z "$OCF_RESKEY_hypervisor" ] ||<br clear="none"> [ "$OCF_RESKEY_hypervisor" = "auto" ]; then<br clear="none">
export OCF_RESKEY_hypervisor="`virsh version | grep \"Running hypervisor:\" | awk '{print $3}' | tr A-Z a-z`"<br clear="none"> if [ -z "$OCF_RESKEY_hypervisor" ]; then<br clear="none">
ocf_log err "Could not determine Hypervisor"<br clear="none"> return $OCF_ERR_ARGS<br clear="none"> fi<br clear="none"> echo Hypervisor: $OCF_RESKEY_hypervisor <br clear="none">
fi<br clear="none">
<br clear="none"> #<br clear="none"> # Xen hypervisor only for when use_virsh = 0.<br clear="none"> #<br clear="none"> if [ "$OCF_RESKEY_use_virsh" = "0" ]; then<br clear="none">
if [ "$OCF_RESKEY_hypervisor" != "xen" ]; then<br clear="none">
ocf_log err "Cannot use $OCF_RESKEY_hypervisor hypervisor without using virsh"<br clear="none"> return $OCF_ERR_ARGS<br clear="none"> fi<br clear="none">
<br clear="none"></div>with this following enviroment variables, when i tested by hand the angent uses xm commands<br clear="none">
<br clear="none">env | grep OCF<br clear="none">OCF_RESKEY_hypervisor=xen<br clear="none">OCF_RESKEY_path=/vms_c<br clear="none">OCF_RESKEY_name=guest1<br clear="none">OCF_RESKEY_use_virsh=0<br clear="none"><br clear="none">
[root@client ~]# /usr/share/cluster/vm.sh status<br clear="none">Management tool: xm<br clear="none"><err> Cannot find 'xm'; is it installed?<br clear="none">
[vm.sh] Cannot find 'xm'; is it installed?<br clear="none"><br clear="none"><br clear="none"></div>I don't have xen installed to test it<br clear="none"><div><br clear="none"><div><br clear="none"> if [ -n "$OCF_RESKEY_xmlfile" ]; then<br clear="none">
ocf_log err "Cannot use xmlfile if use_virsh is set to 0"<br clear="none">
return $OCF_ERR_ARGS<br clear="none"> fi<br clear="none"><br clear="none"></div></div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">
2013/11/25 emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hello paras<br clear="none"><br clear="none"></div>missing the export command in front of variables, the correct way is this<br clear="none">
<br clear="none">export OCF_RESKEY_name="guest1" ; export OCF_RESKEY_path="/vms_c" ; export OCF_RESKEY_use_virsh=0<br clear="none">
[root@client ~]# env | grep OCF<br clear="none">OCF_RESKEY_path=/vms_c<br clear="none">OCF_RESKEY_name=guest1<br clear="none">OCF_RESKEY_use_virsh=0<br clear="none"><br clear="none"></div><div><div><div class="gmail_extra">
<br clear="none"><br clear="none"><div class="gmail_quote">2013/11/25 emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>Hello Paras<br clear="none"><br clear="none"></div>I have a centos 6, i don't know if it is different on redhat 5, but i saw in the script vm.sh calls do_start function when start parameter is given<br clear="none">
<br clear="none">do_start()<br clear="none">
{<br clear="none"> if [ "$OCF_RESKEY_use_virsh" = "1" ]; then<br clear="none"> do_virsh_start $*<br clear="none"> return $?<br clear="none"> fi<br clear="none">
<br clear="none"> do_xm_start $*<br clear="none"> return $?<br clear="none">}<br clear="none"><br clear="none"></div>
i don't know why because the vm.sh uses virsh when you launch the script by hand :(<br clear="none"></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">2013/11/25 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Looks like use_virsh=0 has no effect.<div><br clear="none"></div><div>--</div><div><div>[root@cvtst3 ~]# export OCF_RESKEY_name="guest1" ; OCF_RESKEY_path="/vms_c" ; OCF_RESKEY_use_virsh=0</div>
<div>[root@cvtst3 ~]# set -x</div>
<div>++ printf '\033]0;%s@%s:%s\007' root cvtst3 '~'</div><div>[root@cvtst3 ~]# /usr/share/cluster/vm.sh start</div><div>+ /usr/share/cluster/vm.sh start</div><div><div>Hypervisor: xen</div><div>
Management tool: virsh</div>
<div>Hypervisor URI: xen:///</div><div>Migration URI format: xenmigr://target_host/</div><div>Virtual machine guest1 is error: failed to get domain 'guest1'</div><div>error: Domain not found: xenUnifiedDomainLookupByName</div>
<div><br clear="none"></div><div><debug> virsh -c xen:/// start guest1</div><div>error: failed to get domain 'guest1'</div><div>error: Domain not found: xenUnifiedDomainLookupByName</div><div><br clear="none">
</div></div><div>++ printf '\033]0;%s@%s:%s\007' root cvtst3 '~'</div>
<div>
<div>[root@cvtst3 ~]# set +x</div><div>+ set +x</div></div></div><div>---</div><div><br clear="none"></div><div><br clear="none"></div><div>-Paras.</div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none">
<div class="gmail_quote">
On Fri, Nov 22, 2013 at 5:22 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hellos Paras<br clear="none"><br clear="none"></div>Stop the vm and retry to start the vm with following commands and if you got some error show it<br clear="none">
<br clear="none"><span style="font-family:arial,sans-serif;font-size:13px">export OCF_RESKEY_name="guest1" ; OCF_RESKEY_path="/vms_c"</span> ; OCF_RESKEY_use_virsh=0<div><br style="font-family:arial,sans-serif;font-size:13px" clear="none">
<br style="font-family:arial,sans-serif;font-size:13px" clear="none"><span style="font-family:arial,sans-serif;font-size:13px">set -x</span><br style="font-family:arial,sans-serif;font-size:13px" clear="none"><span style="font-family:arial,sans-serif;font-size:13px">/usr/share/cluster/vm.sh start</span><br style="font-family:arial,sans-serif;font-size:13px" clear="none">
<span style="font-family:arial,sans-serif;font-size:13px">set +x</span><br clear="none"></div></div><div class="gmail_extra"><br clear="none"><div><div><br clear="none"><div class="gmail_quote">2013/11/22 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>I found the workaround to my issue. What i did is:</div><div><br clear="none"></div><div>run the vm using xm and then start using cluvscadm. This works for me for the time being but I am not sure what is causing this. This is what I did</div>
<div><br clear="none"></div><div>xm create /vms_c/guest1</div><div>clusvcadm -e vm: guest1 ( This detects that guest1 is up and quickly changes its status to success)</div><div><br clear="none"></div>Although i used virt-install, it also create a xem format configuration file and since use_virsh=0 it should be able to use this xen format config file. This is my vm configuration:<div>
<br clear="none"></div><div><div>---</div><div>name = "guest1"</div><div>maxmem = 2048</div><div>memory = 512</div><div>vcpus = 1</div><div>#cpus="1-2"</div><div>bootloader = "/usr/bin/pygrub"</div>
<div>
on_poweroff = "destroy"</div>
<div>on_reboot = "restart"</div><div>on_crash = "restart"</div><div>vfb = [ ]</div><div>disk = [ "tap:aio:/vms_c/guest1.img,xvda,w", "tap:aio:/vms_c/guest1-disk.img,xvdb,w" ]</div>
<div>vif = [ "rate=10MB/s,mac=00:16:3e:6b:be:71,bridge=xenbr0" ]</div></div><div><br clear="none"></div><div>---</div><div><br clear="none"></div><div>Thanks for you help Emmanuel ! Really appreciate it.</div><span><font color="#888888"></font></span><div>
<br clear="none"></div><div>-Paras.</div>
</div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Fri, Nov 22, 2013 at 11:10 AM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>ok, but your vm doesn't start on others nodes, i think, for configuration problems<br clear="none">
================================================================<br clear="none"><div><div><div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <notice> start on vm "guest1" returned 1 (generic error) </div>
<div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <warning> #68: Failed to start vm:guest1; return value: 1 </div>
<div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <notice> Stopping service vm:guest1 </div><div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <notice> Service vm:guest1 is recovering </div><div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <warning> #71: Relocating failed service vm:guest1 </div>
</div><div><div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <notice> Service vm:guest1 is stopped <br clear="none"></div>================================================================<br clear="none"></div><div>in few words, try in every cluster node<div>
<br clear="none"><br clear="none">export OCF_RESKEY_name="guest1" ; OCF_RESKEY_path="/vms_c"<br clear="none">
<br clear="none">set -x<br clear="none">/usr/share/cluster/vm.sh start<br clear="none"></div>
/usr/share/cluster/vm.sh stop<br clear="none"><br clear="none">after you check if your vm can start and stop on every cluster node,<br clear="none"><br clear="none"></div></div>/usr/share/cluster/vm.sh start<br clear="none">
/usr/share/cluster/vm.sh migrate name_of_a_cluster_node<br clear="none"><br clear="none">
</div>can you show me your vm configuration under /vms_c?<br clear="none"><br clear="none"></div>Thanks <br clear="none"></div><span><font color="#888888">Emmanuel<br clear="none"></font></span></div><div><div><div class="gmail_extra">
<br clear="none"><br clear="none"><div class="gmail_quote">2013/11/22 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">And also to test I made use_virsh=1 , same problem. The vm does not start up if the FD domains are offline. <span><font color="#888888"></font></span><div>
<br clear="none"></div><div>-Paras.</div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Fri, Nov 22, 2013 at 10:37 AM, Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Well thats seems to theoretically correct. But right now my cluser has use_virsh=0 and I don't have any issue untill my mebmers on the failover domains are offline. So wondering what is it that clusvcadm -e is looking when I don't use virsh .<div>
<br clear="none"></div><div><br clear="none"></div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Fri, Nov 22, 2013 at 10:05 AM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">If you used virt-install, i think you need use virsh, the cluster uses xm xen command if you got use_virsh=0 and virsh if you got use_virsh=1 in your cluster config<br clear="none">
</div><div><div><div class="gmail_extra"><br clear="none"><br clear="none">
<div class="gmail_quote">2013/11/22 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><p>I use virt-install to create virtual machines. Is there a way to debug why clusvcadm -e vm:guest1 is failing? vm.sh seems to use virsh and my cluster.conf has use_virsh=0</p><p><br clear="none"></p><p>
Thanks</p><span><font color="#888888"></font></span><p>
Paras.</p><div><div>
<p><br clear="none"></p><p>On Nov 21, 2013 5:53 PM, "emmanuel segura" <<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>> wrote:<br clear="none"></p><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">but did you configure your vm with xen tools or using virt-manager?<br clear="none"></div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">2013/11/22 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Well no i don't want to use virsh. But as we are debugging with virsh now i found a strange issue.<div>
<br clear="none"></div><div>I exported an xml file and imported to all nodes . Ran</div><div><br clear="none"></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none">
</span></div><div><span style="font-family:arial,sans-serif;font-size:13px">---</span></div><div><div><span style="font-family:arial,sans-serif;font-size:13px">name="guest1" path="/vms_c"</span><br style="font-family:arial,sans-serif;font-size:13px" clear="none">
<br style="font-family:arial,sans-serif;font-size:13px" clear="none"><span style="font-family:arial,sans-serif;font-size:13px">export OCF_RESKEY_name="guest1" ; OCF_RESKEY_path="/vms_c"</span><br style="font-family:arial,sans-serif;font-size:13px" clear="none">
<br style="font-family:arial,sans-serif;font-size:13px" clear="none"><span style="font-family:arial,sans-serif;font-size:13px">set -x</span><br style="font-family:arial,sans-serif;font-size:13px" clear="none"><span style="font-family:arial,sans-serif;font-size:13px">/usr/share/cluster/vm.sh start</span><br style="font-family:arial,sans-serif;font-size:13px" clear="none">
<span style="font-family:arial,sans-serif;font-size:13px">set +x</span><br clear="none"></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none"></span></div></div><div><span style="font-family:arial,sans-serif;font-size:13px">--</span></div>
<div><font face="arial, sans-serif">vm starts now. BUT from a cluster service : cluvscam -e vm:guest1 , same error.</font><br clear="none"></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none">
</span></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none">
</span></div><div><font face="arial, sans-serif">So if i populate all my domains' config files to all my cluser nodes and make use_virsh=1, then the issue is resolved. But this is a lot of work for those who have hundreds of vm.</font></div>
<div><font face="arial, sans-serif"><br clear="none"></font></div><div><font face="arial, sans-serif">vm.start uses virsh . Is there a way to tell him not use virsh?</font></div><div><font face="arial, sans-serif"><br clear="none">
</font></div><div>
<font face="arial, sans-serif"><br clear="none"></font></div><div><font face="arial, sans-serif">Thanks</font></div><span><font color="#888888"></font></span><div><font face="arial, sans-serif">Paras.</font></div></div>
<div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">
On Thu, Nov 21, 2013 at 5:19 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div><div>if you are using virsh for manage your vms, change this in your cluster.conf <br clear="none"><br clear="none"></div>from<br clear="none">use_virsh="0"<br clear="none"></div>to<br clear="none">
use_virsh="1"<br clear="none"></div><div><div>
<div class="gmail_extra"><br clear="none">
<br clear="none"><div class="gmail_quote">2013/11/22 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">I think i found the problem. <div><br clear="none"></div><div>virsh list --all does not show my vm . This is because it was created on another node. and another node has it. Now I want to start the service on a different node in which it was not created or where virsh list --all does not have an entry. Is it possible to create this entry using a xen config file?Looks like this is now a Xen issue rather than a linux-cluster issue . :)</div>
<span><font color="#888888">
</font></span><div><br clear="none"></div><div>Paras.</div><div><br clear="none"></div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Thu, Nov 21, 2013 at 4:58 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>1:did you verify your xen livemigration configuration?<br clear="none"></div>2: where you vm disk reside?<br clear="none">
</div>3: can you see your vm defined on every cluster node with xm list?<br clear="none"></div><div><div><div class="gmail_extra">
<br clear="none"><br clear="none"><div class="gmail_quote">2013/11/21 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">This is what I get<div><br clear="none"></div><div><div>Hypervisor: xen</div><div>Management tool: virsh</div><div>Hypervisor URI: xen:///</div><div>Migration URI format: xenmigr://target_host/</div><div>Virtual machine guest1 is error: failed to get domain 'guest1'</div>
<div>error: Domain not found: xenUnifiedDomainLookupByName</div><div><br clear="none"></div><div><debug> virsh -c xen:/// start guest1</div><div>error: failed to get domain 'guest1'</div><div>error: Domain not found: xenUnifiedDomainLookupByName</div>
<div><br clear="none"></div><div>++ printf '\033]0;%s@%s:%s\007' root vtst3 '~'</div><div>[root@cvtst3 ~]# set +x</div><div>+ set +x</div></div><div><br clear="none"></div><div><br clear="none"></div><div>
--</div><div><br clear="none"></div><div><br clear="none"></div>
<div>
I am wondering why it failed to get domain .</div><span><font color="#888888"></font></span><div><br clear="none"></div><div><br clear="none"></div><div>-Paras.</div><div><br clear="none"></div></div><div><div><div class="gmail_extra">
<br clear="none"><br clear="none"><div class="gmail_quote">On Thu, Nov 21, 2013 at 4:43 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">yes<br clear="none"></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">
2013/11/21 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Well it is guest1. Isn't it?.<div><br clear="none"></div><div><vm autostart="1" domain="myfd1" exclusive="0" max_restarts="0" name="guest1" path="/vms_c" recovery="restart" restart_expire_time="0" use_virsh="0"/><br clear="none">
</div><div><br clear="none"></div><div>It is a vm service if it matters.</div><span><font color="#888888"></font></span><div><br clear="none"></div><div>-Paras.</div><div><br clear="none"></div><div><br clear="none"></div>
</div><div><div>
<div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">On Thu, Nov 21, 2013 at 4:22 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">use the servicename you defined in your cluster.conf<br clear="none"></div><div><div><div class="gmail_extra">
<br clear="none"><br clear="none"><div class="gmail_quote">2013/11/21 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Says:<div><br clear="none"></div><div><div>Running in test mode.</div><div>No resource guest1 of type service found</div>
</div><span><font color="#888888"></font></span><div><br clear="none"></div><div>-Paras.</div></div><div><div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">
On Thu, Nov 21, 2013 at 4:07 PM, emmanuel segura <span dir="ltr"><<a rel="nofollow" shape="rect">emi2fast@gmail.com</a>></span> wrote:<br clear="none"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">rg_test test /etc/cluster/cluster.conf start service guest1</div><div class="gmail_extra"><br clear="none"><br clear="none"><div class="gmail_quote">2013/11/21 Paras pradhan <span dir="ltr"><<a rel="nofollow" shape="rect">pradhanparas@gmail.com</a>></span><br clear="none">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hi,<div><br clear="none"></div><div>My failover domain looks like this:</div><div><br clear="none">
</div><div>
<div><failoverdomain name="myfd1" nofailback="1" ordered="1" restricted="0"></div>
<div> <failoverdomainnode name="vtst1" priority="1"/><br clear="none"></div><div> <failoverdomainnode name="vtst3" priority="2"/></div>
<div><div> <failoverdomainnode name="vtst2" priority="3"/></div></div><div><br clear="none"></div><div><br clear="none"></div><div> </failoverdomain></div>
</div>
<div><br clear="none"></div><div><br clear="none"></div><div>I have vm service that uses this failover domain. If my node vtst1 is offline, the service doesnot start on vtst3 which is 2nd in the priority.</div><div><br clear="none">
</div><div>I tried to start it with: clusvcadm -e vm:guest1 and even with -F and -m option.</div>
<div><br clear="none"></div><div>All i see is this error:</div><div><br clear="none"></div><div><div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <notice> start on vm "guest1" returned 1 (generic error) </div>
<div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <warning> #68: Failed to start vm:guest1; return value: 1 </div>
<div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <notice> Stopping service vm:guest1 </div><div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <notice> Service vm:guest1 is recovering </div><div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <warning> #71: Relocating failed service vm:guest1 </div>
<div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <notice> Service vm:guest1 is stopped </div></div><div><br clear="none"></div><div><br clear="none"></div><div>How do I debug?</div><div>Thanks!</div><span><font color="#888888"></font></span><div>
Paras.</div></div>
<br clear="none"></div></div><span><font color="#888888">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></font></span></blockquote></div><span><font color="#888888"><br clear="none">
<br clear="all"><br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</font></span></div>
<br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
<br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div>
</div></div></div>
<br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div></div></div>
<br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div></blockquote></div><br clear="none"><br clear="all"><br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div></blockquote></div><br clear="none"><br clear="all"><br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div></blockquote></div><br clear="none"><br clear="all"><br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"></div>
</div></div><br clear="none">--<br clear="none">
Linux-cluster mailing list<br clear="none">
<a rel="nofollow" shape="rect">Linux-cluster@redhat.com</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br clear="none"></blockquote></div><br clear="none"><br clear="all">
<br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div></blockquote></div></div><br clear="none"><br clear="all"><br clear="none">-- <br clear="none">esta es mi vida e me la vivo hasta que dios quiera
</div></td>
</tr>
</tbody>
</table>
</div></div></div>
</div>
</div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div>