<div dir="ltr"><div>I found the workaround to my issue. What i did is:</div><div><br></div><div>run the vm using xm and then start using cluvscadm. This works for me for the time being but I am not sure what is causing this. This is what I did</div>
<div><br></div><div>xm create /vms_c/guest1</div><div>clusvcadm -e vm: guest1 ( This detects that guest1 is up and quickly changes its status to success)</div><div><br></div>Although i used virt-install, it also create a xem format configuration file and since use_virsh=0 it should be able to use this xen format config file. This is my vm configuration:<div>
<br></div><div><div>---</div><div>name = "guest1"</div><div>maxmem = 2048</div><div>memory = 512</div><div>vcpus = 1</div><div>#cpus="1-2"</div><div>bootloader = "/usr/bin/pygrub"</div><div>on_poweroff = "destroy"</div>
<div>on_reboot = "restart"</div><div>on_crash = "restart"</div><div>vfb = [ ]</div><div>disk = [ "tap:aio:/vms_c/guest1.img,xvda,w", "tap:aio:/vms_c/guest1-disk.img,xvdb,w" ]</div>
<div>vif = [ "rate=10MB/s,mac=00:16:3e:6b:be:71,bridge=xenbr0" ]</div></div><div><br></div><div>---</div><div><br></div><div>Thanks for you help Emmanuel ! Really appreciate it.</div><div><br></div><div>-Paras.</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Nov 22, 2013 at 11:10 AM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>ok, but your vm doesn't start on others nodes, i think, for configuration problems<br>
================================================================<br><div><div class="im"><div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <notice> start on vm "guest1" returned 1 (generic error) </div>
<div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <warning> #68: Failed to start vm:guest1; return value: 1 </div>
<div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <notice> Stopping service vm:guest1 </div><div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <notice> Service vm:guest1 is recovering </div><div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <warning> #71: Relocating failed service vm:guest1 </div>
</div><div><div class="im">Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <notice> Service vm:guest1 is stopped <br></div>================================================================<br></div><div>in few words, try in every cluster node<div class="im">
<br><br>export OCF_RESKEY_name="guest1" ; OCF_RESKEY_path="/vms_c"<br>
<br>set -x<br>/usr/share/cluster/vm.sh start<br></div>
/usr/share/cluster/vm.sh stop<br><br>after you check if your vm can start and stop on every cluster node,<br><br></div></div>/usr/share/cluster/vm.sh start<br>/usr/share/cluster/vm.sh migrate name_of_a_cluster_node<br><br>
</div>can you show me your vm configuration under /vms_c?<br><br></div>Thanks <br></div><span class="HOEnZb"><font color="#888888">Emmanuel<br></font></span></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/11/22 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">And also to test I made use_virsh=1 , same problem. The vm does not start up if the FD domains are offline. <span><font color="#888888"><div>
<br></div><div>-Paras.</div></font></span></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Nov 22, 2013 at 10:37 AM, Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Well thats seems to theoretically correct. But right now my cluser has use_virsh=0 and I don't have any issue untill my mebmers on the failover domains are offline. So wondering what is it that clusvcadm -e is looking when I don't use virsh .<div>
<br></div><div><br></div></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Nov 22, 2013 at 10:05 AM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">If you used virt-install, i think you need use virsh, the cluster uses xm xen command if you got use_virsh=0 and virsh if you got use_virsh=1 in your cluster config<br>
</div><div><div><div class="gmail_extra"><br><br>
<div class="gmail_quote">2013/11/22 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><p>I use virt-install to create virtual machines. Is there a way to debug why clusvcadm -e vm:guest1 is failing? vm.sh seems to use virsh and my cluster.conf has use_virsh=0</p><p><br></p><p>Thanks</p><span><font color="#888888"><p>
Paras.</p></font></span><div><div>
<p><br></p><p>On Nov 21, 2013 5:53 PM, "emmanuel segura" <<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>> wrote:<br></p><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">but did you configure your vm with xen tools or using virt-manager?<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/11/22 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Well no i don't want to use virsh. But as we are debugging with virsh now i found a strange issue.<div>
<br></div><div>I exported an xml file and imported to all nodes . Ran</div><div><br></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br>
</span></div><div><span style="font-family:arial,sans-serif;font-size:13px">---</span></div><div><div><span style="font-family:arial,sans-serif;font-size:13px">name="guest1" path="/vms_c"</span><br style="font-family:arial,sans-serif;font-size:13px">
<br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px">export OCF_RESKEY_name="guest1" ; OCF_RESKEY_path="/vms_c"</span><br style="font-family:arial,sans-serif;font-size:13px">
<br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px">set -x</span><br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px">/usr/share/cluster/vm.sh start</span><br style="font-family:arial,sans-serif;font-size:13px">
<span style="font-family:arial,sans-serif;font-size:13px">set +x</span><br></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div></div><div><span style="font-family:arial,sans-serif;font-size:13px">--</span></div>
<div><font face="arial, sans-serif">vm starts now. BUT from a cluster service : cluvscam -e vm:guest1 , same error.</font><br></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br>
</span></div><div><font face="arial, sans-serif">So if i populate all my domains' config files to all my cluser nodes and make use_virsh=1, then the issue is resolved. But this is a lot of work for those who have hundreds of vm.</font></div>
<div><font face="arial, sans-serif"><br></font></div><div><font face="arial, sans-serif">vm.start uses virsh . Is there a way to tell him not use virsh?</font></div><div><font face="arial, sans-serif"><br></font></div><div>
<font face="arial, sans-serif"><br></font></div><div><font face="arial, sans-serif">Thanks</font></div><span><font color="#888888"><div><font face="arial, sans-serif">Paras.</font></div></font></span></div>
<div><div><div class="gmail_extra"><br><br><div class="gmail_quote">
On Thu, Nov 21, 2013 at 5:19 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div><div>if you are using virsh for manage your vms, change this in your cluster.conf <br><br></div>from<br>use_virsh="0"<br></div>to<br>use_virsh="1"<br></div><div><div>
<div class="gmail_extra"><br>
<br><div class="gmail_quote">2013/11/22 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">I think i found the problem. <div><br></div><div>virsh list --all does not show my vm . This is because it was created on another node. and another node has it. Now I want to start the service on a different node in which it was not created or where virsh list --all does not have an entry. Is it possible to create this entry using a xen config file?Looks like this is now a Xen issue rather than a linux-cluster issue . :)</div>
<span><font color="#888888">
<div><br></div><div>Paras.</div><div><br></div></font></span></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, Nov 21, 2013 at 4:58 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>1:did you verify your xen livemigration configuration?<br></div>2: where you vm disk reside?<br>
</div>3: can you see your vm defined on every cluster node with xm list?<br></div><div><div><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/11/21 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">This is what I get<div><br></div><div><div>Hypervisor: xen</div><div>Management tool: virsh</div><div>Hypervisor URI: xen:///</div><div>Migration URI format: xenmigr://target_host/</div><div>Virtual machine guest1 is error: failed to get domain 'guest1'</div>
<div>error: Domain not found: xenUnifiedDomainLookupByName</div><div><br></div><div><debug> virsh -c xen:/// start guest1</div><div>error: failed to get domain 'guest1'</div><div>error: Domain not found: xenUnifiedDomainLookupByName</div>
<div><br></div><div>++ printf '\033]0;%s@%s:%s\007' root vtst3 '~'</div><div>[root@cvtst3 ~]# set +x</div><div>+ set +x</div></div><div><br></div><div><br></div><div>--</div><div><br></div><div><br></div>
<div>
I am wondering why it failed to get domain .</div><span><font color="#888888"><div><br></div><div><br></div><div>-Paras.</div><div><br></div></font></span></div><div><div><div class="gmail_extra">
<br><br><div class="gmail_quote">On Thu, Nov 21, 2013 at 4:43 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">yes<br></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">
2013/11/21 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Well it is guest1. Isn't it?.<div><br></div><div><vm autostart="1" domain="myfd1" exclusive="0" max_restarts="0" name="guest1" path="/vms_c" recovery="restart" restart_expire_time="0" use_virsh="0"/><br>
</div><div><br></div><div>It is a vm service if it matters.</div><span><font color="#888888"><div><br></div><div>-Paras.</div><div><br></div><div><br></div></font></span></div><div><div>
<div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, Nov 21, 2013 at 4:22 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">use the servicename you defined in your cluster.conf<br></div><div><div><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/11/21 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Says:<div><br></div><div><div>Running in test mode.</div><div>No resource guest1 of type service found</div>
</div><span><font color="#888888"><div><br></div><div>-Paras.</div></font></span></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">
On Thu, Nov 21, 2013 at 4:07 PM, emmanuel segura <span dir="ltr"><<a href="mailto:emi2fast@gmail.com" target="_blank">emi2fast@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">rg_test test /etc/cluster/cluster.conf start service guest1</div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/11/21 Paras pradhan <span dir="ltr"><<a href="mailto:pradhanparas@gmail.com" target="_blank">pradhanparas@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hi,<div><br></div><div>My failover domain looks like this:</div><div><br></div><div>
<div><failoverdomain name="myfd1" nofailback="1" ordered="1" restricted="0"></div>
<div> <failoverdomainnode name="vtst1" priority="1"/><br></div><div> <failoverdomainnode name="vtst3" priority="2"/></div>
<div><div> <failoverdomainnode name="vtst2" priority="3"/></div></div><div><br></div><div><br></div><div> </failoverdomain></div></div>
<div><br></div><div><br></div><div>I have vm service that uses this failover domain. If my node vtst1 is offline, the service doesnot start on vtst3 which is 2nd in the priority.</div><div><br></div><div>I tried to start it with: clusvcadm -e vm:guest1 and even with -F and -m option.</div>
<div><br></div><div>All i see is this error:</div><div><br></div><div><div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <notice> start on vm "guest1" returned 1 (generic error) </div><div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <warning> #68: Failed to start vm:guest1; return value: 1 </div>
<div>Nov 21 15:40:29 vtst3 clurgmgrd[13911]: <notice> Stopping service vm:guest1 </div><div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <notice> Service vm:guest1 is recovering </div><div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <warning> #71: Relocating failed service vm:guest1 </div>
<div>Nov 21 15:40:35 vtst3 clurgmgrd[13911]: <notice> Service vm:guest1 is stopped </div></div><div><br></div><div><br></div><div>How do I debug?</div><div>Thanks!</div><span><font color="#888888"><div>
Paras.</div></font></span></div>
<br></div></div><span><font color="#888888">--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></font></span></blockquote></div><span><font color="#888888"><br>
<br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</font></span></div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div>
</div></div></div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com" target="_blank">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><br>-- <br>esta es mi vida e me la vivo hasta que dios quiera
</div>
</div></div><br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>