Hello everybody,<br><br>I installed eucalyptus on ubuntu10, basic configuration . Everything is ok untill I start the instances, the disk is being created but it terminates soon.<br><br>Environment:<br>NFS , KVM, ubuntu10 x64, Euca on 2 machines (wc sc cc clc on one machine, and nc on another).<br>
libvirtd (libvirt) 0.7.5<br>QEMU PC emulator version 0.12.3 (qemu-kvm-0.12.3), Copyright (c) 2003-2008 Fabrice Bellard.<br><br>Logs:<br>/var/log/eucalyptus/nc.log:<br><br>[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] doStartNetwork() invoked<br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] StartNetwork(): SUCCESS return from vnetStartNetwork 0<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] StartNetwork(): done<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] doRunInstance() invoked (id=i-4C9D08C3 cores=2 disk=10 memory=512)<br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] image=emi-DDBD105C at <a href="http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml">http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml</a><br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] krnel=eki-F41F10E3 at <a href="http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml">http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml</a><br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] rmdsk=eri-08841148 at <a href="http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml">http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml</a><br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vlan=10 priMAC=d0:0d:4C:9D:08:C3 pubMAC=d0:0d:4C:9D:08:C3<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] network started for instance i-4C9D08C3<br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] retrieving images for instance i-4C9D08C3 (disk limit=10240MB)...<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] verifying cached file in /var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel...<br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): downloading /tmp/walrus-digest-3D4AKY<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] from <a href="http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml">http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml</a><br>
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET output to /tmp/walrus-digest-3D4AKY<br>[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3479 bytes in 3 writes<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): saved image in /tmp/walrus-digest-3D4AKY<br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel /var/lib/eucalyptus/instances//admin/i-4C9D08C3/ker<br>nel]<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] verifying cached file in /var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk...<br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): downloading /tmp/walrus-digest-sVEVa4<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] from <a href="http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml">http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml</a><br>
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET output to /tmp/walrus-digest-sVEVa4<br>[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3482 bytes in 3 writes<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): saved image in /tmp/walrus-digest-sVEVa4<br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk /var/lib/eucalyptus/instances//admin/i-4C9D08C3/ramdisk]<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] verifying cached file in /var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk...<br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): downloading /tmp/walrus-digest-RQEzI9<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] from <a href="http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml">http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml</a><br>
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET output to /tmp/walrus-digest-RQEzI9<br>[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 5887 bytes in 5 writes<br>[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): saved image in /tmp/walrus-digest-RQEzI9<br>
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk]<br>[Thu Jun 16 03:54:32 2011][003755][EUCAINFO ] vrun(): [//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/partition2disk /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk 512 8280]<br>
[Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>[Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>[Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] preparing images for instance i-4C9D08C3...<br>
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] adding key/tmp/sckey.uUHVTI to the root file system at /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk using (//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/<a href="http://add_key.pl">add_key.pl</a> //usr/lib/eucalyptus/euca_mountwrap)<br>
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] vrun(): [//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/<a href="http://add_key.pl">add_key.pl</a> //usr/lib/eucalyptus/euca_mountwrap 32256 /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk /tmp/sckey.uUHVTI]<br>
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] system_output(): [//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/gen_kvm_libvirt_xml --ramdisk --ephemeral]<br>[Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] currently running/booting: i-4C9D08C3<br>
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>[Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>
[Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>[Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>[Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>
[Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>[Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>[Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>
[Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>[Thu Jun 16 03:55:13 2011][003755][EUCAERROR ] libvirt: monitor socket did not show up.: No such file or directory (code=38)<br>[Thu Jun 16 03:55:13 2011][003755][EUCAFATAL ] hypervisor failed to start domain<br>
[Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>[Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>[Thu Jun 16 03:55:15 2011][003755][EUCAERROR ] libvirt: Domain not found: no domain with matching name 'i-4C9D08C3' (code=42)<br>
[Thu Jun 16 03:55:15 2011][003755][EUCAINFO ] vrun(): [rm -rf /var/lib/eucalyptus/instances//admin/i-4C9D08C3/]<br>[Thu Jun 16 03:55:15 2011][003755][EUCAINFO ] stopping the network (vlan=10)<br>[Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>
[Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>[Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>[Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>
[Thu Jun 16 03:55:26 2011][003755][EUCAINFO ] doTerminateInstance() invoked (id=i-4C9D08C3)<br>[Thu Jun 16 03:55:26 2011][003755][EUCAERROR ] libvirt: Domain not found: no domain with matching name 'i-4C9D08C3' (code=42)<br>
[Thu Jun 16 03:55:26 2011][003755][EUCAWARN ] warning: domain i-4C9D08C3 to be terminated not running on hypervisor<br>[Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeResource() invoked<br>[Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeInstances() invoked<br>
<br><br> /var/log/libvirt/qemu/i-4C9D08C3.log:<br><br><br>LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin /usr/bin/kvm -S -M pc-0.12 -enable-kvm -m 512 -smp 2 -name i-3D4B085B -uuid 68e17542-66cb-0240-81f5-d71c935e5a5e -nographic -chardev socket,id=monitor,path=/var/lib/libvirt/qemu/i-3D4B085B.monitor,server,nowait -monitor chardev:monitor -boot c -kernel /var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel -initrd /var/lib/eucalyptus/instances//admin/i-3D4B085B/ramdisk -append root=/dev/sda1 console=ttyS0 -drive file=/var/lib/eucalyptus/instances//admin/i-3D4B085B/disk,if=scsi,index=0,boot=on,format=raw -net nic,macaddr=d0:0d:3d:4b:08:5b,vlan=0,model=e1000,name=e1000.0 -net tap,fd=44,vlan=0,name=tap.0 -chardev file,id=serial0,path=/var/lib/eucalyptus/instances//admin/i-3D4B085B/console.log -serial chardev:serial0 -parallel none -usb<br>
<br>libvir: QEMU error : cannot set ownership on /var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel: Permission denied<br><br><br>more info:<br><br>qemu user/group is eucalyptus/root<br><br><br>I noticed that soem process (libvirt or qemu) is changing the ownership before termination:<br>
<br>Before and after:<br><ol><li class="li2"><div class="de2"> ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/</div></li><li class="li1"><div class="de1">total 715912K</div></li><li class="li2"><div class="de2">-rw-r--r-- 1 eucalyptus eucalyptus 10767826944 2011-06-16 04:01 disk</div>
</li><li class="li1"><div class="de1">-rw------- 1 eucalyptus eucalyptus 571064 2011-06-16 04:01 instance-checkpoint</div></li><li class="li2"><div class="de2">-rw-r--r-- 1 eucalyptus eucalyptus 4159008 2011-06-16 03:09 kernel</div>
</li><li class="li1"><div class="de1">-rw-r--r-- 1 eucalyptus eucalyptus 933 2011-06-16 04:01 libvirt.xml</div></li><li class="li2"><div class="de2">-rw-r--r-- 1 eucalyptus eucalyptus 3899035 2011-06-16 03:09 ramdisk</div>
</li><li class="li2"><br></li><li class="li1"><div class="de1"> ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/</div></li><li class="li2"><div class="de2">total 715912K</div></li><li class="li1"><div class="de1">-rw-r--r-- 1 root root 10767826944 2011-06-16 04:01 disk</div>
</li><li class="li2"><div class="de2">-rw------- 1 eucalyptus eucalyptus 571064 2011-06-16 04:01 instance-checkpoint</div></li><li class="li1"><div class="de1">-rw-r--r-- 1 root root 4159008 2011-06-16 03:09 kernel</div>
</li><li class="li2"><div class="de2">-rw-r--r-- 1 eucalyptus eucalyptus 933 2011-06-16 04:01 libvirt.xml</div></li><li class="li1"><div class="de1">-rw-r--r-- 1 root root 3899035 2011-06-16 03:09 ramdisk</div>
</li></ol><br>additional info:<br><br> ls -al /var/lib/eucalyptus<br>total 24K<br>drwxr-xr-x 5 eucalyptus eucalyptus 4096 2011-06-16 03:34 .<br>drwxr-xr-x 43 root root 4096 2011-06-16 02:29 ..<br>-rw------- 1 eucalyptus eucalyptus 16 2011-06-16 03:34 .bash_history<br>
drwx------ 2 eucalyptus eucalyptus 4096 2011-06-16 02:52 .cache<br>lrwxrwxrwx 1 eucalyptus eucalyptus 14 2011-06-16 02:49 instances -> /mnt/instances<br>drwx------ 2 eucalyptus eucalyptus 4096 2011-06-16 02:52 keys<br>
drwxr-xr-x 2 eucalyptus root 4096 2011-06-16 02:43 .ssh<br><br>ls -al /mnt/instances<br>total 16K<br>drwxrwxrwx 4 eucalyptus eucalyptus 4096 2011-06-16 03:09 .<br>drwxr-xr-x 5 eucalyptus eucalyptus 4096 2011-06-16 02:25 ..<br>
drwxr-xr-x 2 eucalyptus eucalyptus 4096 2011-06-16 04:02 admin<br>drwxr-xr-x 3 eucalyptus eucalyptus 4096 2011-06-16 03:09 eucalyptus<br><br><br><br>Is there any solution to this problem? A workaround also works. Thanks<br>
<br><br>Best,<br>Ali<br><br>