[libvirt-users] libvir: QEMU error : cannot set ownership

Ali Shoker shokerali at gmail.com
Thu Jun 16 10:35:33 UTC 2011 

Hello everybody,

I installed eucalyptus on ubuntu10, basic configuration . Everything is ok
untill I start the instances, the disk is being created but it terminates
soon.

Environment:
NFS , KVM, ubuntu10 x64, Euca on 2 machines (wc sc cc clc on one machine,
and nc on another).
libvirtd (libvirt) 0.7.5
QEMU PC emulator version 0.12.3 (qemu-kvm-0.12.3), Copyright (c) 2003-2008
Fabrice Bellard.

Logs:
/var/log/eucalyptus/nc.log:

[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] doStartNetwork() invoked
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] StartNetwork(): SUCCESS
return from vnetStartNetwork 0
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] StartNetwork(): done
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] doRunInstance() invoked
(id=i-4C9D08C3 cores=2 disk=10 memory=512)
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]
image=emi-DDBD105C at
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]
krnel=eki-F41F10E3 at
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]
rmdsk=eri-08841148 at
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]
vlan=10 priMAC=d0:0d:4C:9D:08:C3 pubMAC=d0:0d:4C:9D:08:C3
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] network started for instance
i-4C9D08C3
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] retrieving images for
instance i-4C9D08C3 (disk limit=10240MB)...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] verifying cached file in
/var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): downloading
/tmp/walrus-digest-3D4AKY
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                   from
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET
output to /tmp/walrus-digest-3D4AKY
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3479
bytes in 3 writes
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): saved image
in /tmp/walrus-digest-3D4AKY
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] vrun(): [cp -a
/var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/ker
nel]
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] verifying cached file in
/var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): downloading
/tmp/walrus-digest-sVEVa4
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                   from
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET
output to /tmp/walrus-digest-sVEVa4
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3482
bytes in 3 writes
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): saved image
in /tmp/walrus-digest-sVEVa4
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] vrun(): [cp -a
/var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/ramdisk]
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] verifying cached file in
/var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): downloading
/tmp/walrus-digest-RQEzI9
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                   from
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET
output to /tmp/walrus-digest-RQEzI9
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 5887
bytes in 5 writes
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): saved image
in /tmp/walrus-digest-RQEzI9
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] vrun(): [cp -a
/var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk]
[Thu Jun 16 03:54:32 2011][003755][EUCAINFO  ] vrun():
[//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/partition2disk
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk 512 8280]
[Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO  ] preparing images for instance
i-4C9D08C3...
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO  ] adding key/tmp/sckey.uUHVTI
to the root file system at
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk using
(//usr/lib/eucalyptus/euca_rootwrap
//usr/share/eucalyptus/add_key.pl//usr/lib/eucalyptus/euca_mountwrap)
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO  ] vrun():
[//usr/lib/eucalyptus/euca_rootwrap
//usr/share/eucalyptus/add_key.pl//usr/lib/eucalyptus/euca_mountwrap
32256
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk /tmp/sckey.uUHVTI]
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] system_output():
[//usr/lib/eucalyptus/euca_rootwrap
//usr/share/eucalyptus/gen_kvm_libvirt_xml --ramdisk --ephemeral]
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO  ] currently running/booting:
i-4C9D08C3
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:13 2011][003755][EUCAERROR ] libvirt: monitor socket did
not show up.: No such file or directory (code=38)
[Thu Jun 16 03:55:13 2011][003755][EUCAFATAL ] hypervisor failed to start
domain
[Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:15 2011][003755][EUCAERROR ] libvirt: Domain not found: no
domain with matching name 'i-4C9D08C3' (code=42)
[Thu Jun 16 03:55:15 2011][003755][EUCAINFO  ] vrun(): [rm -rf
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/]
[Thu Jun 16 03:55:15 2011][003755][EUCAINFO  ] stopping the network
(vlan=10)
[Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:26 2011][003755][EUCAINFO  ] doTerminateInstance() invoked
(id=i-4C9D08C3)
[Thu Jun 16 03:55:26 2011][003755][EUCAERROR ] libvirt: Domain not found: no
domain with matching name 'i-4C9D08C3' (code=42)
[Thu Jun 16 03:55:26 2011][003755][EUCAWARN  ] warning: domain i-4C9D08C3 to
be terminated not running on hypervisor
[Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeInstances() invoked


 /var/log/libvirt/qemu/i-4C9D08C3.log:


LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin
/usr/bin/kvm -S -M pc-0.12 -enable-kvm -m 512 -smp 2 -name i-3D4B085B -uuid
68e17542-66cb-0240-81f5-d71c935e5a5e -nographic -chardev
socket,id=monitor,path=/var/lib/libvirt/qemu/i-3D4B085B.monitor,server,nowait
-monitor chardev:monitor -boot c -kernel
/var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel -initrd
/var/lib/eucalyptus/instances//admin/i-3D4B085B/ramdisk -append
root=/dev/sda1 console=ttyS0 -drive
file=/var/lib/eucalyptus/instances//admin/i-3D4B085B/disk,if=scsi,index=0,boot=on,format=raw
-net nic,macaddr=d0:0d:3d:4b:08:5b,vlan=0,model=e1000,name=e1000.0 -net
tap,fd=44,vlan=0,name=tap.0 -chardev
file,id=serial0,path=/var/lib/eucalyptus/instances//admin/i-3D4B085B/console.log
-serial chardev:serial0 -parallel none -usb

libvir: QEMU error : cannot set ownership on
/var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel: Permission denied


more info:

qemu user/group is eucalyptus/root


I noticed that soem process (libvirt or qemu) is changing the ownership
before termination:

Before and after:

   1.  ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/
   2. total 715912K
   3. -rw-r--r-- 1 eucalyptus eucalyptus 10767826944 2011-06-16 04:01 disk
   4. -rw------- 1 eucalyptus eucalyptus      571064 2011-06-16 04:01
   instance-checkpoint
   5. -rw-r--r-- 1 eucalyptus eucalyptus     4159008 2011-06-16 03:09 kernel
   6. -rw-r--r-- 1 eucalyptus eucalyptus         933 2011-06-16 04:01
   libvirt.xml
   7. -rw-r--r-- 1 eucalyptus eucalyptus     3899035 2011-06-16 03:09
   ramdisk
   8.
   9.  ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/
   10. total 715912K
   11. -rw-r--r-- 1 root       root       10767826944 2011-06-16 04:01 disk
   12. -rw------- 1 eucalyptus eucalyptus      571064 2011-06-16 04:01
   instance-checkpoint
   13. -rw-r--r-- 1 root       root           4159008 2011-06-16 03:09
   kernel
   14. -rw-r--r-- 1 eucalyptus eucalyptus         933 2011-06-16 04:01
   libvirt.xml
   15. -rw-r--r-- 1 root       root           3899035 2011-06-16 03:09
   ramdisk


additional info:

 ls -al /var/lib/eucalyptus
total 24K
drwxr-xr-x  5 eucalyptus eucalyptus 4096 2011-06-16 03:34 .
drwxr-xr-x 43 root       root       4096 2011-06-16 02:29 ..
-rw-------  1 eucalyptus eucalyptus   16 2011-06-16 03:34 .bash_history
drwx------  2 eucalyptus eucalyptus 4096 2011-06-16 02:52 .cache
lrwxrwxrwx  1 eucalyptus eucalyptus   14 2011-06-16 02:49 instances ->
/mnt/instances
drwx------  2 eucalyptus eucalyptus 4096 2011-06-16 02:52 keys
drwxr-xr-x  2 eucalyptus root       4096 2011-06-16 02:43 .ssh

ls -al /mnt/instances
total 16K
drwxrwxrwx 4 eucalyptus eucalyptus 4096 2011-06-16 03:09 .
drwxr-xr-x 5 eucalyptus eucalyptus 4096 2011-06-16 02:25 ..
drwxr-xr-x 2 eucalyptus eucalyptus 4096 2011-06-16 04:02 admin
drwxr-xr-x 3 eucalyptus eucalyptus 4096 2011-06-16 03:09 eucalyptus



Is there any solution to this problem? A workaround also works. Thanks


Best,
Ali
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/libvirt-users/attachments/20110616/c7937abe/attachment.htm>

More information about the libvirt-users mailing list