Hi,<div><br></div><div>I'm running OpenStack on CentOS 6.3 to manage lxc instances. And running into series of problem relating libvirt and lxc interaction.</div><div><br></div><div>For example, libvirt_lxc segfault (<a href="https://bugzilla.redhat.com/show_bug.cgi?id=874549">https://bugzilla.redhat.com/show_bug.cgi?id=874549</a>) which has an upstream fix. And another bugs such as fail to start when SELinux disabled.</div>
<div><br></div><div>Finally, I decides to adopt libvirt 0.10.2, self compiled from libvirt-0.10.2-1.fc17.src.rpm. And now coming across following message when starting lxc container.</div><div><br></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px">
<div>lxcContainerGetSubtree:1199 : Failed to read /proc/mounts: No such file or directory</div></blockquote><div><br></div><div>Could it be something related to my container template setting? Or host setting? Or simply just another bug? I'm not a libvirt guy, so please, do shed me some lights on how to fix it. Thanks very much.</div>
<div><br></div><div>libvirtd log with LIBVIRT_DEBUG=1</div><div>--</div><div><div>2012-11-08 12:41:10.106+0000: 28362: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:41:10.106+0000: 28362: error : virLXCControllerRun:1418 : error receiving signal from container: Input/output error</div>
<div><br></div><div>2012-11-08 12:41:10.222+0000: 24641: error : virNetDevSetOnline:536 : Cannot get interface flags on 'veth0': No such device</div><div>2012-11-08 12:41:10.227+0000: 24641: error : virNWFilterDHCPSnoopEnd:2131 : internal error ifname "veth0" not in key map</div>
<div>2012-11-08 12:41:10.229+0000: 24641: error : virNetDevGetIndex:653 : Unable to get index for interface veth0: No such device</div><div>2012-11-08 12:41:10.370+0000: 24640: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container</div>
<div>2012-11-08 12:41:10.370+0000: 24640: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container</div><div>2012-11-08 12:48:26.136+0000: 30706: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div>
<div>2012-11-08 12:48:26.136+0000: 30706: error : virDomainObjParseNode:10094 : XML error: unexpected root element <domain>, expecting <domstatus></div><div><br></div><div><br></div><div><br></div><div>2012-11-08 12:48:50.878+0000: 30695: error : virNetSocketReadWire:1176 : Cannot recv data: Connection reset by peer</div>
<div>2012-11-08 12:48:50.977+0000: 30698: error : virLXCProcessStart:1145 : internal error guest failed to start: PATH=/bin:/sbin TERM=linux container=lxc-libvirt container_uuid=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_UUID=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_NAME=instance-00000077 LIBVIRT_LXC_CMDLINE=console=ttyS0 /sbin/init</div>
<div>2012-11-08 12:48:50.863+0000: 1: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:48:50.863+0000: 1: error : lxcContainerGetSubtree:1199 : Failed to read /proc/mounts: No such file or directory</div>
<div>2012-11-08 12:48:50.863+0000: 31202: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:48:50.863+0000: 31202: error : virLXCControllerRun:1418 : error receiving signal from container: Input/output error</div>
<div><br></div><div>2012-11-08 12:48:50.979+0000: 30698: error : virNetDevSetOnline:536 : Cannot get interface flags on 'veth0': No such device</div><div>2012-11-08 12:48:50.984+0000: 30698: error : virNWFilterDHCPSnoopEnd:2131 : internal error ifname "veth0" not in key map</div>
<div>2012-11-08 12:48:50.986+0000: 30698: error : virNetDevGetIndex:653 : Unable to get index for interface veth0: No such device</div><div>2012-11-08 12:48:51.127+0000: 30695: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container</div>
<div>2012-11-08 12:48:51.128+0000: 30695: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container</div><div>2012-11-08 12:48:54.709+0000: 30695: error : virNetSocketReadWire:1184 : End of file while reading data: Input/output error</div>
<div>2012-11-08 12:48:54.710+0000: 30695: error : virNetSocketReadWire:1184 : End of file while reading data: Input/output error</div></div><div><br></div><div><br></div><div>lxc log</div><div>--</div><div><div> tail -f lxc/instance-00000077.log </div>
<div>2012-11-08 12:48:50.723+0000: starting up</div><div>PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin LIBVIRT_DEBUG=3 LIBVIRT_LOG_OUTPUTS=3:stderr /usr/libexec/libvirt_lxc --name instance-00000077 --console 21 --security=none --handshake 24 --background --veth veth1</div>
<div>PATH=/bin:/sbin TERM=linux container=lxc-libvirt container_uuid=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_UUID=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_NAME=instance-00000077 LIBVIRT_LXC_CMDLINE=console=ttyS0 /sbin/init</div>
<div>2012-11-08 12:48:50.863+0000: 1: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:48:50.863+0000: 1: error : lxcContainerGetSubtree:1199 : Failed to read /proc/mounts: No such file or directory</div>
<div>2012-11-08 12:48:50.863+0000: 31202: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:48:50.863+0000: 31202: error : virLXCControllerRun:1418 : error receiving signal from container: Input/output error</div>
</div><div><br></div><div><br></div><div>libvirt xml</div><div>--</div><div><div><domain type='lxc'></div><div> <name>instance-00000077</name></div><div> <uuid>ecc871cb-58be-4ae4-b216-a8a62b894a7f</uuid></div>
<div> <memory unit='KiB'>524288</memory></div><div> <currentMemory unit='KiB'>524288</currentMemory></div><div> <vcpu placement='static'>2</vcpu></div><div> <os></div>
<div> <type arch='x86_64'>exe</type></div><div> <init>/sbin/init</init></div><div> <cmdline>console=ttyS0</cmdline></div><div> </os></div><div> <clock offset='utc'/></div>
<div> <on_poweroff>destroy</on_poweroff></div><div> <on_reboot>restart</on_reboot></div><div> <on_crash>destroy</on_crash></div><div> <devices></div><div> <emulator>/usr/libexec/libvirt_lxc</emulator></div>
<div> <filesystem type='mount' accessmode='passthrough'></div><div> <source dir='/home/stack/nova_state/instances/instance-00000077/rootfs'/></div><div> <target dir='/'/></div>
<div> </filesystem></div><div> <interface type='bridge'></div><div> <mac address='fa:16:3e:40:ec:11'/></div><div> <source bridge='br100'/></div><div> <filterref filter='nova-instance-instance-00000077-fa163e40ec11'></div>
<div> <parameter name='DHCPSERVER' value='10.48.253.1'/></div><div> <parameter name='IP' value='10.48.253.2'/></div><div> <parameter name='PROJMASK' value='255.255.255.0'/></div>
<div> <parameter name='PROJNET' value='10.48.253.0'/></div><div> </filterref></div><div> </interface></div><div> <console type='pty'></div><div> <target type='lxc' port='0'/></div>
<div> </console></div><div> </devices></div><div></domain></div></div><div><br></div><div>cat /proc/mounts</div><div>--</div><div><div>[root@localhost libvirt]# cat /proc/mounts </div><div>rootfs / rootfs rw 0 0</div>
<div>proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0</div><div>sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0</div><div>devtmpfs /dev devtmpfs rw,nosuid,relatime,size=32967000k,nr_inodes=8241750,mode=755 0 0</div>
<div>devpts /dev/pts devpts rw,relatime,gid=5,mode=620,ptmxmode=000 0 0</div><div>tmpfs /dev/shm tmpfs rw,nosuid,nodev,relatime 0 0</div><div>/dev/sda2 / ext4 rw,relatime,barrier=1,data=ordered 0 0</div><div>/proc/bus/usb /proc/bus/usb usbfs rw,relatime 0 0</div>
<div>/dev/mapper/xenvg-home /home ext4 rw,relatime,barrier=1,data=ordered 0 0</div><div>none /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0</div><div>sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0</div><div>
none /noah/tmp tmpfs rw,relatime,mode=755 0 0</div><div>cgroup /cgroup/cpuset cgroup rw,relatime,cpuset 0 0</div><div>cgroup /cgroup/cpu cgroup rw,relatime,cpu 0 0</div><div>cgroup /cgroup/cpuacct cgroup rw,relatime,cpuacct 0 0</div>
<div>cgroup /cgroup/memory cgroup rw,relatime,memory 0 0</div><div>cgroup /cgroup/devices cgroup rw,relatime,devices 0 0</div><div>cgroup /cgroup/freezer cgroup rw,relatime,freezer 0 0</div><div>cgroup /cgroup/net_cls cgroup rw,relatime,net_cls 0 0</div>
<div>cgroup /cgroup/blk_io cgroup rw,relatime,blkio 0 0</div><div>cgroup /cgroup/ns cgroup rw,relatime,ns 0 0</div><div>/dev/nbd15 /home/stack/nova_state/instances/instance-00000070/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div>
<div>/dev/nbd14 /home/stack/nova_state/instances/instance-00000071/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div><div>/dev/nbd13 /home/stack/nova_state/instances/instance-00000073/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div>
<div>/dev/nbd12 /home/stack/nova_state/instances/instance-00000075/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div><div>/dev/nbd11 /home/stack/nova_state/instances/instance-00000076/rootfs ext3 rw,relatime,errors=continue,barrier=1,data=ordered 0 0</div>
<div>/dev/nbd10 /home/stack/nova_state/instances/instance-00000077/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div>--<br>Qiu Yu<br>
</div>