Hi,<div><br></div><div>I&#39;m running OpenStack on CentOS 6.3 to manage lxc instances. And running into series of problem relating libvirt and lxc interaction.</div><div><br></div><div>For example, libvirt_lxc segfault (<a href="https://bugzilla.redhat.com/show_bug.cgi?id=874549">https://bugzilla.redhat.com/show_bug.cgi?id=874549</a>) which has an upstream fix. And another bugs such as fail to start when SELinux disabled.</div>

<div><br></div><div>Finally, I decides to adopt libvirt 0.10.2, self compiled from libvirt-0.10.2-1.fc17.src.rpm. And now coming across following message when starting lxc container.</div><div><br></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px">

<div>lxcContainerGetSubtree:1199 : Failed to read /proc/mounts: No such file or directory</div></blockquote><div><br></div><div>Could it be something related to my container template setting? Or host setting? Or simply just another bug? I&#39;m not a libvirt guy, so please, do shed me some lights on how to fix it. Thanks very much.</div>

<div><br></div><div>libvirtd log with LIBVIRT_DEBUG=1</div><div>--</div><div><div>2012-11-08 12:41:10.106+0000: 28362: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:41:10.106+0000: 28362: error : virLXCControllerRun:1418 : error receiving signal from container: Input/output error</div>

<div><br></div><div>2012-11-08 12:41:10.222+0000: 24641: error : virNetDevSetOnline:536 : Cannot get interface flags on &#39;veth0&#39;: No such device</div><div>2012-11-08 12:41:10.227+0000: 24641: error : virNWFilterDHCPSnoopEnd:2131 : internal error ifname &quot;veth0&quot; not in key map</div>

<div>2012-11-08 12:41:10.229+0000: 24641: error : virNetDevGetIndex:653 : Unable to get index for interface veth0: No such device</div><div>2012-11-08 12:41:10.370+0000: 24640: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container</div>

<div>2012-11-08 12:41:10.370+0000: 24640: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container</div><div>2012-11-08 12:48:26.136+0000: 30706: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div>

<div>2012-11-08 12:48:26.136+0000: 30706: error : virDomainObjParseNode:10094 : XML error: unexpected root element &lt;domain&gt;, expecting &lt;domstatus&gt;</div><div><br></div><div><br></div><div><br></div><div>2012-11-08 12:48:50.878+0000: 30695: error : virNetSocketReadWire:1176 : Cannot recv data: Connection reset by peer</div>

<div>2012-11-08 12:48:50.977+0000: 30698: error : virLXCProcessStart:1145 : internal error guest failed to start: PATH=/bin:/sbin TERM=linux container=lxc-libvirt container_uuid=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_UUID=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_NAME=instance-00000077 LIBVIRT_LXC_CMDLINE=console=ttyS0 /sbin/init</div>

<div>2012-11-08 12:48:50.863+0000: 1: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:48:50.863+0000: 1: error : lxcContainerGetSubtree:1199 : Failed to read /proc/mounts: No such file or directory</div>

<div>2012-11-08 12:48:50.863+0000: 31202: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:48:50.863+0000: 31202: error : virLXCControllerRun:1418 : error receiving signal from container: Input/output error</div>

<div><br></div><div>2012-11-08 12:48:50.979+0000: 30698: error : virNetDevSetOnline:536 : Cannot get interface flags on &#39;veth0&#39;: No such device</div><div>2012-11-08 12:48:50.984+0000: 30698: error : virNWFilterDHCPSnoopEnd:2131 : internal error ifname &quot;veth0&quot; not in key map</div>

<div>2012-11-08 12:48:50.986+0000: 30698: error : virNetDevGetIndex:653 : Unable to get index for interface veth0: No such device</div><div>2012-11-08 12:48:51.127+0000: 30695: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container</div>

<div>2012-11-08 12:48:51.128+0000: 30695: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container</div><div>2012-11-08 12:48:54.709+0000: 30695: error : virNetSocketReadWire:1184 : End of file while reading data: Input/output error</div>

<div>2012-11-08 12:48:54.710+0000: 30695: error : virNetSocketReadWire:1184 : End of file while reading data: Input/output error</div></div><div><br></div><div><br></div><div>lxc log</div><div>--</div><div><div> tail -f lxc/instance-00000077.log </div>

<div>2012-11-08 12:48:50.723+0000: starting up</div><div>PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin LIBVIRT_DEBUG=3 LIBVIRT_LOG_OUTPUTS=3:stderr /usr/libexec/libvirt_lxc --name instance-00000077 --console 21 --security=none --handshake 24 --background --veth veth1</div>

<div>PATH=/bin:/sbin TERM=linux container=lxc-libvirt container_uuid=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_UUID=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_NAME=instance-00000077 LIBVIRT_LXC_CMDLINE=console=ttyS0 /sbin/init</div>

<div>2012-11-08 12:48:50.863+0000: 1: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:48:50.863+0000: 1: error : lxcContainerGetSubtree:1199 : Failed to read /proc/mounts: No such file or directory</div>

<div>2012-11-08 12:48:50.863+0000: 31202: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost)</div><div>2012-11-08 12:48:50.863+0000: 31202: error : virLXCControllerRun:1418 : error receiving signal from container: Input/output error</div>

</div><div><br></div><div><br></div><div>libvirt xml</div><div>--</div><div><div>&lt;domain type=&#39;lxc&#39;&gt;</div><div>  &lt;name&gt;instance-00000077&lt;/name&gt;</div><div>  &lt;uuid&gt;ecc871cb-58be-4ae4-b216-a8a62b894a7f&lt;/uuid&gt;</div>

<div>  &lt;memory unit=&#39;KiB&#39;&gt;524288&lt;/memory&gt;</div><div>  &lt;currentMemory unit=&#39;KiB&#39;&gt;524288&lt;/currentMemory&gt;</div><div>  &lt;vcpu placement=&#39;static&#39;&gt;2&lt;/vcpu&gt;</div><div>  &lt;os&gt;</div>

<div>    &lt;type arch=&#39;x86_64&#39;&gt;exe&lt;/type&gt;</div><div>    &lt;init&gt;/sbin/init&lt;/init&gt;</div><div>    &lt;cmdline&gt;console=ttyS0&lt;/cmdline&gt;</div><div>  &lt;/os&gt;</div><div>  &lt;clock offset=&#39;utc&#39;/&gt;</div>

<div>  &lt;on_poweroff&gt;destroy&lt;/on_poweroff&gt;</div><div>  &lt;on_reboot&gt;restart&lt;/on_reboot&gt;</div><div>  &lt;on_crash&gt;destroy&lt;/on_crash&gt;</div><div>  &lt;devices&gt;</div><div>    &lt;emulator&gt;/usr/libexec/libvirt_lxc&lt;/emulator&gt;</div>

<div>    &lt;filesystem type=&#39;mount&#39; accessmode=&#39;passthrough&#39;&gt;</div><div>      &lt;source dir=&#39;/home/stack/nova_state/instances/instance-00000077/rootfs&#39;/&gt;</div><div>      &lt;target dir=&#39;/&#39;/&gt;</div>

<div>    &lt;/filesystem&gt;</div><div>    &lt;interface type=&#39;bridge&#39;&gt;</div><div>      &lt;mac address=&#39;fa:16:3e:40:ec:11&#39;/&gt;</div><div>      &lt;source bridge=&#39;br100&#39;/&gt;</div><div>      &lt;filterref filter=&#39;nova-instance-instance-00000077-fa163e40ec11&#39;&gt;</div>

<div>        &lt;parameter name=&#39;DHCPSERVER&#39; value=&#39;10.48.253.1&#39;/&gt;</div><div>        &lt;parameter name=&#39;IP&#39; value=&#39;10.48.253.2&#39;/&gt;</div><div>        &lt;parameter name=&#39;PROJMASK&#39; value=&#39;255.255.255.0&#39;/&gt;</div>

<div>        &lt;parameter name=&#39;PROJNET&#39; value=&#39;10.48.253.0&#39;/&gt;</div><div>      &lt;/filterref&gt;</div><div>    &lt;/interface&gt;</div><div>    &lt;console type=&#39;pty&#39;&gt;</div><div>      &lt;target type=&#39;lxc&#39; port=&#39;0&#39;/&gt;</div>

<div>    &lt;/console&gt;</div><div>  &lt;/devices&gt;</div><div>&lt;/domain&gt;</div></div><div><br></div><div>cat /proc/mounts</div><div>--</div><div><div>[root@localhost libvirt]# cat /proc/mounts </div><div>rootfs / rootfs rw 0 0</div>

<div>proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0</div><div>sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0</div><div>devtmpfs /dev devtmpfs rw,nosuid,relatime,size=32967000k,nr_inodes=8241750,mode=755 0 0</div>

<div>devpts /dev/pts devpts rw,relatime,gid=5,mode=620,ptmxmode=000 0 0</div><div>tmpfs /dev/shm tmpfs rw,nosuid,nodev,relatime 0 0</div><div>/dev/sda2 / ext4 rw,relatime,barrier=1,data=ordered 0 0</div><div>/proc/bus/usb /proc/bus/usb usbfs rw,relatime 0 0</div>

<div>/dev/mapper/xenvg-home /home ext4 rw,relatime,barrier=1,data=ordered 0 0</div><div>none /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0</div><div>sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0</div><div>

none /noah/tmp tmpfs rw,relatime,mode=755 0 0</div><div>cgroup /cgroup/cpuset cgroup rw,relatime,cpuset 0 0</div><div>cgroup /cgroup/cpu cgroup rw,relatime,cpu 0 0</div><div>cgroup /cgroup/cpuacct cgroup rw,relatime,cpuacct 0 0</div>

<div>cgroup /cgroup/memory cgroup rw,relatime,memory 0 0</div><div>cgroup /cgroup/devices cgroup rw,relatime,devices 0 0</div><div>cgroup /cgroup/freezer cgroup rw,relatime,freezer 0 0</div><div>cgroup /cgroup/net_cls cgroup rw,relatime,net_cls 0 0</div>

<div>cgroup /cgroup/blk_io cgroup rw,relatime,blkio 0 0</div><div>cgroup /cgroup/ns cgroup rw,relatime,ns 0 0</div><div>/dev/nbd15 /home/stack/nova_state/instances/instance-00000070/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div>

<div>/dev/nbd14 /home/stack/nova_state/instances/instance-00000071/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div><div>/dev/nbd13 /home/stack/nova_state/instances/instance-00000073/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div>

<div>/dev/nbd12 /home/stack/nova_state/instances/instance-00000075/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div><div>/dev/nbd11 /home/stack/nova_state/instances/instance-00000076/rootfs ext3 rw,relatime,errors=continue,barrier=1,data=ordered 0 0</div>

<div>/dev/nbd10 /home/stack/nova_state/instances/instance-00000077/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0</div>--<br>Qiu Yu<br>
</div>