- Users - libvirt List Archives

[libvirt-users] OpenStack+libvirt+lxc: lxcContainerGetSubtree:1199 : Failed to read /proc/mounts
by unicell 08 Nov '12

08 Nov '12

Hi, I'm running OpenStack on CentOS 6.3 to manage lxc instances. And running into series of problem relating libvirt and lxc interaction. For example, libvirt_lxc segfault ( https://bugzilla.redhat.com/show_bug.cgi?id=874549) which has an upstream fix. And another bugs such as fail to start when SELinux disabled. Finally, I decides to adopt libvirt 0.10.2, self compiled from libvirt-0.10.2-1.fc17.src.rpm. And now coming across following message when starting lxc container. lxcContainerGetSubtree:1199 : Failed to read /proc/mounts: No such file or directory Could it be something related to my container template setting? Or host setting? Or simply just another bug? I'm not a libvirt guy, so please, do shed me some lights on how to fix it. Thanks very much. libvirtd log with LIBVIRT_DEBUG=1 -- 2012-11-08 12:41:10.106+0000: 28362: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost) 2012-11-08 12:41:10.106+0000: 28362: error : virLXCControllerRun:1418 : error receiving signal from container: Input/output error 2012-11-08 12:41:10.222+0000: 24641: error : virNetDevSetOnline:536 : Cannot get interface flags on 'veth0': No such device 2012-11-08 12:41:10.227+0000: 24641: error : virNWFilterDHCPSnoopEnd:2131 : internal error ifname "veth0" not in key map 2012-11-08 12:41:10.229+0000: 24641: error : virNetDevGetIndex:653 : Unable to get index for interface veth0: No such device 2012-11-08 12:41:10.370+0000: 24640: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container 2012-11-08 12:41:10.370+0000: 24640: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container 2012-11-08 12:48:26.136+0000: 30706: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost) 2012-11-08 12:48:26.136+0000: 30706: error : virDomainObjParseNode:10094 : XML error: unexpected root element <domain>, expecting <domstatus> 2012-11-08 12:48:50.878+0000: 30695: error : virNetSocketReadWire:1176 : Cannot recv data: Connection reset by peer 2012-11-08 12:48:50.977+0000: 30698: error : virLXCProcessStart:1145 : internal error guest failed to start: PATH=/bin:/sbin TERM=linux container=lxc-libvirt container_uuid=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_UUID=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_NAME=instance-00000077 LIBVIRT_LXC_CMDLINE=console=ttyS0 /sbin/init 2012-11-08 12:48:50.863+0000: 1: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost) 2012-11-08 12:48:50.863+0000: 1: error : lxcContainerGetSubtree:1199 : Failed to read /proc/mounts: No such file or directory 2012-11-08 12:48:50.863+0000: 31202: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost) 2012-11-08 12:48:50.863+0000: 31202: error : virLXCControllerRun:1418 : error receiving signal from container: Input/output error 2012-11-08 12:48:50.979+0000: 30698: error : virNetDevSetOnline:536 : Cannot get interface flags on 'veth0': No such device 2012-11-08 12:48:50.984+0000: 30698: error : virNWFilterDHCPSnoopEnd:2131 : internal error ifname "veth0" not in key map 2012-11-08 12:48:50.986+0000: 30698: error : virNetDevGetIndex:653 : Unable to get index for interface veth0: No such device 2012-11-08 12:48:51.127+0000: 30695: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container 2012-11-08 12:48:51.128+0000: 30695: error : virLXCProcessStop:701 : internal error Invalid PID -1 for container 2012-11-08 12:48:54.709+0000: 30695: error : virNetSocketReadWire:1184 : End of file while reading data: Input/output error 2012-11-08 12:48:54.710+0000: 30695: error : virNetSocketReadWire:1184 : End of file while reading data: Input/output error lxc log -- tail -f lxc/instance-00000077.log 2012-11-08 12:48:50.723+0000: starting up PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin LIBVIRT_DEBUG=3 LIBVIRT_LOG_OUTPUTS=3:stderr /usr/libexec/libvirt_lxc --name instance-00000077 --console 21 --security=none --handshake 24 --background --veth veth1 PATH=/bin:/sbin TERM=linux container=lxc-libvirt container_uuid=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_UUID=ecc871cb-58be-4ae4-b216-a8a62b894a7f LIBVIRT_LXC_NAME=instance-00000077 LIBVIRT_LXC_CMDLINE=console=ttyS0 /sbin/init 2012-11-08 12:48:50.863+0000: 1: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost) 2012-11-08 12:48:50.863+0000: 1: error : lxcContainerGetSubtree:1199 : Failed to read /proc/mounts: No such file or directory 2012-11-08 12:48:50.863+0000: 31202: info : libvirt version: 0.10.2, package: 1.el6 (Unknown, 2012-11-08-20:20:52, localhost) 2012-11-08 12:48:50.863+0000: 31202: error : virLXCControllerRun:1418 : error receiving signal from container: Input/output error libvirt xml -- <domain type='lxc'> <name>instance-00000077</name> <uuid>ecc871cb-58be-4ae4-b216-a8a62b894a7f</uuid> <memory unit='KiB'>524288</memory> <currentMemory unit='KiB'>524288</currentMemory> <vcpu placement='static'>2</vcpu> <os> <type arch='x86_64'>exe</type> <init>/sbin/init</init> <cmdline>console=ttyS0</cmdline> </os> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/libexec/libvirt_lxc</emulator> <filesystem type='mount' accessmode='passthrough'> <source dir='/home/stack/nova_state/instances/instance-00000077/rootfs'/> <target dir='/'/> </filesystem> <interface type='bridge'> <mac address='fa:16:3e:40:ec:11'/> <source bridge='br100'/> <filterref filter='nova-instance-instance-00000077-fa163e40ec11'> <parameter name='DHCPSERVER' value='10.48.253.1'/> <parameter name='IP' value='10.48.253.2'/> <parameter name='PROJMASK' value='255.255.255.0'/> <parameter name='PROJNET' value='10.48.253.0'/> </filterref> </interface> <console type='pty'> <target type='lxc' port='0'/> </console> </devices> </domain> cat /proc/mounts -- [root@localhost libvirt]# cat /proc/mounts rootfs / rootfs rw 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,nosuid,relatime,size=32967000k,nr_inodes=8241750,mode=755 0 0 devpts /dev/pts devpts rw,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,relatime 0 0 /dev/sda2 / ext4 rw,relatime,barrier=1,data=ordered 0 0 /proc/bus/usb /proc/bus/usb usbfs rw,relatime 0 0 /dev/mapper/xenvg-home /home ext4 rw,relatime,barrier=1,data=ordered 0 0 none /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 none /noah/tmp tmpfs rw,relatime,mode=755 0 0 cgroup /cgroup/cpuset cgroup rw,relatime,cpuset 0 0 cgroup /cgroup/cpu cgroup rw,relatime,cpu 0 0 cgroup /cgroup/cpuacct cgroup rw,relatime,cpuacct 0 0 cgroup /cgroup/memory cgroup rw,relatime,memory 0 0 cgroup /cgroup/devices cgroup rw,relatime,devices 0 0 cgroup /cgroup/freezer cgroup rw,relatime,freezer 0 0 cgroup /cgroup/net_cls cgroup rw,relatime,net_cls 0 0 cgroup /cgroup/blk_io cgroup rw,relatime,blkio 0 0 cgroup /cgroup/ns cgroup rw,relatime,ns 0 0 /dev/nbd15 /home/stack/nova_state/instances/instance-00000070/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0 /dev/nbd14 /home/stack/nova_state/instances/instance-00000071/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0 /dev/nbd13 /home/stack/nova_state/instances/instance-00000073/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0 /dev/nbd12 /home/stack/nova_state/instances/instance-00000075/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0 /dev/nbd11 /home/stack/nova_state/instances/instance-00000076/rootfs ext3 rw,relatime,errors=continue,barrier=1,data=ordered 0 0 /dev/nbd10 /home/stack/nova_state/instances/instance-00000077/rootfs ext3 rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered 0 0 -- Qiu Yu

2 2

[libvirt-users] Problems when filtering on icmpv6
by Guido Winkelmann 08 Nov '12

08 Nov '12

Hi, I am trying to prevent my qemu guest machines from sending IPv6 router advertisements over their network device. To that end, I have written this filter definition: <filter name='no-ipv6-router-advertisement' chain='root' priority='-690'> <rule action='drop' direction='out' priority='600'> <icmpv6 type='134'/> </rule> <rule action='drop' direction='out' priority='600'> <icmpv6 type='153'/> </rule> </filter> As soon as I try to use this filter, though, I get the following error (in virsh): error: Error while building firewall: Some rules could not be created for interface vnet0: Failure to execute command '$IPT -A libvirt-out -m physdev -- physdev-out vnet0 -g FP-vnet0' : 'ip6tables: No chain/target/match by that name.'. I am (trying to) use this filter by including it in here: <filter name='clean-traffic-with-v6' chain='root'> <filterref filter='no-mac-spoofing'/> <filterref filter='no-ip-spoofing'/> <filterref filter='no-dhcp-server'/> <rule action='accept' direction='out' priority='-650'> <mac protocolid='ipv4'/> </rule> <filterref filter='allow-incoming-ipv4'/> <filterref filter='no-ipv6-spoofing'/> <filterref filter='no-ipv6-router-advertisement'/> <filterref filter='no-dhcpv6-server'/> <rule action='accept' direction='out' priority='-600'> <mac protocolid='ipv6'/> </rule> <filterref filter='allow-incoming-ipv6'/> <filterref filter='no-arp-spoofing'/> <rule action='accept' direction='inout' priority='-500'> <mac protocolid='arp'/> </rule> <filterref filter='no-other-l2-traffic'/> <filterref filter='qemu-announce-self'/> </filter> Without the line <filterref filter='no-ipv6-router-advertisement'/> this filter works fine. When running a domain with this filter without the no-ipv6-router- advertisement filterref, my ip6tables look like this: # ip6tables-save # Generated by ip6tables-save v1.4.13 on Wed Nov 7 17:46:32 2012 *mangle :PREROUTING ACCEPT [146:12680] :INPUT ACCEPT [103:9704] :FORWARD ACCEPT [0:0] :OUTPUT ACCEPT [172:14184] :POSTROUTING ACCEPT [172:14184] COMMIT # Completed on Wed Nov 7 17:46:32 2012 # Generated by ip6tables-save v1.4.13 on Wed Nov 7 17:46:32 2012 *filter :INPUT ACCEPT [0:0] :FORWARD ACCEPT [0:0] :OUTPUT ACCEPT [0:0] :libvirt-host-in - [0:0] :libvirt-in - [0:0] :libvirt-in-post - [0:0] :libvirt-out - [0:0] -A INPUT -j libvirt-host-in -A FORWARD -j libvirt-in -A FORWARD -j libvirt-out -A FORWARD -j libvirt-in-post COMMIT # Completed on Wed Nov 7 17:46:32 2012 This is with libvirt 0.10.2. Does anybody have an idea what is happening here or how I could debug this further? Regards, Guido

1 1

[libvirt-users] libvirt with lxc: internal error The 'cpuacct', 'devices' & 'memory' cgroups controllers must be mounted
by unicell 07 Nov '12

07 Nov '12

Hi, I'm running OpenStack to manage LXC instance through libvirt. The same setting runs perfectly well on Ubuntu 12.04, while on CentOS 6u3, libvirt dumped following message when starting lxc instance. virsh -c lxc:/// start instance-00000032 error: internal error The 'cpuacct', 'devices' & 'memory' cgroups controllers must be mounted Really appreciated if someone could shed some lights. Seems to some libvirt / cgroup settings related. $ cat /proc/mounts .. none /cgroup cgroup rw,relatime,net_prio,perf_event,blkio,net_cls,freezer,devices,memory,cpuacct,cpu,ns,cpuset 0 0 .. $ chkconfig --list | grep cg cgconfig 0:off 1:off 2:off 3:off 4:off 5:off 6:off cgred 0:off 1:off 2:off 3:off 4:off 5:off 6:off xml definition -- <domain type="lxc"> <uuid>252a2dc5-452c-4e9c-a593-8c386c9f47e6</uuid> <name>instance-00000032</name> <memory>524288</memory> <vcpu>2</vcpu> <os> <type>exe</type> <cmdline>console=ttyS0</cmdline> <init>/sbin/init</init> </os> <clock offset="utc"/> <devices> <filesystem type="mount"> <source dir="/home/stack/nova_state/instances/instance-00000032/rootfs"/> <target dir="/"/> </filesystem> <interface type="bridge"> <mac address="fa:16:3e:73:67:54"/> <source bridge="br100"/> <filterref filter="nova-instance-instance-00000032-fa163e736754"> <parameter name="IP" value="10.0.0.8"/> <parameter name="DHCPSERVER" value="10.0.0.1"/> <parameter name="PROJNET" value="10.0.0.0"/> <parameter name="PROJMASK" value="255.255.255.0"/> </filterref> </interface> <console type="pty"/> </devices> </domain> Log message with LIBVIRT_DEBUG=1 if that is helpful. http://pastebin.com/LjZ6Euma -- Qiu Yu

2 1

[libvirt-users] help filtering spam
by Joe Linoff 07 Nov '12

07 Nov '12

Hi Folks: I am now receiving spam email every few minutes as result of signing up for this mailing list and it is starting to become a challenge. Has anyone had any success filtering it? Regards, Joe

2 1

[libvirt-users] No driver found during virt-install / kickstart
by Joe Linoff 06 Nov '12

06 Nov '12

Hi Folks: I am getting a "No driver found" dialogue when I try to build a guest using virt-install using a kickstart file. I am stuck. I am not sure how to fix or even debug this problem. Can anyone suggest a way forward? Here are the commands that I am using: $ # ================================================================ $ # Create the volume $ # ================================================================ virsh vol-create default /tools/vm/guests/guest1-vol.xml $ # ================================================================ $ # Create a mount for the virt-install --location option. $ # ================================================================ mkdir /opt/mnt mount -o loop,ro /tools/iso/CentOS-6.3-x86_64-bin-DVD1.iso /opt/mnt $ # ================================================================ $ # Create the kickstart file (used system-config-kickstart). $ # ================================================================ $ cat /export/tools/vm/guests/guest1-ks.cfg #platform=x86, AMD64, or Intel EM64T #version=DEVEL # Firewall configuration firewall --enabled --http --ssh # Install OS instead of upgrade install # Use CDROM installation media cdrom # Root password rootpw --iscrypted $1$DAzH1SN3$6yzxoq6oRrXNw.qMkJU0H1 # System authorization information auth --useshadow --passalgo=sha512 # Use graphical install graphical firstboot --disable # System keyboard keyboard us # System language lang en_US # SELinux configuration selinux --enforcing # Installation logging level logging --level=debug # System timezone timezone America/Los_Angeles # Network information network --bootproto=static --device=eth0 --gateway=192.168.2.1 --ip=192.168.2.68 --nameserver=192.168.2.71 --netmask=255.255.255.0 --onboot=on # System bootloader configuration bootloader --location=mbr # Clear the Master Boot Record zerombr # Partition clearing information clearpart --all %packages @base @client-mgmt-tools @compat-libraries @console-internet @emacs @hardware-monitoring @network-file-system-client @network-tools @performance @postgresql @security-tools @system-admin-tools @virtualization-client %end EOF $ # ================================================================ $ # Run virt-install $ # ================================================================ virt-install \ --accelerate \ --location "/opt/mnt" \ --disk device=disk,path="/var/lib/libvirt/images/guest1.img" \ --graphics vnc \ --name "guest1" \ --os-type linux \ --os-variant rhel6 \ --ram 2048 \ --vcpus 2,maxvcpus=2 \ -v \ -w bridge:br0 \ -x 'ks=nfs:192.168.2.140:/export/tools/vm/guests/guest1-ks.cfg ksdevice=eth0 ip=192.168.2.82 netmask=255.255.255.0 dns=192.168.2.71,8.8.8.8 gateway=192.168.2.1' Regards, Joe

1 0

[libvirt-users] Failed to bind socket to '/var/run/libvirt/libvirt-sock': Permission denied
by 何鑫 06 Nov '12

06 Nov '12

Hi all, When I start self-built libvirtd by "libvirtd -d -l -f libvirtd.conf", it shows that error : virNetSocketNewListenUNIX:346 : Failed to bind socket to '/var/run/libvirt/libvirt-sock': Permission denied I have removed some requested comments in libvirtd.conf. The key settings are shown as below: listen_tcp = 1 tcp_port = "16509" listen_addr = "0.0.0.0" unix_sock_group = "root" unix_sock_rw_perms = "0770" unix_sock_ro_perms = "0777" unix_sock_dir = "/var/run/libvirt" Is there any thing wrong? Need I start libvirtd by root? Thanks a lot! Best Regards!Corey

2 1

[libvirt-users] can not create "qcow2" format volume by Java library.
by zhijun liu 06 Nov '12

06 Nov '12

hi，all, when I use Java library to create volume ,specified format "qcow2"，but when I check it use qemu-img info ,it show format is "raw".。 I think it a bug,can you fix it .. thanks very much. the java library version：0.4.8 libvirt version：0.9.8

3 2

[libvirt-users] re-create disk image file
by Joe Linoff 06 Nov '12

06 Nov '12

Hi Everybody: I am curious about how to re-create a disk image file from a running guest when the original disk image file is accidentally deleted. This came up recently during a test scenario but I couldn't figure out how to do it. Thanks, Joe

3 9

[libvirt-users] is this mailing list active? i am seeing low activity and am receiving spam
by Joe Linoff 05 Nov '12

05 Nov '12

Hi Folks: Is this mailing list active? It seems to have pretty low activity and I have received several spam messages since signing up. Regards, Joe

2 4

[libvirt-users] CPU Mode= Host passthrough
by Michael Beham 05 Nov '12

05 Nov '12

Hi, I´m doing some research on Nested Virtualization with KVM and Xen. My cpu on bare-metal system is a Opteron_G4 --> (AMD Opteron 4280). qemu-version 1.0; libvirt 0.9.12 For nesting KVM in KVM I´m adding the <cpu mode='host-passthrough'/> command to the XML-File of the VM on Layer 0. So I´m able to install KVM in KVM and create nested guests at Layer 2. L2 --> Nested VM L1 --> KVM / XEN L0 --> KVM If i try the same with installing Xen in the VM on Layer 1 Xen don´t boot and I get following error: Panic on CPU 0: GENERAL PROTECTION FAULT [error_code=0000] If I remove <cpu mode='host-passthrough'/> command from the VM´s XML Xen boot is successful and Nesting Xen in KVM works! May this problem depends on the following problem --> https://bugzilla.redhat.com/show_bug.cgi?id=804224

1 0