- Users - libvirt List Archives

[libvirt-users] libvirt v1.0.2 fails to boot LXC container, but v1.0.0 works
by Dennis Jenkins 07 Mar '13

07 Mar '13

Hello. tl;dr = v1.0.0 can boot my LXC containers, v.1.0.1 and v.1.0.2 fails. Paraphrased error message: "lxcContainerMountProcFuse:616 : Failed to mount ..../meminfo" I'd like to know if my host is misconfigured, or my domains, or ... why 1.0.2 and 1.0.1 are not working for me. I've been using libvirt for a while to manage QEMU instances. I have experimented with lxc. Back in October of last year, I had some working LXC containers. I don't recall what version of libvirt I was using at the time. I recently attempted to boot my containers, and they failed (libvirt v1.0.2). I then reverted to v1.0.1 and tried again. Failed with the same result (same error text, just different line numbers). I then reverted to 1.0.0 and my containers boot up just fine. My host runs Gentoo Linux on an Inter core-i5 with 16G ram. I regularly (weekly) apply all available Gentoo updates. I strongly perfer to install all third-party software (including libvirt) from Gentoo portage, not manually from source or git. v1.0.2 is the most recent version available. First, items common to all test cases: *** GCC version ostara ~ # gcc --version gcc (Gentoo 4.6.3 p1.11, pie-0.5.2) 4.6.3 Copyright (C) 2011 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. *** Linux kernel ostara ~ # uname -a Linux ostara 3.6.11-gentoo #4 SMP PREEMPT Sat Jan 26 10:27:55 CST 2013 x86_64 Intel(R) Core(TM) i5 CPU 760 @ 2.80GHz GenuineIntel GNU/Linux ostara ~ # zcat /proc/config.gz | egrep "CONFIG_(CGROUP|.*_NS|NAMESPACES)" CONFIG_CGROUPS=y CONFIG_CGROUP_DEBUG=y CONFIG_CGROUP_FREEZER=y CONFIG_CGROUP_DEVICE=y CONFIG_CGROUP_CPUACCT=y CONFIG_CGROUP_PERF=y CONFIG_CGROUP_SCHED=y CONFIG_NAMESPACES=y CONFIG_UTS_NS=y CONFIG_IPC_NS=y CONFIG_PID_NS=y CONFIG_NET_NS=y CONFIG_NF_CONNTRACK_NETBIOS_NS=m # CONFIG_PATA_NS87415 is not set # CONFIG_PATA_NS87410 is not set *** Gento "USE flags" when building Libvirt: ostara ~ # equery u libvirt | xargs echo -audit -avahi +caps -firewalld -iscsi +libvirtd +lvm +lxc +macvtap +nfs +nls -numa -openvz -parted +pcap -phyp -policykit -python +qemu -rbd +sasl +udev +uml +vepa +virt-network -virtualbox -xen *** libvirt config over-rides: ostara ~ # egrep "^\w" < /etc/libvirt/libvirtd.conf host_uuid = "ab8c50b8-2337-4a02-9274-00923fe8f476" ostara ~ # egrep "^\w" < /etc/libvirt/libvirt.conf ostara ~ # egrep "^\w" < /etc/conf.d/libvirtd rc_need="net" LIBVIRTD_OPTS="--listen" LIBVIRTD_KVM_SHUTDOWN="managedsave" *** Network when no domains (qemu or libvirt) are running: ostara ~ # ifconfig -a | grep -e "^[a-z]" br0: flags=4355<UP,BROADCAST,PROMISC,MULTICAST> mtu 1500 br1: flags=4419<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> mtu 1500 eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 eth1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 eth2: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 lo: flags=73<UP,LOOPBACK,RUNNING> mtu 16436 *** Network with libvirt running (libvirt manages "virbr0" for my qemu instances. It attaches to "br0"). ostara ~ # /etc/init.d/libvirtd start * Starting libvirtd ... [ ok ] ostara ~ # ifconfig -a | grep -e "^[a-z]" br0: flags=4355<UP,BROADCAST,PROMISC,MULTICAST> mtu 1500 br1: flags=4419<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> mtu 1500 eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 eth1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 eth2: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 lo: flags=73<UP,LOOPBACK,RUNNING> mtu 16436 virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500 *** Mounts (cgroup is mounted) ostara ~ # mount rootfs on / type rootfs (rw) proc on /proc type proc (rw,relatime) udev on /dev type devtmpfs (rw,nosuid,relatime,size=10240k,nr_inodes=2050547,mode=755) devpts on /dev/pts type devpts (rw,relatime,gid=5,mode=620,ptmxmode=000) sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime) /dev/md3 on / type ext3 (rw,noatime,errors=continue,barrier=1,data=writeback) tmpfs on /run type tmpfs (rw,nosuid,nodev,relatime,mode=755) shm on /dev/shm type tmpfs (rw,nosuid,nodev,noexec,relatime) debugfs on /sys/kernel/debug type debugfs (rw,nosuid,nodev,noexec,relatime) cgroup_root on /sys/fs/cgroup type tmpfs (rw,nosuid,nodev,noexec,relatime,size=10240k,mode=755) openrc on /sys/fs/cgroup/openrc type cgroup (rw,nosuid,nodev,noexec,relatime,release_agent=/lib64/rc/sh/cgroup-release-agent.sh,name=openrc) cpuset on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) debug on /sys/fs/cgroup/debug type cgroup (rw,nosuid,nodev,noexec,relatime,debug) cpu on /sys/fs/cgroup/cpu type cgroup (rw,nosuid,nodev,noexec,relatime,cpu) cpuacct on /sys/fs/cgroup/cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpuacct) memory on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory) devices on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) freezer on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) blkio on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) perf_event on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) /chroot/ssh-jails/jamiel/home/jamiel on /home/jamiel type none (rw,bind) libvirt on /run/libvirt/lxc/dwj-lnx-dev type fuse (rw,nosuid,nodev) *** My LXC containers: ostara ~ # virsh -c lxc:// list --all Id Name State ---------------------------------------------------- - dwj-lnx-dev shut off - vm1 shut off *** Config from one container (itself is Gentoo Linux, sharing some file-systems) ostara ~ # virsh -c lxc:// dumpxml dwj-lnx-dev <domain type='lxc'> <name>dwj-lnx-dev</name> <uuid>fbcd8c3a-9939-12b4-727d-5d3526bc448f</uuid> <memory unit='KiB'>500000</memory> <currentMemory unit='KiB'>500000</currentMemory> <vcpu placement='static'>2</vcpu> <os> <type arch='x86_64'>exe</type> <init>/sbin/init</init> </os> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/libexec/libvirt_lxc</emulator> <filesystem type='mount' accessmode='passthrough'> <source dir='/vm/lxc/dwj-lnx-dev'/> <target dir='/'/> </filesystem> <filesystem type='mount' accessmode='passthrough'> <source dir='/usr/portage'/> <target dir='/usr/portage'/> </filesystem> <filesystem type='mount' accessmode='passthrough'> <source dir='/usr/src'/> <target dir='/usr/src'/> </filesystem> <filesystem type='mount' accessmode='passthrough'> <source dir='/home'/> <target dir='/home'/> </filesystem> <interface type='bridge'> <mac address='82:00:00:00:01:00'/> <source bridge='br0'/> </interface> <console type='pty'> <target type='lxc' port='0'/> </console> </devices> </domain> ostara ~ # ls -l /vm/lxc/dwj-lnx-dev total 108 drwxr-xr-x 2 root root 4096 Oct 18 09:38 bin drwxr-xr-x 2 root root 4096 Apr 27 2011 boot drwxr-xr-x 10 root root 45056 Jan 26 10:52 dev drwxr-xr-x 53 root root 4096 Feb 8 11:23 etc drwxr-xr-x 2 root root 4096 Apr 27 2011 home lrwxrwxrwx 1 root root 5 Oct 18 00:46 lib -> lib64 drwxr-xr-x 2 root root 4096 Oct 18 00:51 lib32 drwxr-xr-x 10 root root 4096 Oct 18 09:11 lib64 drwxr-xr-x 4 root root 4096 Apr 27 2011 mnt drwxr-xr-x 4 root root 4096 May 22 2012 opt drwxr-xr-x 2 root root 4096 Apr 27 2011 proc drwx------ 3 root root 4096 Oct 18 08:13 root drwxr-xr-x 2 root root 4096 Oct 18 00:57 run drwxr-xr-x 2 root root 4096 Oct 18 09:11 sbin drwxr-xr-x 2 root root 4096 Apr 27 2011 sys drwxrwxrwt 4 root root 4096 Feb 8 11:23 tmp drwxr-xr-x 13 root root 4096 May 4 2011 usr drwxr-xr-x 14 root root 4096 May 22 2012 var ************ v 1.0.0 works great! ostara ~ # virsh --version 1.0.0 ostara ~ # virsh -c lxc:// list --all Id Name State ---------------------------------------------------- - dwj-lnx-dev shut off - vm1 shut off ostara ~ # virsh -c lxc:// start dwj-lnx-dev Domain dwj-lnx-dev started ostara ~ # virsh -c lxc:// list --all Id Name State ---------------------------------------------------- 21364 dwj-lnx-dev running - vm1 shut off ************* v 1.0.2 fails: ostara ~ # /etc/init.d/libvirtd start * Caching service dependencies ... [ ok ] * Starting libvirtd ... [ ok ] ostara ~ # virsh --version 1.0.2 ostara ~ # ls -l /var/lib/libvirt/lxc/ total 0 ostara ~ # virsh -c lxc:// start dwj-lnx-dev error: Failed to start domain dwj-lnx-dev error: internal error guest failed to start: PATH=/bin:/sbin TERM=linux container=lxc-libvirt container_uuid=fbcd8c3a-9939-12b4-727d-5d3526bc448f LIBVIRT_LXC_UUID=fbcd8c3a-9939-12b4-727d-5d3526bc448f LIBVIRT_LXC_NAME=dwj-lnx-dev /sbin/init 2013-02-08 18:09:28.402+0000: 1: info : libvirt version: 1.0.2 2013-02-08 18:09:28.402+0000: 1: error : lxcContainerMountProcFuse:616 : Failed to mount /.oldroot//var/run/libvirt/lxc/dwj-lnx-dev/meminfo on /proc/meminfo: No such file or directory 2013-02-08 18:09:28.402+0000: 23867: info : libvirt version: 1.0.2 2013-02-08 18:09:28.402+0000: 23867: error : virLXCControllerRun:1468 : error receiving signal from container: Input/output error 2013-02-08 18:09:28.814+0000: 23867: error : virCommandWait:2287 : internal error Child process (ip link del veth1) unexpected exit status 1: Cannot find device "veth1" ostara ~ # ls -l /var/lib/libvirt/lxc/ total 0 ostara ~ # mount | grep libvirt libvirt on /run/libvirt/lxc/dwj-lnx-dev type fuse (rw,nosuid,nodev) ostara ~ # ls -l /run/libvirt/lxc total 0 drwxr-xr-x 2 root root 40 Feb 8 12:09 dwj-lnx-dev srwx------ 1 root root 0 Feb 8 12:09 dwj-lnx-dev.sock srwx------ 1 root root 0 Feb 8 11:22 vm1.sock ostara ~ # ls -l /run/libvirt/lxc/dwj-lnx-dev total 0 *** "veth1" (regarding the rror "Cannot find device") *** "veth1" is still no created. But I do know that when *** using libvirt v1.0.0, and the container is running, the device DOES exist (not shown above) ostara ~ # ifconfig -a | egrep "^\w" br0: flags=4355<UP,BROADCAST,PROMISC,MULTICAST> mtu 1500 br1: flags=4419<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> mtu 1500 eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 eth1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 eth2: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 lo: flags=73<UP,LOOPBACK,RUNNING> mtu 16436 virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500 *** The last entry in "/var/log/libvirt/lxc/dwj-lnx-dev.log" 2013-02-08 18:09:27.771+0000: starting up PATH=/bin:/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/opt/bin:/usr/x86_64-pc-linux-gnu/gcc-bin/4.6.3:/usr/x86_64-pc-linux-gnu/i686-pc-mingw32/gcc-bin/4.7.2 LIBVIRT_DEBUG=3 LIBVIRT_LOG_OUTPUTS=3:stderr /usr/libexec/libvirt_lxc --name dwj-lnx-dev --console 20 --security=none --handshake 23 --background --veth veth1 PATH=/bin:/sbin TERM=linux container=lxc-libvirt container_uuid=fbcd8c3a-9939-12b4-727d-5d3526bc448f LIBVIRT_LXC_UUID=fbcd8c3a-9939-12b4-727d-5d3526bc448f LIBVIRT_LXC_NAME=dwj-lnx-dev /sbin/init 2013-02-08 18:09:28.402+0000: 1: info : libvirt version: 1.0.2 2013-02-08 18:09:28.402+0000: 1: error : lxcContainerMountProcFuse:616 : Failed to mount /.oldroot//var/run/libvirt/lxc/dwj-lnx-dev/meminfo on /proc/meminfo: No such file or directory 2013-02-08 18:09:28.402+0000: 23867: info : libvirt version: 1.0.2 2013-02-08 18:09:28.402+0000: 23867: error : virLXCControllerRun:1468 : error receiving signal from container: Input/output error 2013-02-08 18:09:28.814+0000: 23867: error : virCommandWait:2287 : internal error Child process (ip link del veth1) unexpected exit status 1: Cannot find device "veth1"

5 10

[libvirt-users] KVM Raw Format Image Causes lseek Error when Copying
by d hee 07 Mar '13

07 Mar '13

When copying a raw KVM image to my usb drive I got a lseek error...why is this? localhost temp # lr /kvm_guests/newInstall.img -rw-r--r-- 1 root root 10G Oct 22 05:36 /kvm_guests/newInstall.img localhost temp # localhost temp # cp /kvm_guests/newInstall.img . cp: cannot lseek `./newInstall.img': Invalid argument localhost temp # df -h Filesystem Size Used Avail Use% Mounted on /dev/sdc1 15G 7.2G 7.8G 48% /mnt/temp After copy error, only 4 Gigs were copied: localhost temp # lr total 7.2G drwxr-xr-x 2 root root 8.0K Mar 6 18:10 . drwxr-xr-x 16 root root 4.0K Nov 6 09:10 .. -rwxr-xr-x 1 root root 4.0G Mar 6 18:16 newInstall.img

3 2

[libvirt-users] Developing on host machine, running code on guest VM
by Brad Barrows 07 Mar '13

07 Mar '13

Currently I am developing my projects on my host laptop and am sharing my development folder with my Guest VMs via NFS. This works however it is somewhat a hassle do to UID/GID issues.. I was wondering if there was something similar to Shared Drives in VirtualBox? Is NFS the best way to go about this kind of development or is there another feature I am missing? I have added a group on the VM with the same GID and the host users GID which works (until some file loses the group rw for some reason..). Any ideas? Thank you! Brad

3 5

[libvirt-users] libvirt (and qemu) and RHEL 6.3, 6.4, ...
by Skardal, Harald 06 Mar '13

06 Mar '13

Is there any information available that describes which versions of RHEL 6.X are supported by the different libvirt releases, and also qemu releases? For instance, can you install libvirt 1.0.2 and qemu 1.4 on the newly released RHEL 6.4? I see the following in the release notes for 1.0.3 on libvirt.org: tests: skip virstoragetest on RHEL 5 (Eric Blake), I read that to mean that libvirt 1.0.3 is tested with the most recent RHEL 5.X releases? Together with a matching qemu? But I see nothing else that indicates which KVM virtualization releases works with RHEL 6.3, 6.4, etc. Anyone know where one can find out? Harald Skardal Stratus Technologies

2 1

[libvirt-users] lxc--sshd
by Brandon Foster 06 Mar '13

06 Mar '13

Hey all, I am new to libvirt lxc and am trying to get a container that i can ssh to. So far i've booted up a container and gave it an Ip address, it can ping out and I can ping it but I cannot get ssh to work. When i try to run an ssh command inside the container I get a command not found error. here is my xml file <domain type='lxc'> <name>helloworld</name> <memory>102400</memory> <os> <type>exe</type> <init>/bin/sh</init> </os> <devices> <console type='pty'/> <filesystem type='mount'> <source dir='/export/helloworld/config'/> <target dir='/etc/httpd'/> </filesystem> <filesystem type='mount'> <source dir='/export/helloworld/data'/> <target dir='/var/www'/> </filesystem> <interface type='bridge'> <mac address='52:54:00:5e:02:45'/> <source bridge='br0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> <model type='virtio' /> </interface> </devices> </domain> I havent restricted it with busybox for simplicity thinking it was because I wasn't allowing it access to necessary ssh files, but Im not sure what I am missing now. surely someone has done this before. thanks -- Brandon Foster Infrastructure Administrator Liferay, Inc. Enterprise. Open Source. For life.

1 3

Re: [libvirt-users] Virsh+QEMU, SSH issue on compiled libvirt
by Will Dennis 06 Mar '13

06 Mar '13

On Wed, 06 Mar 2013 10:35:08 +0100, Peter Krempa wrote: >This is true for normal connections using TCP. SSH tunneling works in a different way. Hi Peter, Can you tell me why I got the "I/O Error" message (like Shantan did) when trying qemu+ssh method against libvirtd 1.x when it worked fine with libvirtd 0.9.x? What changed with that method between 0.9.x and 1.x? (I am somewhat new to all things libvirt, so documentation references are gladly accepted :) Thanks, Will

1 0

[libvirt-users] Virsh+QEMU, SSH issue on compiled libvirt
by Shantan Marepally (shanredd) 05 Mar '13

05 Mar '13

Hi All, I am trying to build libvirt from source, the compilation went fine and I see that various libvirt tools are being generated, but when I try to use the generated virsh with qemu and ssh (example virsh qemu+ssh://uri/system) I am not able to login and it fails with the following error: error: failed to connect to the hypervisor error: End of file while reading data: : Input/output error I verified the following so far: * QEMU driver is being enabled (--with-qemu, --with-qemu-user, --with-qemu-group), other options are default * Permissions and ssh logging setup are all fine (the same command with a precompiled virsh works fine) Any ideas? Thanks for your time. Shantan

1 0

[libvirt-users] Debugging TLS connection between virt-viewer and libvirt running on separate hosts
by Will Dennis 05 Mar '13

05 Mar '13

Hi all, I'm running libvirt 1.0.2 on one host (Ubuntu 12.04), and virt-manager/virt-viewer on another (FC18), and using TLS to secure the comm's between the hosts. I was able to get virt-manager to connect the the hypervisor host via qemu+tls method, but virt-viewer will not connect (either invoked from the "Show the graphical console" option on virt-manager's VM window, or by invoking virt-viewer directly.) Both fail with a generic error (virt-manager's view console says "viewer connection to hypervisor host got refused or disconnected") but does not give a more explicit error. I did a tcpdump, and the trace does show the client machine connecting to TCP port 16514 on the hypervisor host, which is owned by the libvirtd daemon. From what I can see in the packets from that dump, it looks like the endpoints are exchanging certificate info, but of course the session is encrypted, so can't really see what else is going on... Is there a way someone can give me to debug the communications for either the client or server side? (There's nothing being written to logs as far as I can see.) Thanks, Will

1 0

[libvirt-users] Live external snapshot coalescing
by Skardal, Harald 05 Mar '13

05 Mar '13

On standard Fedora 18 I was attempting blockcommit on a *live* VM, libvirt said it was not supported, so I tried fedora-virt-preview as recommended. We found a problem with qemu 1.4, there seems to be an acknowledged bug, a missing library. On a different system we loaded Fedora 18, and then pulled qemu (1.3) and libvirt (1.0.2) from rawhide. I tried blockcommit with domain shut down, it said must be up. Started the domain, and voila, it seems to have worked. Question: The committed snap file (the one I committed to the image below) is still in there, and virsh snapshot-list lists it. But the base and the upstream snap file has been updated, the upstream snap file points to the base image as per qemu-img info. How/where do I update the metadata so that virsh displays the correct thing? I.e. the committed snapshot should disappear? Is it as simple as removing the committed snap? Do I have to restart anything to get the virsh output correct? Cheers, Harald Skardal, Stratus Technologies.

3 2

[libvirt-users] Fwd: OpenVSwitch and libvirt integration problem at shutdown/reboot
by Ernesto Domato 04 Mar '13

04 Mar '13

Hi everyone, I'm forwarding this mail that I wrote to OpenVSwitch dev list because I think that you could maybe help me a little :-) What did you think about the patch to libvirt that I'm using?. At least, it worked for me :-) Thanks. Ernesto ---------- Forwarded message ---------- From: Ernesto Domato <edomat(a)gmail.com> Date: Mon, Mar 4, 2013 at 2:09 PM Subject: OpenVSwitch and libvirt integration problem at shutdown/reboot To: dev(a)openvswitch.org Hi everyone, this mail is related to a bug report that I did on Debian (#701760) that I wasn't able to resolve yet and want to know if someone has the same problem and how could I fix it. The problem that I'm having is that on shutdown/reboot of the machine that holds the virtual machines that use OVS, the OVS-Switch is going down before libvirt finish to shutdown the VMs. This cause that libvirt can¡t unregister the virtual interface from the OVS-Switch and it hangs the shutdown/reboot process. The only way that I have to solve this at that point is to log in by SSH and restart the OVS-Switch so libvirt can finish unregistering the interfaces and the system continue with the task asked. What I tried too is to patch the libvirt to use the --no-wait flag for ovs-vsctl command that deletes the virtual interface so it doesn't hang when OVS-Switch isn't running. It worked on the sense that the system does shutdown/reboot but next time it boot, the VMs stop responding, I have to delete the virtual interface from OVS-Switch and register it again and then the VM start responding again. I guess that this happens because the virtual interface was never deleted from OVS-DB and when the system boots again there's like an old reference to the virtual interface that provoke this behavior. Have anyone had this problem?, how did you solve it?, what your suggestion for me?. Looking at the manpages, I'll try another patch for libvirt that will delete the interface with the flag --if-exists before adding it back on libvirt start of the VM so, if the OVS-DB already has the interface, it is deleted. If this works, do you think it's a good solution?, or should it be implemented in other ways?. Thanks for all and excuse my english but it's not my native language. Ernesto

2 1