- Users - libvirt List Archives

[libvirt-users] SR-IOV: no traffic isolation between VFs with Broadcom 10Gbps cards
by Yoann Juet 11 Feb '14

11 Feb '14

Hi all, I'm testing on debian/unstable SR-IOV feature with Broadcom BCM57810 cards and KVM hypervisor: Compiled against library: libvirt 1.2.1 Using library: libvirt 1.2.1 Using API: QEMU 1.2.1 Running hypervisor: QEMU 1.7.0 bnx2x -> firmware 7.8.17 -> driver from kernel 3.12.7 8 VFs are created on the first PF. For each VF, a specific mac address is set manually using "ip link set eth0 vf x mac xx:xx:xx:xx:xx" command. I run several KVM guests with PCI passthrough (same kernel, bnx2x driver and firmware as the host), performance is close to bare metal. Well, that sounds good, until I start capturing the traffic inside each VM: host traffic is visible as well as traffic destined to other VM. It's like if internal card switching was inoperable. I made several tests with different kernels, different PCIe Passthrough method assignments for libvirt. All failed. Has anyone successfully experiment SR-IOV with Broadcom cards on linux ? ----- Some details: 01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10) 01:00.1 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10) 01:09.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function 01:09.1 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function 01:09.2 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function 01:09.3 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function 01:09.4 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function 01:09.5 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function 01:09.6 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function 01:09.7 Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function # virsh nodedev-dumpxml pci_0000_01_09_0 <device> <name>pci_0000_01_09_0</name> <path>/sys/devices/pci0000:00/0000:00:01.0/0000:01:09.0</path> <parent>pci_0000_00_01_0</parent> <driver> <name>vfio-pci</name> </driver> <capability type='pci'> <domain>0</domain> <bus>1</bus> <slot>9</slot> <function>0</function> <product id='0x16af'>NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function</product> <vendor id='0x14e4'>Broadcom Corporation</vendor> <capability type='phys_function'> <address domain='0x0000' bus='0x01' slot='0x00' function='0x1'/> </capability> <iommuGroup number='35'> <address domain='0x0000' bus='0x01' slot='0x09' function='0x0'/> </iommuGroup> </capability> </device> # virsh nodedev-dumpxml pci_0000_01_09_1 <device> <name>pci_0000_01_09_1</name> <path>/sys/devices/pci0000:00/0000:00:01.0/0000:01:09.1</path> <parent>pci_0000_00_01_0</parent> <driver> <name>vfio-pci</name> </driver> <capability type='pci'> <domain>0</domain> <bus>1</bus> <slot>9</slot> <function>1</function> <product id='0x16af'>NetXtreme II BCM57810 10 Gigabit Ethernet Virtual Function</product> <vendor id='0x14e4'>Broadcom Corporation</vendor> <capability type='phys_function'> <address domain='0x0000' bus='0x01' slot='0x00' function='0x1'/> </capability> <iommuGroup number='36'> <address domain='0x0000' bus='0x01' slot='0x09' function='0x1'/> </iommuGroup> </capability> </device> Guest A XML: ... <hostdev mode='subsystem' type='pci' managed='yes'> <source> <address domain='0x0000' bus='0x01' slot='0x09' function='0x0'/> </source> </hostdev> ... Guest B XML: ... <hostdev mode='subsystem' type='pci' managed='yes'> <source> <address domain='0x0000' bus='0x01' slot='0x09' function='0x1'/> </source> </hostdev> ... -- Université de Nantes - Direction des Systèmes d'Information

2 3

[libvirt-users] libvirt 1.2.1 / lxc : default virtual network not defined after installing/starting Libvirt
by Mohamed Amine Larabi 11 Feb '14

11 Feb '14

Hi There, I am using Libvirt 1.2.1 on Fedora 20. So, Libvirt is well installed and started but the weird thing is that the 'default' virtual network is not automatically defined and started, knowing that I can define/start it manually and everything goes fine. previously I was using libvirt 1.0.4 and the 'default' virtual network was defined/started at Libvirt startup. so, I am wondering if this new behavior was introduced intentionally in the latest versions of Libvirt or it's a known issue. Thank you in advance for your help. Regards Mohamed.

2 2

[libvirt-users] event-test.py cannot detects domain shutdown
by Kim Larry 11 Feb '14

11 Feb '14

Hi, I used event-test.py from here: http://libvirt.org/git/?p=libvirt-python.git;a=blob;f=examples/event-test.p… which is very lasted version. However, it detects all of events but not domain shutdown. I've searched through Google and got nothing. libvirtd version is 1.1.4 and using Xen for hypervisor. Any ideas? Larry

2 1

[libvirt-users] libvirt/qemu and cgroups
by arnaud gaboury 11 Feb '14

11 Feb '14

Dear list, I am building a Arch server on my Arch box. My tools are QEMU/KVM and libvirt to manage the guest, systemd as system manager. I am looking at implementing the Linux Control Groups facilities for resource management. Even after long hours of reading, I am not quite sure about how to deal with the cgroups facilities. First, do I really need to care about all that, or libvirt and systemd will manage the resource in an efficient way right out of the box? If not, It's all about /etc/cgconfig.conf and cgrules.conf. I am honestly not sure : -what are the correct mount points for cpu, memory etc in the /sys/fs/cgroup directory . - which directories am I supposed to mk, if any ? Then, Archwiki[1] says: # cgcreate -a $USER -g memory,cpu:groupname - what is the groupename I shall create (qemu*, MyMachine) ? - which $USER shall I use (qemu*, my username) ? * qemu:qemu as user:group in /etc/libvirt/qemu.conf Thank you for some help as I admit if I understand the cgroups principle and advantages, I am far from understanding how to create such a group in case of a VM. [1]https://wiki.archlinux.org/index.php/Cgroups

3 7

[libvirt-users] How to use /dev/mapper in virt-manager/libvirt
by Marc Haber 10 Feb '14

10 Feb '14

Hi, my test host is running Debian/GNU Linux unstable and has virt-manger 0.9.5 and libvirt 1.2.1. I am using encryption and thus have devices in /dev/mapper that are not LVs, for example called /dev/mapper/myvirtualdisk. I'd like to configure libvirt in a way that allows me to directly assign such devices to a VM. This does not work when I create a filesystem directory storage pool in virt-manager since virt-manager obviously choked in /dev/mapper/control, which is a character special device that is only readable by root. I currently help myself by linking the devices in question manually to /dev/luksdev and having a filesystem directory storage pool point to that directory. this works, but is ugly. Is there a nicer way to get the contents of /dev/mapper available as volumes in virt-manager? Greetings Marc -- ----------------------------------------------------------------------------- Marc Haber | "I don't trust Computers. They | Mailadresse im Header Mannheim, Germany | lose things." Winona Ryder | Fon: *49 621 31958061 Nordisch by Nature | How to make an American Quilt | Fax: *49 621 31958062

2 1

[libvirt-users] Failed to terminate process X with SIGKILL: Device or resource busy
by sylecn 09 Feb '14

09 Feb '14

Hi, I'm using libvirt/kvm with openstack. When vm has CPU stall, the instance can't be destroyed. I have asked the question on openstack user mailing list and received no answers in weeks. Here is one example: # virsh destroy instance-00000085 error: Failed to destroy domain instance-00000085 error: Failed to terminate process 61222 with SIGKILL: Device or resource busy # lsof -p 61222 # ps -f -p 61222 UID PID PPID C STIME TTY TIME CMD 107 61222 1 68 Jan24 ? 9-23:06:19 [qemu-system-x86] <defunct> The log in /var/log/libvirt/libvirtd.log: 2014-02-08 03:21:31.597+0000: 2177: error : virProcessKillPainfully:315 : Failed to terminate process 61222 with SIGKILL: Device or resource busy Restart libvirt-bin service did not solve the problem. virsh shutdown/reboot just hang. Maybe that is because the CPU in vm is stalled. I wonder if there is some way to destroy (or rebuild) dead instance without rebooting the hypervisor. Any suggestions is welcome. The software I am running: hypervisor os: ubuntu 12.04.3 hypervisor kernel: 3.8.0-35-generic vm os: ubuntu 12.04 vm kernel: 3.2.0-56-virtual openstack: havana libvirt: 1.1.1-0ubuntu8~cloud2 Thanks, Yuanle

1 1

[libvirt-users] Automate Windows 7 installation via Answer file
by RAJESH David John 08 Feb '14

08 Feb '14

Hello, Is there a means to automate windows 7 installation after Running "Virsh create windows7.xml" OS = Centos 6.2 Hypervisor = KVM Any ideas or pointer is greatly appreciated. Thanks Rajesh J

3 3

[libvirt-users] Connecting disks to controller virtio-scsi of qemu/kvm
by chickenmarkus＠freenet.de 08 Feb '14

08 Feb '14

Hello, I try to use the virtio-scsi driver to use my disks. But my setup at first: * in general Debian Wheezy * Kernel: 3.11-0.bpo.2-amd64 (http://packages.debian.org/wheezy-backports/linux-image-3.11-0.bpo.2-amd64) * Qemu-KVM: 1.7.0 (http://packages.debian.org/jessie/qemu-kvm) * Virsh 1.2.1 (http://packages.debian.org/jessie/libvirt-bin) The new kernel and dirty things from Jessie are for discard support (also not working with current configuration despite thin volumes with working discard). Once I have the this "new" qemu version, why not to use virtio... Every disk with target bus "scsi" gets an own scsi-hd device. Libvirt ignores the scsi controller of type virtio-scsi. Here is a XML snippet: <devices> <controller type='scsi' model='virtio-scsi' index="0"/> <disk type="block" device="disk"> <source dev="/dev/ssd0/sarabi"/> <driver discard="unmap"/> <target dev="sda" bus="scsi"/> <address type="drive" controller="0" bus=0/> </disk> </devices> This creates the virtio-scsi controller (verified by lspci in guest) but do not "connect" the disks to it. The resulting command line looks following: kvm [...] -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x5 -drive file=/dev/ssd0/sarabi,if=none,id=drive-scsi0-0-0-0,format=raw,discard=unmap -device scsi-hd,bus=scsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0-0-0-0,id=scsi0-0-0-0,bootindex=2 [...] How get my disk to run over virtio-scsi? Or did I found something like a bug? Bye Markus

1 2

[libvirt-users] Can I move the disk image of the guest while it is running?
by Gergely Horváth 08 Feb '14

08 Feb '14

Hello guys! We want to move some guests' disk images to different locations (within the same machine, locally), but we do not want to turn off the guests. Can we do that while the guest is running, like live migration? I did not find any related documentation or posts about it. Let's say the guest has a disk at /ssd/image.raw We want to move that to /hdd/image.raw Is there any way to do that without interrupting the guest? -- Üdvözlettel / Best regards Horváth Gergely | gergely.horvath(a)inepex.com IneTrack - Nyomkövetés egyszerűen | Inepex Kft. Ügyfélszolgálat: support(a)inetrack.hu | +36 30 825 7646 | support.inetrack.hu Web: www.inetrack.hu | nyomkovetes-blog.hu | facebook.com/inetrack Inepex - The White Label GPS fleet-tracking platform | www.inepex.com

4 10

[libvirt-users] Question about managing migration transfers
by Joaquim Barrera 07 Feb '14

07 Feb '14

Hi folks, As part of a project I am working on, I need to control every step of a migration, from when I establish the connection to the destination, to when I decide to move data blocks, its size, etc. As I can see in the documentation, tunnelled migration allows some kind of control, as the data goes through libvirt before leaving the host. May someone put more light on the subject? Is there any possibility to achieve such control I am looking for, or libvirt hacking will be needed? Thank you very much.

1 0