April 2015 - Users - libvirt List Archives

[libvirt-users] virRandomBits - not very random
by Brian Rak 01 Jun '18

01 Jun '18

I just ran into an issue where I had about 30 guests get duplicate mac addresses assigned. These were scattered across 30 different machines. Some debugging revealed that: 1) All the host machines were restarted within a couple seconds of each other 2) All the host machines had fairly similar libvirtd pids (within ~100 PIDs of each other) 3) Libvirt seeds the RNG using 'time(NULL) ^ getpid()' This perfectly explains why I saw so many duplicate mac addresses. Why is the RNG seed such a predictable value? Surely there has to be a better source of a random seed then the timestamp and the pid? The PID seems to me to be a very bad source of any randomness. I just ran a test across 60 of our hosts. 43 of them shared their PID with at least one other machine.

7 13

[libvirt-users] Freeze Windows Guests For Consistent Storage Snapshots
by Payes Anand 09 Jun '15

09 Jun '15

Hi, Is it possible to freeze windows guests for a consistent storage level snapshot. I am using openstack icehouse on centos 6.6 Hypervisor: KVM Libvirt: 0.10.2 Qemu: 0.10.2 Guest OS: Windows 7 and Windows Server 2008 I was able to freeze Centos guests by issuing the command: virsh qemu-agent-command <guest_ID> '{"execute":"guest-fsfreeze-freeze"}' For CentOS guests, I enabled access between compute nodes and guests through a socket by setting metadata parameter, hw_qemu_guest_agent=yes for the guest image. And then installing qemu-guest-agent inside the guest. What steps do i have to follow for windows ? Regars, Payes

2 2

[libvirt-users] Block Commit: [100 %]error: failed to pivot job for disk vda (Bug filed)
by Matthew Schumacher 01 Jun '15

01 Jun '15

Hello List, Seems like blockcopy --wait doesn't work work qemu-2.2.x. I found someone else having the same problem, but it never went anywhere: https://www.redhat.com/archives/libvirt-users/2015-January/msg00045.html I went ahead and did some more debugging and created a bug report: https://bugzilla.redhat.com/show_bug.cgi?id=1210903 I'm going to do some more debugging and hopefully figure this out, but wanted it to post it here so that it gets more attention. Thanks, schu

2 4

[libvirt-users] unable to edit existing snapshot
by NoxDaFox 26 May '15

26 May '15

Greetings, due to hardware failure I had to replace my workstation which has a different CPU. I have a VM with several snapshots and I need to revert to a specific one. While reverting to it, I get an error due to unsupported CPU features. Therefore, I try to edit the snapshot XML through the command: virsh snapshot-edit <domain_name> <snapshot_name> When I save the changes I get the error message: error: intermal error: unexpected domain snapshot <snapshot_name> already exists Tried to look around for solution but didn't find any information related to my problem. Am I doing something wrong? It's quite critical for me to be able to revert to that state of the machine. Is there any chance to do so via libvirt? Thank you.

4 5

[libvirt-users] [Libvirt Users]how to provide password authentication for qemu driver
by Dhaval_Shah1＠dell.com 05 May '15

05 May '15

Dell Customer Communication Hi All, I am using Compiled against library: libvirt 1.2.9 Using library: libvirt 1.2.9 Using API: QEMU 1.2.9 Running hypervisor: QEMU 2.1.2 I want user to provide username and password authentication to virConnectPtr virConnectOpenAuth(const char *name, virConnectAuthPtr auth, unsigned int flags) to login remotely for the qemu hypervisor. But it is not taking user provided username and driver. Because internally it is calling below qemu driver function, static virDrvOpenStatus qemuConnectOpen(virConnectPtr conn, virConnectAuthPtr auth ATTRIBUTE_UNUSED, unsigned int flags) so it is not taking any user provided auth parameters and it is internally calling separate function for prompting password. I don't want to provide password here. In case of windows HyperV it is working fine as it takes auth parameters but for Qemu Hypervisor I am facing this issue since here the auth parameters as marked as ATTRIBUTE_UNUSED. Can anyone help me with this that how can I achieve this? Thanks & Regards, Dhaval Shah

2 2

[libvirt-users] Limitations of macvtap devices?
by Lars Kellogg-Stedman 04 May '15

04 May '15

I am running OpenStack inside a libvirt guest that is connected to the local network via a macvtap interface. My experience so far suggests that a macvtap interface will not pass traffic with a source MAC address other than the MAC address of the interface itself...for example, if inside the guest eth0 is attached to a bridge. Is that correct, or is there some setting that will make that work? Outbound traffic doesn't seem to be a problem (I can see, for example, dhcp requests on the local network), but replies get dropped before they reach the guest. Thanks, -- Lars Kellogg-Stedman <lars(a)redhat.com> | larsks @ {freenode,twitter,github} Cloud Engineering / OpenStack | http://blog.oddbit.com/

4 4

[libvirt-users] Sometimes libvirt fails to update domain block file after blockcommit.
by Matthew Schumacher 30 Apr '15

30 Apr '15

Posted to https://bugzilla.redhat.com/show_bug.cgi?id=1217185 I just stumbled on another bug while snapshotting and think it's related to 1210903 and 1197592 as it seems like some sort of race condition because it depends on what logging is in place and doesn't happen every time. Here are the details: I wrote this test script to snapshot and commit over and over: #!/bin/sh while [ 1 ]; do echo "Starting snapshot test `date`" virsh snapshot-create-as test 20150429 20150429-backup --disk-only --atomic virsh domblklist test virsh blockcommit test vda --active --pivot --verbose virsh snapshot-delete test 20150429 --metadata virsh domblklist test rm /glustervol1/vm/test/test.20150429 echo "Ending snapshot test `date`" echo echo sleep 2 done If I run libvirtd in the foreground with debug set to 1 I can't get it to fail, it does what it's supposed to do, snapshot and commit over and over. If I run libvirtd in the foreground with debug set to 3, then I will always eventually get this: Starting snapshot test Wed Apr 29 09:34:34 AKDT 2015 Domain snapshot 20150429 created Target Source ------------------------------------------------ vda /glustervol1/vm/test/test.20150429 hdc /dev/sr0 Block Commit: [100 %] Successfully pivoted Domain snapshot 20150429 deleted Target Source ------------------------------------------------ vda /glustervol1/vm/test/test.20150429 hdc /dev/sr0 Ending snapshot test Wed Apr 29 09:34:35 AKDT 2015 Starting snapshot test Wed Apr 29 09:34:37 AKDT 2015 error: unsupported configuration: source for disk 'vda' is not a regular file; refusing to generate external snapshot name Target Source ------------------------------------------------ vda /glustervol1/vm/test/test.20150429 hdc /dev/sr0 error: internal error: qemu block name '/glustervol1/vm/test/test.qcow2' doesn't match expected '/glustervol1/vm/test/test.20150429' error: Domain snapshot not found: no domain snapshot with matching name '20150429' Target Source ------------------------------------------------ vda /glustervol1/vm/test/test.20150429 hdc /dev/sr0 rm: can't remove '/glustervol1/vm/test/test.20150429': No such file or directory Ending snapshot test Wed Apr 29 09:34:37 AKDT 2015 At this point libvirt is confused about which file is the backing store because the first run did pivot after blockcommit, but didn't update the block file. From the logs: 2015-04-29 17:33:41.052+0000: 25192: warning : qemuDomainObjTaint:1972 : Domain id=2 name='test' uuid=4b9cc25b-68d1-4ce8-8a65-2a378e255e36 is tainted: high-privileges 2015-04-29 17:34:37.322+0000: 25191: error : virDomainSnapshotAlignDisks:609 : unsupported configuration: source for disk 'vda' is not a regular file; refusing to generate external snapshot name 2015-04-29 17:34:37.352+0000: 25194: error : qemuMonitorJSONDiskNameLookup:3977 : internal error: unable to find backing name for device drive-virtio-disk0 2015-04-29 17:34:37.354+0000: 25194: error : qemuMonitorJSONDiskNameLookupOne:3914 : internal error: qemu block name '/glustervol1/vm/test/test.qcow2' doesn't match expected '/glustervol1/vm/test/test.20150429' So libvirt insists that the block file is: root@wasvirt2:/glustervol1/vm/waspbx# virsh domblklist test Target Source ------------------------------------------------ vda /glustervol1/vm/test/test.20150429 hdc /dev/sr0 But that file isn't in use and isn't what qemu is using: root@wasvirt2:/glustervol1/vm/waspbx# lsof | grep test 25300 /usr/bin/qemu-system-x86_64 /var/log/libvirt/qemu/test.log 25300 /usr/bin/qemu-system-x86_64 /var/log/libvirt/qemu/test.log 25300 /usr/bin/qemu-system-x86_64 /glustervol1/vm/test/test.qcow2 The only way to straighten this out is to destroy and start the domain.

1 0

[libvirt-users] non failover equivalent to "virsh migrate --copy-storage-all"
by Andreas Buschmann 30 Apr '15

30 Apr '15

Hello, I have two servers where I can push VMs from one to the other by issuing the command virsh migrate --live --persistent --copy-storage-all --verbose \ test6 qemu+ssh://kvmhost2/system on kvmhost1. I can get the VM back by issuing the equivalent command on kvmhost2: virsh migrate --live --persistent --copy-storage-all --verbose \ test6 qemu+ssh://kvmhost1/system virsh copies the local data file /data/vm/test6.qcow2 with the filesystem over to the other server. Is there a way to just copy the data file over to the second server, without moving the VM? I want the equivalent of doing these two migrations is sequence, but without moving the VM. The goal is to get a backup copy of a running system onto a second system (kvmhost2). The copy (snapshot) from kvmhost2 can then be copied to a backup server, and can be used for a fast recovery point if kvmhost1 dies. Mit freundlichen Gruessen Andreas Buschmann -- Andreas Buschmann [Senior Systems Engineer] net.DE AG

3 3

[libvirt-users] Semantics of "virsh migrate --copy-storage-all" vs. --copy-storage-inc
by Andreas Buschmann 30 Apr '15

30 Apr '15

Hello, what is really the difference between virsh migrate --copy-storage-all and virsh migrate --copy-storage-inc ? There are some documents talking about NBD snapshots, but the user visible semantics are incomplete. Where does the incremental stuff happen? Does it require qcow2 files? Does it work with raw files? Does "--copy-storage-inc" require existing snapshots? Does "--copy-storage-inc" require existing snapshots which are in an external file so that there is a visible chain [base] <- [sn1] <- [sn2] Background: I am trying to understand what really happens, so I can use the tools for a reasonable fast failover between two servers with local storage. more Background: I have VMs and bare metal servers which do use expensive shared storages like NetApp, EMC² VNX, HP and others, but the shared storage boxes all require customer visible maintenance downtimes every 12 to 20 month. And these downtimes take a long lead time and are between 01:00 and 05:00. Mit freundlichen Gruessen Andreas Buschmann -- Andreas Buschmann [Senior Systems Engineer] net.DE AG

2 1

[libvirt-users] Virtual Smartcard GPG
by roky＠openmailbox.org 29 Apr '15

29 Apr '15

Hi. Is is possible to use GPG on the host instead of NSS with virtual smartcards? Please document how or add support for it. Can a virtual smartcard make the host less secure? If there are bugs in GPG/NSS backend on the host can they be abused by untrusted code in the vm?

2 1

[libvirt-users] Disable weak ciphers in vnc_tls
by Matthias Fenner 29 Apr '15

29 Apr '15

Dear libvirt team, we a currently in a pci-dss certification process and our security scanner found weak ciphers in the vlc_tls service on our centos6 box: When I scan using sslscan I can see that sslv3 and rc4 is accepted: inf0rmix@tardis:~$ sslscan myhost:16514 | grep Accepted Accepted SSLv3 256 bits DHE-RSA-AES256-SHA Accepted SSLv3 256 bits AES256-SHA Accepted SSLv3 128 bits DHE-RSA-AES128-SHA Accepted SSLv3 128 bits AES128-SHA Accepted SSLv3 128 bits RC4-SHA Accepted SSLv3 128 bits RC4-MD5 Accepted SSLv3 112 bits EDH-RSA-DES-CBC3-SHA Accepted SSLv3 112 bits DES-CBC3-SHA Accepted TLSv1 256 bits DHE-RSA-AES256-SHA Accepted TLSv1 256 bits DHE-RSA-CAMELLIA256-SHA Accepted TLSv1 256 bits AES256-SHA Accepted TLSv1 256 bits CAMELLIA256-SHA Accepted TLSv1 128 bits DHE-RSA-AES128-SHA Accepted TLSv1 128 bits DHE-RSA-CAMELLIA128-SHA Accepted TLSv1 128 bits AES128-SHA Accepted TLSv1 128 bits CAMELLIA128-SHA Accepted TLSv1 128 bits RC4-SHA Accepted TLSv1 128 bits RC4-MD5 Accepted TLSv1 112 bits EDH-RSA-DES-CBC3-SHA Accepted TLSv1 112 bits DES-CBC3-SHA how do we turn it off and only allow tlv>=1.1 Kind regards, Matthias Fenner

2 1

[libvirt-users] QemuDomainObjEndJob called when libvirtd is started and libvirt insists qemu is using the wrong disk source.
by Matthew Schumacher 29 Apr '15

29 Apr '15

List, I was under the impression that I could restart libvirtd without it destroying my VMs, but am not finding that to be true. When I killall libvirtd then my VM's keep running, but then when I start libvirtd it calls qemuDomainObjEndJob:1542 : Stopping job: modify (async=none vm=0x7fb8cc0d8510 name=test) and my domain gets whacked. Any way to disable this behavior? Also, while I'm at it, due to issues with snapshotting, I ended up with two domains where libvirt insists the disk source is incorrect which causes many things to break like this: root@wasvirt1:/etc/libvirt# virsh domblklist wasdev Target Source ------------------------------------------------ vda /glustervol1/vm/wasdev/wasdev.reboot hdc /dev/sr0 Yet: root@wasvirt1:/etc/libvirt# lsof | grep wasdev 2235 /usr/bin/qemu-system-x86_64 /var/log/libvirt/qemu/wasdev.log 2235 /usr/bin/qemu-system-x86_64 /var/log/libvirt/qemu/wasdev.log 2235 /usr/bin/qemu-system-x86_64 /glustervol1/vm/wasdev/wasdev.qcow2 The reason is because a blockcommit --active --pivot doesn't work, I blockjob --abort, then try again, it works the second time, but then the disk is wrong. Help would be greatly appreciated. Thanks, schu

3 10

[libvirt-users] Virtual Smartcard GPG
by roky＠openmailbox.org 29 Apr '15

29 Apr '15

Hi. Is is possible to use GPG on the host instead of NSS with virtual smartcards? Please document how or add support for it. Can a virtual smartcard make the host less secure? If there are bugs in GPG/NSS backend on the host can they be abused by untrusted code in the vm?

1 0

[libvirt-users] How does the libvirt deal with the vnet mac address
by wh.h＠foxmail.com 29 Apr '15

29 Apr '15

How does the libvirt deal with the vnet mac address? Greetings, if I establish a network for the VM (hypervisor is KVM) using bridge in the virt-manager , a vnet0 device is created . There are some relationships about mac address between the vnet0 device in the hypervisor and the ethX device in the VM, for example : the mac address of vnet0 is FE:54:00:84:E3:62 the mac address of ethX in the VM is 52:54:00:84:E3:62 two mac addresses above are almost the same except the first part of the address . but if I created a tap device manually , tunctl -t tap0 -u root brctl addif br0 tap0 and add tap0 to the VM, I will find that mac address between the tap0 device in the hypervisor and the ethX device in the VM will totally different . so I think that libvirt must do something about the mac address handling, could you please kindly tell me something about this ? I have found a function in libvirt-0.10.2.8\src\util\ virnetdevtap.c int virNetDevTapCreateInBridgePort(const char *brname, char **ifname, const virMacAddrPtr macaddr, const unsigned char *vmuuid, int *tapfd, virNetDevVPortProfilePtr virtPortProfile, virNetDevVlanPtr virtVlan, unsigned int flags) { …. virMacAddr tapmac; if (virNetDevTapCreate(ifname, tapfd, flags) < 0) return -1; /* We need to set the interface MAC before adding it * to the bridge, because the bridge assumes the lowest * MAC of all enslaved interfaces & we don't want it * seeing the kernel allocate random MAC for the TAP * device before we set our static MAC. */ virMacAddrSet(&tapmac, macaddr); if (!(flags & VIR_NETDEV_TAP_CREATE_USE_MAC_FOR_BRIDGE)) { if (macaddr->addr[0] == 0xFE) { /* For normal use, the tap device's MAC address cannot * match the MAC address used by the guest. This results * in "received packet on vnetX with own address as source * address" error logs from the kernel. */ virReportError(VIR_ERR_CONFIG_UNSUPPORTED, _("Unable to use MAC address starting with " "reserved value 0xFE - '%02X:%02X:%02X:%02X:%02X:%02X' - "), macaddr->addr[0], macaddr->addr[1], macaddr->addr[2], macaddr->addr[3], macaddr->addr[4], macaddr->addr[5]); goto error; } tapmac.addr[0] = 0xFE; /* Discourage bridge from using TAP dev MAC */ //the first part of mac address is set to 0xFE. } if (virNetDevSetMAC(*ifname, &tapmac) < 0) goto error; …. } How does the libvirt establish the arp table in the hypervisor if the vnet0 device in the hypervisor and the ethX device in the VM is different? If I want to create tap device manually , how should I deal with the mac address ?I have setup the mac address of the tap0 device in the hypervisor and the ethX device in the VM in the same way with libvirt , but the network of VM cannot work. weihua wh.h(a)foxmail.com wh.h(a)foxmail.com

3 5

[libvirt-users] Remove Virtual bridge and DNSMASQ
by mimicafe＠gmail.com 25 Apr '15

25 Apr '15

I am running KVM virtualization with libvirtd (libvirt) 0.10.2 in bridged network mode, however I still have the default virtual network bridge/interfaces and dnsmasq on the host. What I am trying to understand is whether or not dnsmasq and the virtual network (*virbr0, Vnet0 and Vnet1*) still play any role. If not, can I remove them? On most virtual hosts I see they are left around even when a network bridge has been manually setup and the default virtual network bridge/interfaces and dnsmasq are not serve any purpose. Thanks Mimi [bigfoot@localhost ~]$ ifconfig br0 Link encap:Ethernet HWaddr E2:59:52:12:34:4C inet addr:135.17.1XX.XX Bcast:135.17.1XX.XX Mask:255.255.255.128 inet6 addr: fe80::ea39:35ff:fe12:948e/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:564577 errors:0 dropped:0 overruns:0 frame:0 TX packets:303315 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:566465184 (540.2 MiB) TX bytes:83532692 (79.6 MiB) eth0 Link encap:Ethernet HWaddr E2:59:52:12:34:4C inet6 addr: fe80::ea39:35ff:fe12:948e/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:806142 errors:0 dropped:0 overruns:0 frame:0 TX packets:450977 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:711888772 (678.9 MiB) TX bytes:175377460 (167.2 MiB) Interrupt:28 Memory:f7100000-f7120000 lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:276793 errors:0 dropped:0 overruns:0 frame:0 TX packets:276793 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:551259266 (525.7 MiB) TX bytes:551259266 (525.7 MiB) *virbr0 Link encap:Ethernet HWaddr 52:54:00:2A:1B:AF* * inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0* * UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1* * RX packets:0 errors:0 dropped:0 overruns:0 frame:0* * TX packets:0 errors:0 dropped:0 overruns:0 carrier:0* * collisions:0 txqueuelen:0* * RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)* *vnet0 Link encap:Ethernet HWaddr FE:54:00:A0:8D:50* * inet6 addr: fe80::fc54:ff:fea0:8d50/64 Scope:Link* * UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1* * RX packets:124812 errors:0 dropped:0 overruns:0 frame:0* * TX packets:343055 errors:0 dropped:0 overruns:0 carrier:0* * collisions:0 txqueuelen:500* * RX bytes:55075362 (52.5 MiB) TX bytes:138488556 (132.0 MiB)* *vnet1 Link encap:Ethernet HWaddr FE:54:00:71:A8:78* * inet6 addr: fe80::fc54:ff:fe71:a878/64 Scope:Link* * UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1* * RX packets:17834 errors:0 dropped:0 overruns:0 frame:0* * TX packets:318816 errors:0 dropped:0 overruns:1 carrier:0* * collisions:0 txqueuelen:500* * RX bytes:2279102 (2.1 MiB) TX bytes:20534286 (19.5 MiB)* [bigfoot@localhost ~]$

3 7

[libvirt-users] CfP Virtualization in High-Performance Cloud Computing Workshop (VHPC '15)
by VHPC 15 25 Apr '15

25 Apr '15

================================================================= CALL FOR PAPERS 10th Workshop on Virtualization in High-Performance Cloud Computing (VHPC '15) held in conjunction with Euro-Par 2015, August 24-28, Vienna, Austria (Springer LNCS) ================================================================= Date: August 25, 2015 Workshop URL: http://vhpc.org Paper Submission Deadline: May 22, 2015 CALL FOR PAPERS Virtualization technologies constitute a key enabling factor for flexible resource management in modern data centers, cloud environments, and increasingly in HPC as well. Providers need to dynamically manage complex infrastructures in a seamless fashion for varying workloads and hosted applications, independently of the customers deploying software or users submitting highly dynamic and heterogeneous workloads. Thanks to virtualization, we have the ability to manage vast computing and networking resources dynamically and close to the marginal cost of providing the services, which is unprecedented in the history of scientific and commercial computing. Docker et al. OS-level virtualization, with its capability to isolate multiple user-space environments allows for their co-existence within the same OS kernel. It promises to provide many of the advantages of machine virtualization with high levels of responsiveness and performance; coupled with lightweight OSs it forms a potent architecture with promise to become a mainstream environment for HPC workloads. Machine virtualization, with its capability to enable consolidation of multiple under-utilized servers with heterogeneous software and operating systems (OSes), and its capability to live-migrate a fully operating virtual machine (VM) with a very short downtime, enables novel and dynamic ways to manage physical servers; I/O Virtualization allows physical network adapters to take traffic from multiple VMs; network virtualization, with its capability to create logical network overlays that are independent of the underlying physical topology and IP addressing, provides the fundamental ground on top of which evolved network services can be realized with an unprecedented level of dynamicity and flexibility; These technologies have to be inter-mixed and integrated in an intelligent way, to support workloads that are increasingly demanding in terms of absolute performance, responsiveness and interactivity, and have to respect well-specified Service- Level Agreements (SLAs), as needed for industrial-grade provided services. The Workshop on Virtualization in High-Performance Cloud Computing (VHPC) aims to bring together researchers and industrial practitioners facing the challenges posed by virtualization in order to foster discussion, collaboration, mutual exchange of knowledge and experience, enabling research to ultimately provide novel solutions for virtualized computing systems of tomorrow. The workshop will be one day in length, composed of 20 min paper presentations, each followed by 10 min discussion sections, and lightning talks, limited to 5 minutes. Presentations may be accompanied by interactive demonstrations. TOPICS Topics of interest include, but are not limited to: - Virtualization in supercomputing environments, HPC clusters, cloud HPC and grids - OS-level virtualization including container runtimes (Docker, rkt et al.) - Lightweight compute node operating systems/VMMs - Optimizations of virtual machine monitor platforms, hypervisors and - Hypervisor and network virtualization QoS and SLAs - Cloud based network and system management for SDN and NFV - Management, deployment and monitoring of virtualized environments - Performance measurement, modelling and monitoring of virtualized/cloud workloads - Programming models for virtualized environments - Cloud reliability, fault-tolerance, high-availability and security - Heterogeneous virtualized environments, virtualized accelerators, GPUs and co-processors - Optimized communication libraries/protocols in the cloud and for HPC in the cloud - Topology management and optimization for distributed virtualized applications - Cluster provisioning in the cloud and cloud bursting - Adaptation of emerging HPC technologies (high performance networks, RDMA, etc..) - I/O and storage virtualization, virtualization aware file systems - Job scheduling/control/policy in virtualized environments - Checkpointing and migration of VM-based large compute jobs - Cloud frameworks and APIs - Energy-efficient / power-aware virtualization Important Dates April 29, 2015 - Abstract registration May 22, 2015 - Full paper submission June 19, 2015 - Acceptance notification October 2, 2015 - Camera-ready version due August 25, 2015 - Workshop Date TPC CHAIR Michael Alexander (chair), TU Wien, Austria Anastassios Nanos (co-chair), NTUA, Greece Balazs Gerofi (co-chair), RIKEN Advanced Institute for Computational Science, Japan PROGRAM COMMITTEE Stergios Anastasiadis, University of Ioannina, Greece Costas Bekas, IBM Zurich Research Laboratory, Switzerland Jakob Blomer, CERN Ron Brightwell, Sandia National Laboratories, USA Roberto Canonico, University of Napoli Federico II, Italy Julian Chesterfield, OnApp, UK Patrick Dreher, MIT, USA William Gardner, University of Guelph, Canada Kyle Hale, Northwestern University, USA Marcus Hardt, Karlsruhe Institute of Technology, Germany Iftekhar Hussain, Infinera, USA Krishna Kant, Temple University, USA Eiji Kawai, National Institute of Information and Communications Technology, Japan Romeo Kinzler, IBM, Switzerland Kornilios Kourtis, ETH, Switzerland Nectarios Koziris, National Technical University of Athens, Greece Massimo Lamanna, CERN Che-Rung Roger Lee, National Tsing Hua University, Taiwan William Magato, University of Cincinnati, USA Helge Meinhard, CERN Jean-Marc Menaud, Ecole des Mines de Nantes France Christine Morin, INRIA, France Amer Qouneh, University of Florida, USA Seetharami Seelam, IBM Watson Research Center, USA Josh Simons, VMWare, USA Borja Sotomayor, University of Chicago, USA Kurt Tutschku, Blekinge Institute of Technology, Sweden Yasuhiro Watashiba, Osaka University, Japan Chao-Tung Yang, Tunghai University, Taiwan PAPER SUBMISSION-PUBLICATION Papers submitted to the workshop will be reviewed by at least two members of the program committee and external reviewers. Submissions should include abstract, key words, the e-mail address of the corresponding author, and must not exceed 10 pages, including tables and figures at a main font size no smaller than 11 point. Submission of a paper should be regarded as a commitment that, should the paper be accepted, at least one of the authors will register and attend the conference to present the work. Accepted papers will be published in the Springer LNCS series - the format must be according to the Springer LNCS Style. Initial submissions are in PDF; authors of accepted papers will be requested to provide source files. Format Guidelines: http://www.springer.de/comp/lncs/authors.html Submission Link: https://easychair.org/conferences/?conf=europar2015ws GENERAL INFORMATION The workshop is one day in length and will be held in conjunction with Euro-Par 2015, 24-28 August, Vienna, Austria

1 0

[libvirt-users] Unknown segfault
by Fl＠sh 23 Apr '15

23 Apr '15

Unknown sefault: http://itmag.es/2HxqM Why this might happen? Maybe i'm close last virConnectRef in threads? (but this is unlikely). Or maybe another reason? -- Fl@sh

3 5

[libvirt-users] Mounting directory as readonly within LXC
by Harish Vishwanath 22 Apr '15

22 Apr '15

Hello Is there a way to mount a directory as readonly when using LXC with libvirt? Something like: <filesystem type="mount"> <source dir="/sw/py27/python2.7_x86_64"/> <target dir="/opt//py27"/> <readonly/> </filesystem> The documentation says readonly only works with KVM/QEMU. Regards, Harish

2 2

[libvirt-users] QEMU interface type=ethernet
by Brian Rak 22 Apr '15

22 Apr '15

With Libvirt under modern kernels, you can't use <interface type='ethernet'> unless QEMU is running as root. Running qemu as root is not ideal, but I was able to track down the issue to this linux change: http://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=c… Which means that if you're seeing errors like this: 2015-03-02T18:00:51.243477Z qemu-kvm: -netdev tap,script=/tmp/vnet380622.sh,id=hostnet1: could not open /dev/net/tun: Operation not permitted 2015-03-02T18:00:51.243518Z qemu-kvm: -netdev tap,script=/tmp/vnet380622.sh,id=hostnet1: Device 'tap' could not be initialized They can be resolved like this: 1) Edit /etc/libvirt/qemu.conf, and add "/dev/net/tun" to the cgroup_device_acl option 2) Run: setcap cap_net_admin+eip /bin/qemu-system-x86_64 This will give QEMU CAP_NET_ADMIN when it runs. Make sure you review `man capabilities` to see what capabilities this actually gets qemu. The downside here is that in the event a guest somehow breaks out of qemu, CAP_NET_ADMIN gives them a bunch of scary permissions that could result in you having a seriously bad day (it's enough permissions to MITM all the machine's traffic, which could easily result in compromise) It looks to me like libvirt already has the ability to create tap devices and pass them into qemu (src/util/virnetdevtap.c - virNetDevTapCreateInBridgePort), however you need to actually be using a bridged network to do this. There is no way to have libvirt just create a tap device and leave the rest to user defined scripts. I don't think I have the necessary knowledge to add that feature in a generic way, but it seems like it would be pretty handy. I'll probably just work around it by removing the virNetDevBridgeAddPort call from our version of libvirt.

2 3

[libvirt-users] Libvirt disk API
by fu lirong 21 Apr '15

21 Apr '15

Hi all: I am studying Libvirt API , I am wondering the API about the disk manage is TBD(to be difine). The edition is libvirt 0.7.5 ,but the edition is too old ,The website is http://libvirt.org/guide/html/Application_Development_Guide-Introduction.ht… So, if I want to manage the VM disk , for example read the disk, what should I do ? Sincerely thanks a lot

2 1

[libvirt-users] <qemu:commandline> domain XML tag is not working?
by Chengyuan Li 21 Apr '15

21 Apr '15

Hi, I tried to enable virtio-blk data plane feature for VMs in my openstack environment, the hypervisor is ubuntu 14.04, libvirt 1.2.2 and QEMU 2.0. As nova doesn't support that parameter yet, I did belows 1. nova boot a VM with raw disk image. 2. nova stop the VM. 3. run "virsh edit <instance-id>" on the hyprvisor node, and adding below into instance xml just before </domain>. However, the <qemu:commandline> part is ignored and not saved after closing virsh edit, seems that libvirt rejected these changes. Is there any XML syntax error here? Or libvirt doesn't support <qemu:commandline> tag? <qemu:commandline> <qemu:arg value='-set'/> <qemu:arg value='device.drive-virtio-disk0.x-data-plane=on'/> </qemu:commandline> Regards, Chengyuan.

4 6

[libvirt-users] libvirt and guest processes
by dt sweval 21 Apr '15

21 Apr '15

Hi I wanted to find out if there is way to list all the running processes in a guest VM from the hypervisor. Like the output of 'ps -ef' from inside the guest VM, but without logging in or ssh into it. Thanks dtsweval

4 5

[libvirt-users] inquiry about differences between the tap and the vnet in the virt-manager
by wh.h＠foxmail.com 21 Apr '15

21 Apr '15

inquiry about differences between the tap and the vnet in the virt-manager Greetings! I encounter a problem about the network when using virt-manager to create and run a VM. when I want to establish a network bridge for the guest OS, I generally use two kinds of ways described as fellow : First method : create a bridge with the help of linux commad: brctl, or Second method : using virt-manager (1) create a bridge with the help of linux commad: brctl I use a script to establish a bridge, there are many script examples on the web to establish a bridge. when I restart the network service, I get the bridge : 1.1 create network bridge [root@localhost ~]# ifconfig br0 Link encap:Ethernet HWaddr C2:CD:89:61:2C:F0 inet addr:192.168.1.189 Bcast:192.168.1.255 Mask:255.255.255.0 inet6 addr: fe80::c0cd:89ff:fe61:2cf0/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:16 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:1080 (1.0 KiB) eth2 Link encap:Ethernet HWaddr 00:25:90:8E:C0:F0 inet addr:172.16.1.189 Bcast:172.16.255.255 Mask:255.255.0.0 inet6 addr: fe80::225:90ff:fe8e:c0f0/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:918998 errors:0 dropped:0 overruns:0 frame:0 TX packets:2033 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:84486598 (80.5 MiB) TX bytes:148116 (144.6 KiB) Memory:fbe20000-fbe3ffff [root@localhost ~]# brctl show bridge name bridge id STP enabled interfaces br0 8000.0025908ec0f0 no virbr0 8000.525400b1de42 yes virbr0-nic 1.2 add bridge interface the eth2 device is a physical ethernet device, [root@localhost ~]# brctl addif br0 eth2 [root@localhost ~]# brctl show bridge name bridge id STP enabled interfaces br0 8000.0025908ec0f0 no eth2 virbr0 8000.525400b1de42 yes virbr0-nic 1.3 create tap and add it to the bridge create tap: tunctl -t tap0 -u root brctl addif br0 tap0 ifconfig tap0 up chmod a+rw /dev/net/tun echo 1 > /proc/sys/net/ipv4/ip_forward iptables -t nat -A POSTROUTING -j MASQUERADE add it to the bridge [root@localhost ~]# brctl addif br0 tap0 [root@localhost ~]# brctl show bridge name bridge id STP enabled interfaces br0 8000.0025908ec0f0 no eth2 tap0 virbr0 8000.525400b1de42 yes virbr0-nic [root@localhost kvm_img]# ifconfig br0 Link encap:Ethernet HWaddr 00:25:90:8E:C0:F0 inet addr:172.16.1.189 Bcast:172.16.255.255 Mask:255.255.0.0 inet6 addr: fe80::c0cd:89ff:fe61:2cf0/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:37947 errors:0 dropped:0 overruns:0 frame:0 TX packets:10485 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:2581300 (2.4 MiB) TX bytes:40996927 (39.0 MiB) eth2 Link encap:Ethernet HWaddr 00:25:90:8E:C0:F0 inet6 addr: fe80::225:90ff:fe8e:c0f0/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:957962 errors:0 dropped:34 overruns:0 frame:0 TX packets:38466 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:87721507 (83.6 MiB) TX bytes:42551007 (40.5 MiB) Memory:fbe20000-fbe3ffff tap0 Link encap:Ethernet HWaddr F2:55:FC:F8:95:DC inet6 addr: fe80::f055:fcff:fef8:95dc/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:11 errors:0 dropped:0 overruns:0 frame:0 TX packets:1328 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:846 (846.0 b) TX bytes:173159 (169.1 KiB) 1.4 boot the guest (using the tap0) kvm -boot c -localtime -m 4G -hda /home/kvm_img/centos6p4.img -net nic -net tap,ifname=tap0,script=no -enable-kvm (2) using virt-manager 2.1 create network bridge [root@localhost ~]# ifconfig br0 Link encap:Ethernet HWaddr C2:CD:89:61:2C:F0 inet addr:192.168.1.189 Bcast:192.168.1.255 Mask:255.255.255.0 inet6 addr: fe80::c0cd:89ff:fe61:2cf0/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:16 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:1080 (1.0 KiB) eth2 Link encap:Ethernet HWaddr 00:25:90:8E:C0:F0 inet addr:172.16.1.189 Bcast:172.16.255.255 Mask:255.255.0.0 inet6 addr: fe80::225:90ff:fe8e:c0f0/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:918998 errors:0 dropped:0 overruns:0 frame:0 TX packets:2033 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:84486598 (80.5 MiB) TX bytes:148116 (144.6 KiB) Memory:fbe20000-fbe3ffff [root@localhost ~]# brctl show bridge name bridge id STP enabled interfaces br0 8000.0025908ec0f0 no virbr0 8000.525400b1de42 yes virbr0-nic 2.2 add bridge interface the eth2 device is a physical ethernet device, [root@localhost ~]# brctl addif br0 eth2 [root@localhost ~]# brctl show bridge name bridge id STP enabled interfaces br0 8000.0025908ec0f0 no eth2 virbr0 8000.525400b1de42 yes virbr0-nic 2.3 run the virt-manager and select the NIC option I find the bridge created above , configure it as fellow : in "Virtual Network Interface " setting: Source device: Host device tap0 (bridge br0) Device model: e1000 Mac address: 52:54:00:84:E3:62 2.4 I start the VM using virt-manager I get a vnet0 device created by virt-manager, [root@localhost ~]# ifconfig br0 Link encap:Ethernet HWaddr 00:25:90:8E:C0:F0 inet addr:172.16.1.189 Bcast:172.16.255.255 Mask:255.255.0.0 inet6 addr: fe80::c0cd:89ff:fe61:2cf0/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:62160 errors:0 dropped:1 overruns:0 frame:0 TX packets:22071 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:4007196 (3.8 MiB) TX bytes:59626981 (56.8 MiB) eth2 Link encap:Ethernet HWaddr 00:25:90:8E:C0:F0 inet6 addr: fe80::225:90ff:fe8e:c0f0/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:982209 errors:0 dropped:47 overruns:0 frame:0 TX packets:61101 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:89496644 (85.3 MiB) TX bytes:61778801 (58.9 MiB) Memory:fbe20000-fbe3ffff vnet0 Link encap:Ethernet HWaddr FE:54:00:84:E3:62 inet6 addr: fe80::fc54:ff:fe84:e362/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:5 errors:0 dropped:0 overruns:0 frame:0 TX packets:114 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:670 (670.0 b) TX bytes:13720 (13.3 KiB) both of the methods above seems that the network of guest OS is OK at most of environments, and I can get the attributes of the virtual network device . They are seemed to be the same. about the tap0： [root@localhost ~]# ethtool -i tap0 driver: tun version: 1.6 firmware-version: bus-info: tap supports-statistics: no supports-test: no supports-eeprom-access: no supports-register-dump: no supports-priv-flags: no about the vnet0 created by virt-manager : [root@localhost ~]# ethtool -i vnet0 driver: tun version: 1.6 firmware-version: bus-info: tap supports-statistics: no supports-test: no supports-eeprom-access: no supports-register-dump: no supports-priv-flags: no but the action between tap and vnet is not exactly the same！I will describe it in the following. this is my project environment: hardware : intel xeon E5 2600 server from supermicro host OS: centos 6.4 (kernel version is changed to 3.15.10 by me) virtual software : KVM+qemu 2.1.3 guest OS: centos 6.4 (kernel is not changed : 2.6.32 64bit) when I establish the network by the first method: create a bridge with the help of Linux commad: brctl, tap0 device is created in the host and assigned to the guest OS. tap0 device gets a name “eth0” in the guest OS. I use “ping ” command to test network state . I get the following result : concept explanation : local host: the OS where the guest OS is running remote host: another server which is connected to the local host using ethernet network . and this is my results: ping local host from guest OS is OK, I get reply from local host; ping remote host from local host is OK, I get reply from remote host; ping remote host from guest OS is not OK, I don’t get any reply from remote host; and this is my question. when I establish the network by the second method: using virt-manager, at this time , vnet0 device is created in the host and assigned to the guest OS. vnet0 device gets a name “eth0” in the guest OS. I also use “ping ” command to test network state . I get the following result : ping local host from guest OS is OK, I get reply from local host; ping remote host from local host is OK, I get reply from remote host; ping remote host from guest OS is OK, I get reply from remote host; my question is : why I cannot get reply when I ping remote host from guest OS using the first method? I use the same bridge: br0, so I think that the bridge: br0 is not responsible for the fault. and I have also stop the firewall . I guess the reason is that there are some differences between the tap device created by linux command and vnet device created by virt-manager. could you please kindly give my some advices to solve the problem ? I would be grateful if you could give me some advice . look forward to your reply ! weihua wh.h(a)foxmail.com

3 5

[libvirt-users] Question regarding management of VMs using libvirtd.
by somenathpal . 21 Apr '15

21 Apr '15

Hi All, I have a question regarding the uses of libvirtd. We have the following situation to manage. We have several hosts with libvirtd running. We have one management application to manage different VMs launched in those different hosts. We want to configure the system such a way so that one libvirtd can collect information about the VMs launched by other libvirtd running in different hosts. Is it possible? Could you please point me to some resource around this? In this we will be able to get information about VMs from single source and need not to query different host for VMs info. Regards, Somenath

3 2

[libvirt-users] virsh shutdown <domain> not fully working on win7 ?
by Marko Weber | 8000 21 Apr '15

21 Apr '15

hello list, i have a running vm with win7. When i fire up an 'virsh shutdown win7' nothing happens. When i fire up a second the same command, then the win7 machine is shutting down. Why do i need to fire up this command twice? Any ideas? best regards marko --

4 3