April 2021 - Users - libvirt List Archives

[libvirt-users] [virtual interface] detach interface during boot succeed with no changes
by Yalan Zhang 08 Sep '22

08 Sep '22

Hi guys, when I detach an interface from vm during boot (vm boot not finished), it always fail. I'm not sure if there is an existing bug. I have confirmed with someone that for disk, there is similar behavior, if this is also acceptable? # virsh destroy rhel7.2; virsh start rhel7.2 ;sleep 2; virsh detach-interface rhel7.2 network 52:54:00:98:c4:a0; sleep 2; virsh dumpxml rhel7.2 |grep /interface -B9 Domain rhel7.2 destroyed Domain rhel7.2 started Interface detached successfully <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </controller> <interface type='network'> <mac address='52:54:00:98:c4:a0'/> <source network='default' bridge='virbr0'/> <target dev='vnet0'/> <model type='rtl8139'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </interface> When I detach after the vm boot, expand the sleep time to 10, it will succeed. # virsh destroy rhel7.2; virsh start rhel7.2 ;sleep 10; virsh detach-interface rhel7.2 network 52:54:00:98:c4:a0; sleep 2; virsh dumpxml rhel7.2 |grep /interface -B9 Domain rhel7.2 destroyed Domain rhel7.2 started Interface detached successfully ------- Best Regards, Yalan Zhang IRC: yalzhang Internal phone: 8389413

3 4

Need more doc for libvirt-console-proxy
by Guy Godfroy 05 Oct '21

05 Oct '21

Hello, I'm making a web app for my company that will enable different teams to manage their own VMs. I wish to make possible to interact with each VM console, so I plan to use some xterm.js with websockets. So I discovered libvirt-console-proxy [1] when I looked for something to put a libvirt console into a websocket. That seems like the right tool for the job. The only doc I found is this article from 2017 [2]. After trying to understand from this article and from --help, I still have many questions. I am really bad at reading code so I can't even get answers from the sources. My main concern is: How a client is supposed to talk to the proxy? It is said that a security token must be provided. How? HTTP header? Which header? Am I missing something in websocket protocol? I think an example client implementation would help a lot. Also, I tried to use virtconsoleresolveradm to set up metadata on my domains like explained in the article [1] : ./virtconsoleresolveradm enable milou Enabled access to domain 'milou' But that doesn't seem to do anything (except defining the metadata namespace in the XML): virsh metadata milou http://libvirt.org/schemas/console-proxy/1.0 <consoles/> I precise that I have already this in my XML: <serial type='pty'> <target type='isa-serial' port='0'> <model name='isa-serial'/> </target> </serial> <console type='pty'> <target type='serial' port='0'/> </console> Should I remove that? Should I edit that? Thanks for your help. Guy Godfroy [1] https://gitlab.com/libvirt/libvirt-console-proxy [2] https://www.berrange.com/posts/2017/01/26/announce-new-libvirt-console-prox…

1 1

trying to understand how libvirt uses firewalld
by Felix Schwarz 30 Apr '21

30 Apr '21

Hi, I recently installed a test box using CentOS 8 and installed a CentOS 8 guest via libvirt (KVM). I need to use "routed" forwarding as the datacenter only gives me individual IPs which are routed to the physical interface and the switch only accepts packets with a well-known MAC address. On the host I enabled firewalld and moved the guest to a specific firewalld zone. I verified that libvirt is detecting firewalld. My idea was that I could use this to create somewhat fine-grained filters on the host for traffic from the internet to the guest (and possibly vice-versa). However it seems like that does not work the way I wanted: It seems as if nothing changes when I allow/disallow SSH for that zone. I can still ssh from the internet to the guest. After several reads on the documentation I have a guess of what might be going on but I'd like to confirm that: https://libvirt.org/firewall.html#fw-firewalld-and-virtual-network-driver > If firewalld is active on the host, libvirt will attempt to place the bridge > interface of a libvirt virtual network into the firewalld zone named > "libvirt" (thus making all guest->host traffic on that network subject to > the rules of the "libvirt" zone). Does that mean libvirt's firewalld usage is ONLY for traffic guest->host and does not affect all other traffic (e.g. host->guest, guest<->internet)? That sounds incredibly narrow (and not very useful for me) but it would explain why I don't see any effects in my experiment... --- In a related note it would be nice if there was a way to make routed setups with individual IPs easier. This problem hunts me for more than 10 years (I think I posted something in 2009 - still the same problem basically) and it would be nice if libvirt could somehow support this use case better: I want to allow traffic guest <-> internet in a routed setup. libvirt generates iptables rules like these: Chain LIBVIRT_FWO (1 references) pkts bytes target prot opt in out source destination 0 0 ACCEPT all -- br-private * 10.11.0.0/24 0.0.0.0/0 0 0 REJECT all -- br-private * 0.0.0.0/0 0.0.0.0/0 reject-with icmp-port-unreachable 0 0 ACCEPT all -- br-public * (NETWORK IP ) 0.0.0.0/0 43 3232 REJECT all -- br-public * 0.0.0.0/0 0.0.0.0/0 reject-with icmp-port-unreachable I my case "NETWORK IP" is a /32 IPv4 and AFAIK I have to put the host's IPv4 here (which is basically the router) so I can assign the guest IP inside the VM. What I need is basically a rule like ACCEPT one above but with the GUEST IP. I have some elaborate Python script which I can use as a "network" hook but that requires parsing output of "iptables" due to libvirt's events (e.g. libvirtd restart triggers one "plugged" event per VM). Thank you very much, Felix

1 0

l3 cache and cpu pinning
by Roman Mohr 23 Apr '21

23 Apr '21

Hi, I have a question regarding enabling l3 cache emulation on Domains. Can this also be enabled without cpu-pinning, or does it need cpu pinning to emulate the l3 caches according to the cpus where the guest is pinned to? Thank you and best regards, Roman

2 7

GlusterFS pools - do they work?
by lejeczek 21 Apr '21

21 Apr '21

Hi guys. I've been a consumer of libvirt for a while but this is first time I'm trying this: -> $ virsh vol-create-as glusterfs-VMs2 fcos-node1.qcow2 20G --format qcow2 error: Failed to create vol fcos-node1.qcow2 error: this function is not supported by the connection driver: storage pool does not support volume creation I'm on CentOS Stream with glusterfs-8.4, libvirt-7 and qemu-kvm-5.2.0 What might be the issue here? many thanks, L.

1 0

external snapshot create error
by Eyüp Hakan Duran 20 Apr '21

20 Apr '21

Dear all, I have been creating external snapshots of my KVM/QEMU VMs for more than a year on a host machine that runs Manjaro Linux. The current version of libvirt I am using is 1:7.1.0-3. I just noticed that the script I am using for this purpose has been failing. More specifically the command below returns with the error message indicated underneath the command: sudo virsh snapshot-create-as --no-metadata --domain myVM myVM-state --diskspec hda,file=overlay.qcow2 --disk-only --atomic error: XML document failed to validate against schema: Unable to validate doc against /usr/share/libvirt/schemas/domainsnapshot.rng Extra element disks in interleave Element domainsnapshot failed to validate content I also tried different versions of the command above with similar results, such as: sudo virsh snapshot-create-as mvVM --no-metadata myVM-state --diskspec hda,snapshot=external,file=overlay.qcow2 --disk-only --atomic Any pointers will be greatly appreciated! Hakan Duran

2 2

could not start libvirt service
by shafnamol N 14 Apr '21

14 Apr '21

Hi, I am using *CentOS 8*. I have built *libvirt* with the following method: $ meson build -Dsystem=true $ ninja -C build $ ninja -C build install But the problem is when i started it # systemctl start libvirtd Job for libvirtd.service failed because the control process exited with error code. See "systemctl status libvirtd.service" and "journalctl -xe" for details. i tried to get the status of libvirt # systemctl status libvirtd libvirtd.service - Virtualization daemon Loaded: loaded (/usr/lib/systemd/system/libvirtd.service; enabled; vendor preset: enabled) Active: failed (Result: exit-code) What will be the problem? Thanks for the help in advanc....

3 3

Confusion over networking configuration - I might be able to do some documentation
by Ed B 12 Apr '21

12 Apr '21

Hi libvirt users, I have been using libvirt on Debian Linux for a few months. (Mostly with virt-manager. I haven't yet learned all of the command line commands.) I'm currently confused by bridge mode networking, which I think is what I require to address the particular use case, which I will describe: My use case: Prior to this I have been using routed mode to organize my VMs. Most of the VMs I deploy are for services (web servers, mail servers, etc) so I require them to have static IP addresses on my local network. ==== An aside / comment: I *can* set those static IPs using the command line virsh net-edit (from memory) command and then change the settings in the xml files. However, since this seems like something that many users would require regularly it would be nice to be able to set static IP in the GUI when configuring with virt-manager. I assume that the same people who maintain libvirt also maintain virt-manager? If I'm wrong please re-direct me. Returning to the main discussion: It would be more convenient for me personally if I were able to set the IP addresses of these VMs using static addresses configured via an external DHCP server. I believe I can do this if my network is in "bridge" mode instead of NAT or Routed. I know this should be possible from reading information online but there doesn't seem to be any option for this in the virt-manager GUI. ==== To give more details on my setup: My network has a pfsense instance which is able to provide IP addresses to local machines. I would like to use the same pfsense machine to provide IP addresses to virtual machines. If I am not mistaken, the only way to do this would be to bridge the network on which the VMs reside to the network on which the pfsense machine resides. I will provide some screenshots to illustrate my confusion. When creating a new virtual network, I assume that I do not want to enable DHCPv4, because I want the pfsense system to allocate IP addresses. I do not know whether I should leave "Enable ipv4 network address space definition" or what the value should be. See image below. [cid:4e926d97-7a58-4350-93cc-0db7c401c075] Further in the setup (step 4), I assume I need to choose "Forward to physical network" rather than "Isolated virtual network". For the destination option, I do not know what should be chosen. I don't fully understand how this option works. For "Mode" there are three options: NAT, Routed and finally "Open". I cannot find any documentation which indicates what "Open" means. NAT and Routed are clearly not the correct options here - by a process of elimination that would imply that "Open" means "bridged" but I have a feeling that this is incorrect and I don't understand something else. Again, see screengrab below. [cid:f2ea4e34-c418-48d3-86b2-d7ff1002990a] I am quite keen to contribute something to documentation. At the moment I don't understand enough about how libvirt works to be able to do this. Apologies if my questions have been directed to the wrong people. If this is the case could you please re-direct me to the right place to ask such questions? Best regards

3 2

move mount permission denied
by Jiatong Shen 12 Apr '21

12 Apr '21

Hello community! I am faced with a mysterious [error]( https://gist.github.com/jshen28/5f29eed51e0a1308684214b35f009478) which says move mount is not permissioned. We are using libvirt with openstack-helm which running libvirt in a docker based k8s environment. /dev/termination-log is a device created and attached by k8s and mount looks like `/dev/mapper/ubuntu--vg-root on /var/log/termination-log type ext4 (rw,relatime,errors=remount-ro,data=ordered)` Any idea why this happens? appreciate the help! -- Best Regards, Jiatong Shen

2 1

how to use external snapshots with memory state
by Riccardo Ravaioli 12 Apr '21

12 Apr '21

Hi all, Best wishes for 2021! :) So I've been reading and playing around with live snapshots and still haven't figured out how to use an external memory snapshot. My goal is to take a disk+memory snapshot of a running VM and, if possible, save it in external files. As far as I understand, I can run: $ virsh snapshot-create $VM ... and that'll take an *internal* live snapshot of a given VM, consisting of its disks and memory state, which will be stored in the qcow2 disk(s) of the VM. In particular, the memory state will be stored in the first disk of the VM. I can then use the full range of snapshot commands available: revert, list, current, delete. Now, an external snapshot can be taken with: $ virsh snapshot-create-as --domain $VM mysnapshot --diskspec vda,file=/home/riccardo/disk_mysnapshot.qcow2,snapshot=external --memspec file=/home/riccardo/mem_mysnapshot.qcow2,snapshot=external ... with as many "--diskspec" as there are disks in the VM. I've read the virsh manual and the libvirt API documentation, but it's not clear to me what exactly I can do then with an external snapshot, in particular with the file containing the memory state. In articles from 7-8 years ago people state that external memory snapshots cannot be reverted... is it still the case today? If so, what's a typical usage for such files? If not with libvirt, is it possible to revert to an external memory + disk state in other ways, for instance through qemu commands? Thanks! Riccardo

2 4

live migrate storage to different volume on the same host
by Jing-Wei Su 12 Apr '21

12 Apr '21

Hello experts, I would like to move the qcow2 disk images of a running VM to a different storage because of the maintenance of the underlying storage on the same host. I found the live migration is not allowable on the same host using virsh. Is there any suggestion or better practices for this? Thank you, Derek

2 1

libvirt 7.2.0 domainbackup
by Thomas Stein 12 Apr '21

12 Apr '21

Hello one and all. Just wanted to check out the new feature domainbackup but having trouble to configure it. I thought I just have to put <domainbackup> <disks> <disk name='vda' type='file'> <target file='/var/lib/libvirt/jitsi'/> <driver type='raw'/> </disk> </disks> </domainbackup> at the top level of my domain xml file but that does not seem to work. I get: error: XML document failed to validate against schema: Unable to validate doc against /usr/share/libvirt/schemas/domain.rng Element domain has extra content: domainbackup Can someone please push me in the right direction? cheers, t.

2 5

submitting a patch to fix documentation errors
by Tom Ammon 10 Apr '21

10 Apr '21

Hello, While using the libvirt application development guide for python ( https://libvirt.org/docs/libvirt-appdev-guide-python/en-US/html/index.html) I found a couple of errors in the example code that I'd like to fix. I've created a branch and committed the fixes locally, and I'm ready to push them. I plan to use git send-email to submit the patch. Which list should I use in the --to= ? Should it be libvirt-users(a)redhat.com? This is my first contribution to this project. I've read the best practices and contributing guidelines on libvirt.org, but if I make mistakes in the workflow I'd appreciate your help to correct them. Thanks! Tom -- ----------------------------------------------------------------------------- Tom Ammon M: (737) 400-9042 thomasammon(a)gmail.com -----------------------------------------------------------------------------

2 2

Creating Virtual machine with .OVF format
by Ajay Kumar 09 Apr '21

09 Apr '21

Hello members, I would like to create virtual machine images with some pre-installed software in a .*OVF/OVA* format. So that I can use these* OVF *images/templates for any hypervisor to create a VM. Do you have any suggestions or some available web scripts/links to do this..? Thanks, Ajay

3 2

XML for working mips64el guest
by Skyler Mäntysaari 08 Apr '21

08 Apr '21

Hi there, How do I get a working xml for mips64el guest when using virt-manager? The host system is running Ubuntu, but I believe that this is the right list for things relating to libvirt. It errors with: --------------------------------------------- Unable to complete install: 'this function is not supported by the connection driver: 'mips64el' architecture is not supported by CPU driver' Traceback (most recent call last): File "/usr/share/virt-manager/virtManager/asyncjob.py", line 75, in cb_wrapper callback(asyncjob, *args, **kwargs) File "/usr/share/virt-manager/virtManager/createvm.py", line 2089, in _do_async_install guest.installer_instance.start_install(guest, meter=meter) File "/usr/share/virt-manager/virtinst/install/installer.py", line 542, in start_install domain = self._create_guest( File "/usr/share/virt-manager/virtinst/install/installer.py", line 491, in _create_guest domain = self.conn.createXML(install_xml or final_xml, 0) File "/usr/lib/python3/dist-packages/libvirt.py", line 4034, in createXML if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self) libvirt.libvirtError: this function is not supported by the connection driver: 'mips64el' architecture is not supported by CPU driver --------------------------------------------- This is what I'm trying to use: --------------------------------------------- <domain type="qemu"> <name>debian9-mips64el</name> <metadata> <libosinfo:libosinfo xmlns:libosinfo="http://libosinfo.org/xmlns/libvirt/domain/1.0"> <libosinfo:os id="http://debian.org/debian/9"/> </libosinfo:libosinfo> </metadata> <memory>1048576</memory> <currentMemory>1048576</currentMemory> <vcpu>2</vcpu> <os> <type arch="mips64el" machine="malta">hvm</type> <cmdline>nokaslr root=/dev/sda1 console=ttyS0</cmdline> <boot dev="hd"/> </os> <clock offset="utc"/> <devices> <emulator>/usr/bin/qemu-system-mips64el</emulator> <controller type="pci" index="0" model="pci-root"/> <disk type="file" device="disk"> <driver name="qemu" type="qcow2"/> <source file="/var/lib/libvirt/images/mip64el/stretch/disk.qcow2"/> <target dev="hda" bus="ide"/> </disk> <interface type="network"> <source network="default"/> <mac address="52:54:00:c5:63:f5"/> </interface> <console type="pty"/> </devices> </domain> ---------------------------------------------------------------------------------------------------------------

1 0

Re: Regarding location of Libvirt library
by Andrea Bolognani 08 Apr '21

08 Apr '21

[once again, please keep replies on-list] On Wed, 2021-04-07 at 10:46 +0530, shafnamol N wrote: > > What does running > > > > $ ls /usr/lib/systemd/system/*virt* > > > > output? > > The output is as shown below: > > # ls /usr/lib/systemd/system/*virt* > /usr/lib/systemd/system/libvirtd-admin.socket /usr/lib/systemd/system/virtnodedevd.service > /usr/lib/systemd/system/libvirtd-ro.socket /usr/lib/systemd/system/virtnodedevd.socket > /usr/lib/systemd/system/libvirtd.service /usr/lib/systemd/system/virtnwfilterd-admin.socket > /usr/lib/systemd/system/libvirtd.service_backup /usr/lib/systemd/system/virtnwfilterd-ro.socket > /usr/lib/systemd/system/libvirtd.socket /usr/lib/systemd/system/virtnwfilterd.service > /usr/lib/systemd/system/libvirtd-tcp.socket /usr/lib/systemd/system/virtnwfilterd.socket > /usr/lib/systemd/system/libvirtd-tls.socket /usr/lib/systemd/system/virtproxyd-admin.socket > /usr/lib/systemd/system/libvirt-guests.service /usr/lib/systemd/system/virtproxyd-ro.socket > /usr/lib/systemd/system/virt-guest-shutdown.target /usr/lib/systemd/system/virtproxyd.service > /usr/lib/systemd/system/virtinterfaced-admin.socket /usr/lib/systemd/system/virtproxyd.socket > /usr/lib/systemd/system/virtinterfaced-ro.socket /usr/lib/systemd/system/virtproxyd-tcp.socket > /usr/lib/systemd/system/virtinterfaced.service /usr/lib/systemd/system/virtproxyd-tls.socket > /usr/lib/systemd/system/virtinterfaced.socket /usr/lib/systemd/system/virtqemud-admin.socket > /usr/lib/systemd/system/virtlockd-admin.socket /usr/lib/systemd/system/virtqemud-ro.socket > /usr/lib/systemd/system/virtlockd.service /usr/lib/systemd/system/virtqemud.service > /usr/lib/systemd/system/virtlockd.socket /usr/lib/systemd/system/virtqemud.socket > /usr/lib/systemd/system/virtlogd-admin.socket /usr/lib/systemd/system/virtsecretd-admin.socket > /usr/lib/systemd/system/virtlogd.service /usr/lib/systemd/system/virtsecretd-ro.socket > /usr/lib/systemd/system/virtlogd.socket /usr/lib/systemd/system/virtsecretd.service > /usr/lib/systemd/system/virtlxcd-admin.socket /usr/lib/systemd/system/virtsecretd.socket > /usr/lib/systemd/system/virtlxcd-ro.socket /usr/lib/systemd/system/virtstoraged-admin.socket > /usr/lib/systemd/system/virtlxcd.service /usr/lib/systemd/system/virtstoraged-ro.socket > /usr/lib/systemd/system/virtlxcd.socket /usr/lib/systemd/system/virtstoraged.service > /usr/lib/systemd/system/virtnetworkd-admin.socket /usr/lib/systemd/system/virtstoraged.socket > /usr/lib/systemd/system/virtnetworkd-ro.socket /usr/lib/systemd/system/virtvboxd-admin.socket > /usr/lib/systemd/system/virtnetworkd.service /usr/lib/systemd/system/virtvboxd-ro.socket > /usr/lib/systemd/system/virtnetworkd.socket /usr/lib/systemd/system/virtvboxd.service > /usr/lib/systemd/system/virtnodedevd-admin.socket /usr/lib/systemd/system/virtvboxd.socket > /usr/lib/systemd/system/virtnodedevd-ro.socket libvirtd.service_backup should not be there, but I don't think that's what causing your problem. I would still recommend deleting it just in case. > > What OS are you using? > > Centos 8 > > > What does the > > > > Miscellaneous > > ... > > Init script: XXX > > > > entry look like in the summary that's displayed when you run Meson? > > Miscellaneous > Init script : systemd These all look good, so I really have no idea what's going on. Hopefully someone else on the list will be able to help you! Good luck :) -- Andrea Bolognani / Red Hat / Virtualization

2 1

Xen: libvirt.libvirtError: An error occurred, but the cause is unknown
by Mathieu Tarral 07 Apr '21

07 Apr '21

Hi, I'm facing a strange issue with libvirt and the Xen driver. Whenever I try to define or start a domain, I always get this error: "libvirt.libvirtError: An error occurred, but the cause is unknown" (in Python virt-manager interface) Which is not very helpful. Trying to use virsh directly leads to the same error message: virsh # start win10_xen error: Failed to start domain win10_xen error: An error occurred, but the cause is unknown I checked /var/log/libvirt/libxl/libxl-driver.log, but the log file is empty. However, using the xl toolstack directly to start a new domain works fine, so the issue doesn't seem to come from Xen. My environment: - Ubuntu 20.04 LTS - xen-hypervisor-4.11-amd64 (4.11.3+24-g14b62ab3e5-1ubuntu2) - libvirt0 (6.0.0-0ubuntu8.8) I really like libvirt and virt-manager to manage my VMs. Any clue how I could dig deeper and find the root cause ? Thanks.

3 3

Live migration with change to setmaxmem
by Dariusz Smigiel 07 Apr '21

07 Apr '21

Hi Team, I need to migrate beefy instance between two different hosts which is running out of resources. I was wondering, if there is a way to change maximum memory value during live migration, without shutting down the instance. Thanks, Dariusz

2 2

Re: Regarding location of Libvirt library
by Andrea Bolognani 06 Apr '21

06 Apr '21

[please keep replies on-list] On Mon, 2021-04-05 at 12:03 +0530, shafnamol N wrote: > Hi, > I have build libvirt in the following method: > $ meson build -Dsystem=true > $ ninja -C build > When i tried to get the information via > > $pkg-config --cflags --libs libvirt > > it doesnt show anything. > > But I tried > $ninja -C build install > > and then > $pkg-config --cflags --libs libvirt > It shows like: > libvirt-7.1.0]# pkg-config --cflags --libs libvirt > -lvirt This is expected: pkg-config can't find the libvirt.pc file until you've installed it :) > But the problem is when i tried to get the status of libvirt > > # systemctl status libvirtd > ● libvirtd.service > Loaded: not-found (Reason: Unit libvirtd.service not found.) > Active: failed (Result: exit-code) > > I tried with > # systemctl daemon-reload > But the problem persists.. > what will be the problem... What does running $ ls /usr/lib/systemd/system/*virt* output? What does the Miscellaneous ... Init script: XXX entry look like in the summary that's displayed when you run Meson? What OS are you using? -- Andrea Bolognani / Red Hat / Virtualization

1 0

Virtual Network API for QEMU
by Radek Simko 03 Apr '21

03 Apr '21

Hi, According to this support matrix https://libvirt.org/hvsupport.html#virNetworkDriver there is no support for any APIs other than hypervisor ones for qemu. For example virConnectNumOfNetworks is not supported. Is there any particular reason this is not supported? Has any development in that area been attempted in the past? Would contributions adding support be welcomed? Thanks, Radek Simko

4 8

GlusterFS libgfapi with TLS
by lejeczek 01 Apr '21

01 Apr '21

Hi guys. I have KVM guests stored on glusterFS volume and I recently added TLS encryption to Gluster. What changes, tweaks are required at libvirtd/qemu's end? many thanks, L.

2 2