- Users - libvirt List Archives

Networking on macOS host, without TunTap
by Carl Winbäck 31 Mar '22

31 Mar '22

Dear libvirt users, I’m trying to get the following setup up and running: libvirt+qemu on a macOS Monterey host, with a Debian 11 guest. The domain type is hvf. The thing I’m struggling with now is how to configure networking in a sane way. Older articles reference the “TunTap” project, but AFAICT this software it is no longer recommended. Does anyone know of a good way to add networking to this setup without using TunTap? Best regards, Carl Winbäck

1 0

Requirements to enable discard support on virtio-blk
by Andrew Martin 30 Mar '22

30 Mar '22

Hello, I am attempting to enable discard support on the virtio-blk device on a QEMU VM however it isn't working. My understanding is that this is enabled in QEMU >= 4.0, so I am not sure why this isn't working: Host OS: Ubuntu 20.04 (kernel 5.4.0) Guest OS: Ubuntu 18.04 (kernel 4.15.0) Guest config: <os> <type arch='x86_64' machine='pc-q35-4.2'>hvm</type> </os> <disk type='file' device='disk'> <driver name='qemu' type='qcow2' discard='unmap'/> <source file='/var/lib/libvirt/images/myvm.qcow2' index='1'/> <backingStore/> <target dev='vda' bus='virtio'/> <alias name='virtio-disk0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </disk> What are the values for machine type that will support discard on virtio-blk? Anything 4.0 or greater (e.g. would pc-i440fx-4.0 work too)? I can see from the host's perspective that the guest appears to have discard enabled because the following command shows "discard = true": # virsh qemu-monitor-command myvm --hmp info qtree | grep discard yet inside the VM, even with the "discard" mount option set: # for f in /sys/block/vda/queue/discard_*; do echo $f; cat $f; done /sys/block/vda/queue/discard_granularity 0 /sys/block/vda/queue/discard_max_bytes 0 /sys/block/vda/queue/discard_max_hw_bytes 0 /sys/block/vda/queue/discard_zeroes_data 0 Are the virtio drivers in the guest kernel too old to support discard on virtio-blk? Or is something else missing? Thanks, Andrew

1 0

virDomainCoreDump output format
by Shelly Kagan 29 Mar '22

29 Mar '22

Hi all, I have a small question regarding virDomainCoreDump. In the documentation[1] it is stated that the output is of format RAW. After implementing a function using this command the output file format that I see is ELF. I understand those formats are different, so is the documentation not updated? Is there a reason I will get an ELF format instead of RAW? Appreciate your help! [1] https://libvirt.org/html/libvirt-libvirt-domain.html#virDomainCoreDumpWithF… -- Shelly Kagan Senior Software Engineer Red Hat <https://www.redhat.com> <https://www.redhat.com>

2 1

PHP Warning: libvirt_domain_new(): Cannot get installation XML
by Benjamin Smith 29 Mar '22

29 Mar '22

Despite great success at using php-libvirt with other functions, I have been entirely unsuccessful in getting it to create a new domain/machine. Any time I do, and with virtually anything I try, I get the above error message. Running PHP 7.4 (remi) on otherwise stock AlmaLinux. *[root@sb4 html]# cat /etc/redhat-release AlmaLinux release 8.5 (Arctic Sphynx* *[root@sb4 html]# rpm -qa php php-fpm php-libvirt nginxphp-7.4.28-1.el8.remi.x86_64nginx-1.14.1-9.module_el8.3.0+2165+af250afe.alma.x86_64php-fpm-7.4.28-1.el8.remi.x86_64php-libvirt-0.5.5-1.el8.remi.7.4.x86_6412 XEON E312xx cores, 24 w/HT, 192GB RAM, etc. * When I run it, I find in php-fpm www.error-log: *[24-Mar-2022 20:05:51 UTC] PHP Warning: libvirt_domain_new(): Cannot get installation XML in /var/www/html/manage.php on line 190* Matching message onscreen: *Warning: libvirt_domain_new(): Cannot get installation XML in /var/www/html/manage.php on line 191* Here's the offending code: $networks = [ *'mac'* => '52:54:00:06:a7:df', *'network'* => 'default', *'model'* => *'e1000'*, ]; $disks = [ *'path'* => *"/var/lib/libvirt/images/myvm.qcow2"*, *'driver'* => *'qcow2'*, *'bus'* => *'ide'*, *'dev'* => *'hda'*, *'size'* => *'40G'*, *'flags'* => null, ]; error_reporting(-1); $result = libvirt_domain_new( $conn, 'myvm',* // name of the new domain* null,* // optional architecture string, can be NULL to get default (or false)* 2048,* // number of megabytes of RAM to be allocated for domain* 8192,* // maximum number of megabytes of RAM to be allocated for domain* 2,* // number of VCPUs to be allocated to domain* *'/var/www/html/AlmaLinux-8.4-x86_64-dvd.iso'*,* // installation ISO image for*$ $disks,* // array of disk devices for domain* $networks, null ); I've tried various values for $disks and $networks, setting error reporting to -1 (display anything and everything), journalctl -f on both the webserver and the virt host, etc but was never able to see any error other than this one. I've also been looking in the source code file for anything obvious, and I've been utterly unsuccessful in changing the error message. For example, inserting an invalid path for the ISO image doesn't result in an error message that it *looks* like it should be throwing errors about invalid ISO image. In fact, I've even tried passing ALL NULL/EMPTY VALUES and with the exception of the $conn connection variable, I only get this "Cannot get installation XML" error message: $result = libvirt_domain_new( $conn, null, null, null, null, null, null, [], [] ); Shouldn't I at least be seeing a message like "Name is 'myvm', memMB is 2048, maxmemMB is 8192" ? https://github.com/php/pecl-virtualization-libvirt/blob/master/src/libvirt-…

2 1

How to make the libvirt VM installed under the regular user boot during the system bootup?
by Martin T 21 Mar '22

21 Mar '22

Hi. I installed a virtual machine under a regular user(in other words, not under root user) with virt-install and configured this VM to boot automatically: $ virsh dominfo vm Id: 1 Name: vm UUID: eef95dd6-5efe-4059-8dcc-3e35db12f55d OS Type: hvm State: running CPU(s): 4 CPU time: 253.7s Max memory: 4194304 KiB Used memory: 4194304 KiB Persistent: yes Autostart: enable Managed save: no Security model: none Security DOI: 0 $ ls -l /home/user/.config/libvirt/qemu/autostart/ total 0 lrwxrwxrwx 1 user user 47 Apr 30 16:59 vm.xml -> /home/user/.config/libvirt/qemu/vm.xml $ The vm indeed starts automatically, but only when the regular user has logged in. I would like libvirtd(started by the systemd) to execute this VM already during the system bootup when the regular user has not yet logged in. How to accomplish this? I also made a symlink under /etc/libvirt/qemu/autostart/, but this did not help. thanks, Martin

2 1

how to reliably shutdown domains ?
by Lentes, Bernd 09 Mar '22

09 Mar '22

Hey guys, i have a two-node cluster with around 20 domains. Cluster-Software is pacemaker and corosync, OS is SLES 12 SP5. The scripts for starting/stopping the domains use virsh. Is there a way to reliably shutdown the domains via virsh ? I'm testing around, but sometimes the domains stop, sometimes they don't, sometimes it takes very long so that the cluster times out and fence the respective node. I'm using "virsh shutdown domain --mode acpi,agent" for the windows domains (not reliable) and for the linux domains "virsh shutdown domain", also not reliable. What can i do ? Bernd -- Bernd Lentes System Administrator Institute for Metabolism and Cell Death (MCD) Building 25 - office 122 HelmholtzZentrum München bernd.lentes(a)helmholtz-muenchen.de phone: +49 89 3187 1241 fax: +49 89 3187 2294 http://www.helmholtz-muenchen.de/mcd Public key: 30 82 01 0a 02 82 01 01 00 b3 72 3e ce 2c 0a 6f 58 49 2c 92 23 c7 b9 c1 ff 6c 3a 53 be f7 9e e9 24 b7 49 fa 3c e8 de 28 85 2c d3 ed f7 70 03 3f 4d 82 fc cc 96 4f 18 27 1f df 25 b3 13 00 db 4b 1d ec 7f 1b cf f9 cd e8 5b 1f 11 b3 a7 48 f8 c8 37 ed 41 ff 18 9f d7 83 51 a9 bd 86 c2 32 b3 d6 2d 77 ff 32 83 92 67 9e ae ae 9c 99 ce 42 27 6f bf d8 c2 a1 54 fd 2b 6b 12 65 0e 8a 79 56 be 53 89 70 51 02 6a eb 76 b8 92 25 2d 88 aa 57 08 42 ef 57 fb fe 00 71 8e 90 ef b2 e3 22 f3 34 4f 7b f1 c4 b1 7c 2f 1d 6f bd c8 a6 a1 1f 25 f3 e4 4b 6a 23 d3 d2 fa 27 ae 97 80 a3 f0 5a c4 50 4a 45 e3 45 4d 82 9f 8b 87 90 d0 f9 92 2d a7 d2 67 53 e6 ae 1e 72 3e e9 e0 c9 d3 1c 23 e0 75 78 4a 45 60 94 f8 e3 03 0b 09 85 08 d0 6c f3 ff ce fa 50 25 d9 da 81 7b 2a dc 9e 28 8b 83 04 b4 0a 9f 37 b8 ac 58 f1 38 43 0e 72 af 02 03 01 00 01

3 2

Resize backing store
by Jeff Brown 08 Mar '22

08 Mar '22

Apologies in advance if this be a stupid question, as everything I've read seems to suggest it's impossible. Slowly running out of space on a 200GB root partition. Is it possible to create a snapshot - leaving the QCOW2 image 'quiescent' - resize it using 'qemu-img resize' - then pivot the snapshot back? (Then shutdown, attach the storage to another bootable OS, and run fdisk and resize2fs.) Everything I've read says to shutdown the VM; but besides the real possibility of the snapshot blockcommit being corrupted when pivoted into the newly resized backing store, I don't see why it shouldn't work. And save some significant downtime. Please can someone advise if this is actually possible, or if I'm wasting my time? Thanks! -- Jeff Brown Future Foundation Cell 074 101 5170 VoIP 087 550 1210 Fax: 086 532 3508

2 1

About RO connection
by Xingbo Kan 08 Mar '22

08 Mar '22

Dear developers and users: Is there any standard or convention of which kind of APIs&flags could be invoked by RO connection? If there is any, please tell me in detail, thanks a lot! Kind regards, xkan

2 2

Number of the max supported VFs are different
by Yalan Zhang 08 Mar '22

08 Mar '22

Hi there, I have an Intel X520 network card, and I find the max supported VFs are different. Please check below outputs: # lspci -vvv -s 04:00.0 04:00.0 Ethernet controller: Intel Corporation Ethernet 10G 2P X520 Adapter (rev 01) ... Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV) IOVCap: Migration-, Interrupt Message Number: 000 IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy+ IOVSta: Migration- ** Initial VFs: 64, Total VFs: 64**, Number of VFs: 0, Function Dependency Link: 00 VF offset: 128, stride: 2, Device ID: 10ed Supported Page Size: 00000553, System Page Size: 00000001 Region 0: Memory at 0000000094400000 (64-bit, prefetchable) Region 3: Memory at 0000000094500000 (64-bit, prefetchable) VF Migration: offset: 00000000, BIR: 0 Kernel driver in use: ixgbe Kernel modules: ixgbe # cat /sys/class/net/enp4s0f0/device/sriov_totalvfs 63 # echo 64 > /sys/class/net/enp4s0f0/device/sriov_numvfs -bash: echo: write error: Numerical result out of range # echo 63 > /sys/class/net/enp4s0f0/device/sriov_numvfs # cat /sys/class/net/enp4s0f0/device/sriov_numvfs 63 The lspci command says the Total VFs supported is 64, while in the file "sriov_totalvfs" says it's 63. And the sriov_numvfs file will take precedence. Why are the numbers different? Just a little curious. Thank you! ------- Best Regards, Yalan Zhang IRC: yalzhang

2 2

libvirtd file descriptors leaking
by Дмитрий 01 Mar '22

01 Mar '22

Hello, ## SETUP CentOS 8 Stream libguestfs-tools.noarch 1:1.40.2-24.el8.plesk libvirt.x86_64 7.6.0-6.el8s ## ISSUE REPRODUCTION lsof -p $(cat /run/libvirtd.pid) | wc -l # here we have N open file descriptors by libvirtd guestfish --ro -d domain1 run # here we have N+1 open file descriptors by libvirtd Ctrl+D # and we still have N+1 open file descriptors by libvirtd virt-df -d domain1 # after completion we still having N++ open file descriptors by libvirtd To fix this issue i am force to restart libvirtd

3 7

QEMU args generation order with libvirt
by M, Shivakumar 28 Feb '22

28 Feb '22

Hello, We are trying to bring up the Android VM with Libvirt, as part of this exercise it is advised to keep Replay Protected Memory Block (RPMB) device as the first virtio device in the QEMU arg list, as the secure storage daemon in Andriod side communicates with dev/vport0p1 for RPMB usage. Is there any way we can make a qemu commands generation in particular order with Libvirt XML ? Thanks, Shivakumar M

2 1

virtio 3d acceleration - centOS 9 - ?
by lejeczek 27 Feb '22

27 Feb '22

Hi guys Would anybody know if RHEL & all involved gangs plan or think to have c9, when is GA, offer/support 3d virtio? many thanks, L.

1 0

networking question
by Natxo Asenjo 25 Feb '22

25 Feb '22

hi, I have an issue with one host at a customer's site. I think this cannot work, but I would like to ask you just in case I am confused. host: eno1: 172.20.10.x/24 management interface gw 172.20.10.254 bridge-service: 0.0.0.0/24 tun0: openvpn tunnel to external data center internal-bridge: x.x.x.x/28 ; routed subnet that goes to openvpn tun0 on vm: eth0: x.x.x.x/28 on internal-bridge (default gw) eth1: 172.20.10.x/24 bridge-service gw 172.20.10.254 (same as eno1) Connectivity to and from openvpn (from and to datacenter) is perfect. All vms are directly reachable from our management services, no natting. >From hypervisor I can ping the gw, from vm I cannot ping 172.20.10.254. My gut feeling is that this cannot work because traffic for the hypervisor for subnet 172.20.10.x/24 flows through eno1, but for vm through the bridge-loggin interface. So that cannot work. Should we just ask the customer to give us different subnets for the host and the vm? TIA. -- regards, Natxo

3 2

domblkinfo->allocation is not equals to domstats.1->allocation for disk with <slices> settings
by Zhen Tang 24 Feb '22

24 Feb '22

Hi, I did some testing about disk with <slice> setting and found that the value of domblkinfo->allocation is not same with domstats.1->allocation for disk with <slices> Env: libvirt-8.0.0-4.el9 qemu-kvm-6.2.0-9.el9 Step: 1. prepare a image # qemu-img create /car/lib/libvirt/images/disk-raw -f raw 100M -o preallocation=full 2. start a guest and attach the disk ➜ ~ cat disk.xml <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='none' io='native' copy_on_read='off' discard='ignore' detect_zeroes='on'/> <source file='/var/lib/libvirt/images/disk-raw' index='1'> <slices> <slice type='storage' offset='0' size='104857600'/> </slices> </source> <backingStore/> <target dev='sdb' bus='scsi'/> <iotune> <total_bytes_sec>10000000</total_bytes_sec> <group_name>slice</group_name> </iotune> <alias name='ua-slices'/> <address type='drive' controller='0' bus='0' target='0' unit='1'/> </disk> 3. Write some data to the slices disk in vm (in vm) dd if=/dev/zero of=/dev/sdb bs=10M count=1 4. check *domblkinfo* and *domstats* ➜ ~ virsh domstats rhel9.0-1 --block|grep -Ei 'block.1.(allocation|capacity|physical)' *block.1.allocation=0* block.1.capacity=104857600 block.1.physical=104865792 ➜ ~ ➜ ~ virsh domblkinfo rhel9.0-1 sdb|grep -Ei '(allocation|capacity|physical)' Capacity: 104857600 *Allocation: 104865792* Physical: 104857600 Are these 'allocation' values expected to be equal to each other? Thanks, Zhen Tang

1 0

Re: Hugepages -- "Memory backend 'pc.ram' not found"
by Michal Prívozník 23 Feb '22

23 Feb '22

On 2/21/22 17:12, Charles Polisher wrote: Hey, please the list on CC for benefit of others, e.g. when somebody runs into the same problem they can find the discussion in the archive. > On 2/21/22 01:54, Michal Prívozník wrote: > >> On 2/20/22 04:07, Charles Polisher wrote: >>> Hello, >>> >>> After defining hugepages, as documented at >>> https://libvirt.org/formatdomain.html#memory-backing , >>> when I start the guest, I get a dialogue >>> box that says: >>> >>> Error starting domain: internal error: qemu unexpectedly >>> closed the monitor: 2022-02-20T01:10:36.520955Z >>> qemu-system-x86_64: Memory backend 'pc.ram' not found >>> Traceback (most recent call last): >>> File "/usr/share/virt-manager/virtManager/asyncjob.py", line 65, >>> in cb_wrapper >>> callback(asyncjob, *args, **kwargs) >>> File "/usr/share/virt-manager/virtManager/asyncjob.py", line 101, >>> in tmpcb >>> callback(*args, **kwargs) >>> File >>> "/usr/share/virt-manager/virtManager/object/libvirtobject.py", line 57, >>> in newfn >>> ret = fn(self, *args, **kwargs) >>> File "/usr/share/virt-manager/virtManager/object/domain.py", line >>> 1329, in startup >>> self._backend.create() >>> File "/usr/lib64/python3.9/site-packages/libvirt.py", line 1353, >>> in create >>> raise libvirtError('virDomainCreate() failed' >>> >>> After backing out changes, guest starts normally. >>> I searched online for the error message, but found nothing useful. >>> The hypervisor is running libvirtd (libvirt) 7.8.0 and QEMU emulator >>> version 6.1.0, >>> both build from source. I've got plenty of hugepages available. >>> The domain's XML definition is attached. >> Hey, can you share your domain XML and the generated cmd line? The >> latter should be found in /var/log/libvirt/qemu/$domain.log >> >> Thanks, >> Michal > > Thanks for your reply. As requested, the domain XML: > > <domain type="kvm"> > <name>slacky-0</name> > <uuid>4a67eb39-9b92-8b8a-97ba-7e1250d56b07</uuid> > <title>slacky-0</title> > <description>elided</description> > <memory unit="KiB">4194304</memory> > <currentMemory unit="KiB">4194304</currentMemory> > <memoryBacking> > <hugepages> > <page size="4194304" unit="KiB"/> This does not look correct. This is on x86_64 and there is no such size for hugepages, only 2MiB and 1GiB. > </hugepages> > </memoryBacking> > <vcpu placement="static">2</vcpu> > <os> > <type arch="x86_64" machine="pc-i440fx-5.1">hvm</type> > <bootmenu enable="no"/> > </os> > <features> > <acpi/> > <apic/> > <pae/> > </features> > <cpu mode="custom" match="exact" check="none"> > <model fallback="forbid">kvm64</model> > </cpu> > <clock offset="utc"/> > <on_poweroff>destroy</on_poweroff> > <on_reboot>restart</on_reboot> > <on_crash>restart</on_crash> > <devices> > <emulator>/usr/bin/qemu-system-x86_64</emulator> > <disk type="file" device="cdrom"> > <driver name="qemu" type="raw"/> > <target dev="hdc" bus="ide"/> > <readonly/> > <address type="drive" controller="0" bus="1" target="0" > unit="0"/> > </disk> > <disk type="file" device="disk"> > <driver name="qemu" type="qcow2" cache="writethrough"/> > <source file="/mnt/nvme1/VIRTUAL_MACHINES/slacky-0.qcow2"/> > <target dev="vda" bus="virtio"/> > <boot order="1"/> > <address type="pci" domain="0x0000" bus="0x00" slot="0x09" > function="0x0"/> > </disk> > <controller type="usb" index="0" model="ich9-ehci1"> > <address type="pci" domain="0x0000" bus="0x00" slot="0x05" > function="0x7"/> > </controller> > <controller type="usb" index="0" model="ich9-uhci1"> > <master startport="0"/> > <address type="pci" domain="0x0000" bus="0x00" slot="0x05" > function="0x0" multifunction="on"/> > </controller> > <controller type="usb" index="0" model="ich9-uhci2"> > <master startport="2"/> > <address type="pci" domain="0x0000" bus="0x00" slot="0x05" > function="0x1"/> > </controller> > <controller type="usb" index="0" model="ich9-uhci3"> > <master startport="4"/> > <address type="pci" domain="0x0000" bus="0x00" slot="0x05" > function="0x2"/> > </controller> > <controller type="ide" index="0"> > <address type="pci" domain="0x0000" bus="0x00" slot="0x01" > function="0x1"/> > </controller> > <controller type="virtio-serial" index="0"> > <address type="pci" domain="0x0000" bus="0x00" slot="0x07" > function="0x0"/> > </controller> > <controller type="scsi" index="0" model="virtio-scsi"> > <address type="pci" domain="0x0000" bus="0x00" slot="0x08" > function="0x0"/> > </controller> > <controller type="pci" index="0" model="pci-root"/> > <interface type="network"> > <mac address="52:54:00:c3:93:40"/> > <source network="default"/> > <model type="virtio"/> > <address type="pci" domain="0x0000" bus="0x00" slot="0x03" > function="0x0"/> > </interface> > <serial type="file"> > <source path="/tmp/myconsoleoutput.txt"/> > <target type="isa-serial" port="0"> > <model name="isa-serial"/> > </target> > </serial> > <console type="file"> > <source path="/tmp/myconsoleoutput.txt"/> > <target type="serial" port="0"/> > </console> > <input type="tablet" bus="usb"> > <address type="usb" bus="0" port="1"/> > </input> > <input type="mouse" bus="ps2"/> > <input type="keyboard" bus="ps2"/> > <graphics type="spice" autoport="yes" listen="127.0.0.1"> > <listen type="address" address="127.0.0.1"/> > </graphics> > <sound model="ich9"> > <address type="pci" domain="0x0000" bus="0x00" slot="0x04" > function="0x0"/> > </sound> > <audio id="1" type="spice"/> > <video> > <model type="qxl" ram="65536" vram="65536" vgamem="16384" > heads="1" primary="yes"/> > <address type="pci" domain="0x0000" bus="0x00" slot="0x02" > function="0x0"/> > </video> > <memballoon model="virtio"> > <address type="pci" domain="0x0000" bus="0x00" slot="0x06" > function="0x0"/> > </memballoon> > </devices> > </domain> > > > And the guest log with the generated command line: > > 2022-02-20 01:13:12.985+0000: starting up libvirt version: 7.8.0, > qemu version: 6.1.0, kernel: 5.15.19, hostname: godzilla.peecee3.com > LC_ALL=C \ > PATH=/sbin:/usr/sbin:/bin:/usr/bin \ > HOME=/var/lib/libvirt/qemu/domain-34-slacky-0 \ > XDG_DATA_HOME=/var/lib/libvirt/qemu/domain-34-slacky-0/.local/share \ > XDG_CACHE_HOME=/var/lib/libvirt/qemu/domain-34-slacky-0/.cache \ > XDG_CONFIG_HOME=/var/lib/libvirt/qemu/domain-34-slacky-0/.config \ > /usr/bin/qemu-system-x86_64 \ > -name guest=slacky-0,process=qemu:slacky-0,debug-threads=on \ > -S \ > -object > '{"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/lib/libvirt/qemu/domain-34-slacky-0/master-key.aes"}' > \ > -machine > pc-i440fx-5.1,accel=kvm,usb=off,dump-guest-core=off,memory-backend=pc.ram \ So this instructs qemu to use a memory device wih id='pc.ram' as the default/generic memory for the guest.. > -cpu kvm64 \ > -m 4096 \ > -overcommit mem-lock=off \ .. but we never generate such device. Here libvirt should have generated -object memory-backend-file,id=pc.ram,path=/hugepages/... And I think I know why. Let me post a patch. > -smp 2,sockets=2,cores=1,threads=1 \ > -uuid 4a67eb39-9b92-8b8a-97ba-7e1250d56b07 \ > -no-user-config \ > -nodefaults \ > -chardev socket,id=charmonitor,fd=34,server=on,wait=off \ > -mon chardev=charmonitor,id=monitor,mode=control \ > -rtc base=utc \ > -no-shutdown \ > -boot menu=off,strict=on \ > -device ich9-usb-ehci1,id=usb,bus=pci.0,addr=0x5.0x7 \ > -device > ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pci.0,multifunction=on,addr=0x5 > \ > -device > ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pci.0,addr=0x5.0x1 \ > -device > ich9-usb-uhci3,masterbus=usb.0,firstport=4,bus=pci.0,addr=0x5.0x2 \ > -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x8 \ > -device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x7 \ > -device ide-cd,bus=ide.1,unit=0,id=ide0-1-0 \ > -blockdev > '{"driver":"file","filename":"/mnt/nvme1/VIRTUAL_MACHINES/slacky-0.qcow2","node-name":"libvirt-1-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' > \ > -blockdev > '{"node-name":"libvirt-1-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"qcow2","file":"libvirt-1-storage","backing":null}' > \ > -device > virtio-blk-pci,bus=pci.0,addr=0x9,drive=libvirt-1-format,id=virtio-disk0,bootindex=1,write-cache=off > \ > -netdev tap,fd=58,id=hostnet0,vhost=on,vhostfd=60 \ > -device > virtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:c3:93:40,bus=pci.0,addr=0x3 > \ > -add-fd set=3,fd=62 \ > -chardev file,id=charserial0,path=/dev/fdset/3,append=on \ > -device isa-serial,chardev=charserial0,id=serial0 \ > -device usb-tablet,id=input0,bus=usb.0,port=1 \ > -audiodev id=audio1,driver=spice \ > -spice > port=5901,addr=127.0.0.1,disable-ticketing=on,seamless-migration=on \ > -device > qxl-vga,id=video0,ram_size=67108864,vram_size=67108864,vram64_size_mb=0,vgamem_mb=16,max_outputs=1,bus=pci.0,addr=0x2 > \ > -device ich9-intel-hda,id=sound0,bus=pci.0,addr=0x4 \ > -device > hda-duplex,id=sound0-codec0,bus=sound0.0,cad=0,audiodev=audio1 \ > -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x6 \ > -msg timestamp=on > 2022-02-20T01:13:13.136602Z qemu-system-x86_64: Memory backend > 'pc.ram' not found > 2022-02-20 01:13:13.186+0000: shutting down, reason=failed > > Again, thank you! Michal

2 2

help
by admin＠foundryserver.com 22 Feb '22

22 Feb '22

help

1 0

random but often VMs' - BUG: soft lockup
by lejeczek 22 Feb '22

22 Feb '22

Hi guys I see this often(perhaps once a day) on VMs: ... watchdog: BUG: soft -lockup - CPU#1 stuck for xxXXxxs! [swapper/1:0] At the moment I cannot say I see a pattern - perhaps not spotted one yet - and this can happen to any VM between any one of the three hosts, which hosts are CentOS 9 on AMD Ryzen 5600G hardware. VMs are mostly CentOS 8 but a few Ubuntus too. Anybody would know what that might be, is, a symptom of? But most importantly how to dig in to troubleshoot this?(when this happen then such affected VM I can only hard reset) many thanks, L.

2 1

Hugepages -- "Memory backend 'pc.ram' not found"
by Charles Polisher 21 Feb '22

21 Feb '22

Hello, After defining hugepages, as documented at https://libvirt.org/formatdomain.html#memory-backing , when I start the guest, I get a dialogue box that says: Error starting domain: internal error: qemu unexpectedly closed the monitor: 2022-02-20T01:10:36.520955Z qemu-system-x86_64: Memory backend 'pc.ram' not found Traceback (most recent call last): File "/usr/share/virt-manager/virtManager/asyncjob.py", line 65, in cb_wrapper callback(asyncjob, *args, **kwargs) File "/usr/share/virt-manager/virtManager/asyncjob.py", line 101, in tmpcb callback(*args, **kwargs) File "/usr/share/virt-manager/virtManager/object/libvirtobject.py", line 57, in newfn ret = fn(self, *args, **kwargs) File "/usr/share/virt-manager/virtManager/object/domain.py", line 1329, in startup self._backend.create() File "/usr/lib64/python3.9/site-packages/libvirt.py", line 1353, in create raise libvirtError('virDomainCreate() failed' After backing out changes, guest starts normally. I searched online for the error message, but found nothing useful. The hypervisor is running libvirtd (libvirt) 7.8.0 and QEMU emulator version 6.1.0, both build from source. I've got plenty of hugepages available. The domain's XML definition is attached. Any ideas where to look next? Thanks, -- Charles Polisher

2 1

libvirt-python for alpine linux
by Tom Ammon 20 Feb '22

20 Feb '22

Hi everybody, Is there a libvirt-python package for alpine linux? I'm looking to containerize an app that uses libvirt-python, using alpine linux, but all I found that looked similar to libvirt-python was py-libvirt ( https://pkgs.alpinelinux.org/package/v3.3/main/x86/py-libvirt) and it looks pretty old. Tom -- ----------------------------------------------------------------------------- Tom Ammon M: (737) 400-9042 thomasammon(a)gmail.com -----------------------------------------------------------------------------

2 2

SSH VM from outside, but not from host
by Wolf 16 Feb '22

16 Feb '22

Hi! 1) I have two network ports on my server. - eno1 has the IP: XX1.XX1.XX1.150 - bridge0 has the IP: XX2.XX2.XX2.100 and has the interface member: port eno2. eno2 is not set up with an IP address. 2) The host runs on IP: XX1.XX1.XX1.150 3) A VM uses the bridge: bridge0, and has the IP: XX2.XX2.XX2.100 I have a problem with this setup: I can ssh the VM on XX2.XX2.XX2.100 from outside, but from the host, XX1.XX1.XX1.150, I can't ssh the VM on XX2.XX2.XX2.100. Have I set up this wrong or is it something I can do to solve this? Thanks! Wolf

4 6

Public IP on virtual machine network issue
by Marcin Groszek 15 Feb '22

15 Feb '22

I have been struggling with this for weeks and I was unable to find an answer on line. Perhaps someone here can help me. Oracle linux 8 running virtualization: hardware node has a public IP address on interface bridge0 and physical eno1 is a member of the bridge0 a virtual OS has interface bridged to lan and source is bridge0, Ip address of virtual OS is also a public from same class as the hardware node. I can route in and out of virtual, I can ping from hardware node to virtual and vice versa, so the routing works as it should, sort of. When I try tracepath or traceroute from outside to virtual I get !H on last hup same result when I try to do the same form hardware node to virtual I get !H Also, when I telnet (TCP) to a specific port on virtual where I have a daemon LISTENING OR NOT I get: No route to host. Same experiment works just fine for ssh port. Firewalld is not running, and I just have very basic iptables rules like allowing external address block to ssh to hardware node and to virtual dropping connections from all other sources This issue presented it self when I attempted to setup a galera node on virtual and ports 4567 is responding but 4568 and 4444 are not, but the daemons are running and I can clearly see lsoft showing "LISTENING" I capture the traffic and the tcp as well as udp are getting to the virtual. Is there a preconfigured netfiltering that I am not aware of? What am I missing? -- Best Regards: Marcin Groszek Business Voip Resource. http://www.voipplus.net

4 6

libvirtd daemon missing in LFS
by Sai Kiran Kumar Reddy 15 Feb '22

15 Feb '22

Hi, I am Sai Kiran. I am trying to build libvirt from source on my Linux From Scratch(LFS) system. I have successfully installed libvirt and its dependencies. When I start virt-manager, there is a prompt in GUI saying that "libvirtd service is not installed". I also do not see any libvirtd in my system. I would like to install the libvirtd service(build from source). But I am not able to find the source code for it and also, I am not sure about the build process for the daemon. Could you please help me out here. Thanks in advance for your time and support. -- Regards, Sai Kiran.

3 7

qemu+ssh connections to a remote libvirt fail as ssh banner configured
by Yalan Zhang 14 Feb '22

14 Feb '22

Hi there, I have a system configured with ssh login banner like as below: # cat ~/.bashrc ... echo "=================================================================================" echo "====== This machine is occupied by xxx for testing now. If you are about to use it, contact xxx first ======" echo "=================================================================================" It works as expected that whenever someone logs into this system by ssh, he/she will see this warning message. But it seems such settings will impact a virsh client connection with ssh, when I try to connect the libvirt daemon on this system, it will error out : # virsh -c qemu+ssh://${my_host}/system list --all root@${my_host}'s password: error: failed to connect to the hypervisor error: packet 1027423545 bytes received from server too large, want 33554432 I have searched and found some related explanations[1], and [2] says "The virsh man page doesn't mention ssh, so it sounds like the file /usr/share/doc/libvirt-doc/remote.html shipped with libvirt-doc could use a patch mentioning this." But I can not find anything about this currently on file:///usr/share/doc/libvirt-docs/html/remote.html. Could we have this documented for reference with all the possibilities? Thank you! [1] https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/868753/comments/17 [2] https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/868753/comments/14 ------- Best Regards, Yalan Zhang IRC: yalzhang

4 6

NVMe drive PCI passthrough and suprise hotplug
by Kalra, Ashish 07 Feb '22

07 Feb '22

[AMD Official Use Only] Hi, I am using Fedora 33, with the following KVM, qemu and libvirt versions: QEMU 5.1.0 libvirt 6.6.0 KVM 5.14.18 We have done pass-through of a PCIe NVMe device to the guest running on FC33 using either virt-manager or virsh and then we do the hot-unplug of the device while it is attached to the guest. The device is no longer seen on the guest hardware device list on virt-manager and then we hotplug the device again and we are able to use it on the Host, but when we try to re-attach it to the guest, we get the following error message: Requested operation is not valid, PCI device 0000:c4::00.0 is in use by driver QEMU, Domain fedora 33. So somehow libvirt still thinks the hot-unplugged device is attached. Tracing the flow of hot un-plug event from guest to host : ->Guest pcie hotplug support detected the NVMe driver unplug (from guest kernel logs): pciehp: Slot (0-6): Attention button pressed pciehp: Slot (0-6): Powering off due to to button press. -> Also looks like the guest notified Host/KVM (from host kernel logs): pcieport: 0000:c4:0000.0: pciehp: Slot (208): Card not present -> Correspondingly, vfio-pci module notified Qemu : vfio-pci: 0000:c4:0000.0: Relaying device request to user (#0) -> Then the un-plugged device reset is done. vfio-pci: vfio_bar_restore: reset recovery - restoring BARs pci 0000:c4:00.0: Removing from iommu group 105. -> Next tried to verify if libvirt detected the DELETED_DRIVE event from qemu. Running SystemTap script to capture events between qemu and libvirt : stap examples/systemtap/qemu-monitor.stp When the NVMe drive is attached to VM the following log output is seen from SystemTap: execute "device-add", driver: "vfio-pci", host: "0000:c4:00.0", id: "hostdev0", bus: "pci.7", addr: "0". When we hot-unplug the NVMe drive, the following log output is seen from SystemTap: event: DEVICE_DELETED, device: "hostdev0", path: "/machine/peripheral/hostdev0". So it looks like that qemu sent the "DEVICE_DELTED" event to libvirt, but libvirt has still not removed the attached device from its bookeeping list. I understand there is already a thread from 20202, discussing a similar issue : https://www.spinics.net/linux/fedora/libvirt-users/msg12590.html But I am not sure if there is any fix/support added for this recently. Looking for any feedback related to above and PCI device passthrough and hotplug support. Thanks, Ashish

2 2

udmabuf error with libvirt + QEMU
by M, Shivakumar 01 Feb '22

01 Feb '22

Hi, We are seeing an issue with udambuf, where it says "open /dev/udmabuf: No such file or directory " even if the device exits. This issue particularly we are seeing with libvirt. When we run the QEMU args on the command line, everything works as expected. It seems to be some permission issue when we use the Libvirt, please help us on resolving this. [cid:image001.png@01D817A5.0151F260] Libvirt Version: 6.0.0 Host: Ubuntu 21.04 QEMU commands: qemu-system-x86_64 \ -enable-kvm \ -smp cores=4,threads=2,sockets=1 \ -m 4096 \ -name win-vm-0 \ -cpu host \ -drive id=windows_drive,if=virtio,file=/win10_enterprise.qcow2,format=qcow2,cache=none \ -device vfio-pci,host=0000:00:02.2 \ -device e1000,netdev=net0,mac=00:a1:00:00:00:10 \ -netdev user,id=net0,ipv6=off,hostfwd=tcp::1111-:22,hostfwd=tcp::3389-:3389 \ -monitor tcp:127.0.0.1:11111,server,nowait \ -rtc base=localtime \ -usb \ -device usb-tablet \ -device usb-kbd \ -device usb-mouse \ -device virtio-vga,blob=true \ -display gtk,gl=on \ -object memory-backend-memfd,id=mem1,hugetlb=off,size=4096M \ -machine memory-backend=mem1 Libvirt XML: <?xml version="1.0"?> <domain xmlns:qemu=http://libvirt.org/schemas/domain/qemu/1.0 type="kvm"> <name>win-vm-0</name> <memory unit="KiB">4194304</memory> <currentMemory unit="KiB">4194304</currentMemory> <memoryBacking supported="yes"> <source type="memfd"/> </memoryBacking> <vcpu>6</vcpu> <os> <type arch="x86_64" machine="pc">hvm</type> <boot dev="hd"/> <boot dev="cdrom"/> </os> <features> <acpi/> <apic/> <hyperv> <relaxed state="on"/> <vapic state="on"/> <spinlocks state="on" retries="8191"/> </hyperv> <vmport state="off"/> </features> <cpu mode="host-model"> <model fallback="forbid"/> </cpu> <clock offset="utc"> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/bin/qemu-system-x86_64</emulator> <disk type="file" device="disk"> <driver name="qemu" type="qcow2"/> <source file="/win10_enterprise.qcow2" index="1"/> <backingStore/> <target dev="sda" bus="sata"/> <alias name="sata0-0-0"/> <address type="drive" controller="0" bus="0" target="0" unit="0"/> </disk> <interface type="bridge"> <source bridge="br0"/> <model type="virtio"/> </interface> <serial type="pty"> <target port="0"/> <target type="serial" port="0"> </target> <alias name="serial0"/> </serial> <console type="pty"> <target type="serial" port="0"/> <alias name="serial0"/> </console> <hostdev mode="subsystem" type="pci" managed="yes"> <driver name="vfio"/> <source> <address domain="0x0000" bus="0x00" slot="0x02" function="0x02"/> </source> </hostdev> </devices> <qemu:commandline> <qemu:arg value="-device"/> <qemu:arg value="virtio-vga,blob=true"/> <qemu:arg value="-display"/> <qemu:arg value="gtk,gl=on"/> <qemu:env name="DISPLAY" value=":1.0"/> </qemu:commandline> </domain> Thanks, Shiv

3 3