- Users - libvirt List Archives

[libvirt-users] questions about disk auth element for Backing Chain
by Meina Li 03 Jan '18

03 Jan '18

Hi, I am a libvirt qe, I am testing the function about the new location of disk auth element (as sub-element of the source element) in Backing Chain Management. And I have a questions: When all the backing chain are iscsi network disk type(no matter if the authentication is exist), start the guest , it will only has the top level disk in xml and there are no other backingStore in it. The test step is below. So can this function support all backing chain with network disk type actually, or only use network authentication as the base image for backing chain of file disk type? Can you help reviewing it? Thanks very much in advance! Test step: 1. iSCSI server: o- iscsi ............................................................................................................ [Targets: 2] | o- iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.9cba196611e6 ....................................................... [TPGs: 1] | | o- tpg1 ..................................................................................... [gen-acls, tpg-auth, 1-way auth] | | o- acls .......................................................................................................... [ACLs: 0] | | o- luns .......................................................................................................... [LUNs: 4] | | | o- lun0 ................................................................ [fileio/file1 (/tmp/lun1.img) (default_tg_pt_gp)] | | o- portals .................................................................................................... [Portals: 1] | | o- 0.0.0.0:3260 ..................................................................................................... [OK] | o- iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.a8d92ebb4ece ....................................................... [TPGs: 1] | o- tpg1 .................................................................................................. [gen-acls, no-auth] | o- acls .......................................................................................................... [ACLs: 0] | o- luns .......................................................................................................... [LUNs: 3] | | o- lun0 ................................................................ [fileio/file3 (/tmp/lun3.img) (default_tg_pt_gp)] | o- portals .................................................................................................... [Portals: 1] | o- 0.0.0.0:3260 ..................................................................................................... [OK] 2. Set iscsi secret. # cat iscsi-secret.xml <secret ephemeral='no' private='yes'> <description>iSCSI secret</description> <usage type='iscsi'> <target>libvirtiscsi</target> </usage> </secret> # virsh secret-define iscsi-secret.xml Secret 47bd2f3e-023f-44ba-85a3-e8fa7f16ff23 created # MYSECRET=`printf %s "redhat" | base64` # virsh secret-set-value 47bd2f3e-023f-44ba-85a3-e8fa7f16ff23 $MYSECRET Secret value set 3. Create backing chain. # qemu-img create -f qcow2 -b iscsi:// redhat:redhat@10.66.7.27:3260/iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.9cba196611e6/0 iscsi:// 10.66.7.27:3260/iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.a8d92ebb4ece/0 -o backing_fmt=qcow2 4. Start guest. # qemu-img info iscsi:// 10.66.7.27:3260/iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.a8d92ebb4ece/0 --backing-chainimage: json:{"driver": "qcow2", "file": {"lun": "0", "portal": "10.66.7.27:3260", "driver": "iscsi", "transport": "tcp", "target": "iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.a8d92ebb4ece"}} file format: qcow2 virtual size: 5.0G (5368709120 bytes) disk size: unavailable cluster_size: 65536 backing file: iscsi:// redhat:redhat@10.66.7.27:3260/iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.9cba196611e6/0 backing file format: qcow2 Format specific information: compat: 1.1 lazy refcounts: false refcount bits: 16 corrupt: false image: json:{"driver": "qcow2", "file": {"lun": "0", "portal": " 10.66.7.27:3260", "driver": "iscsi", "transport": "tcp", "user": "redhat", "password": "redhat", "target": "iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.9cba196611e6"}} file format: qcow2 virtual size: 5.0G (5368709120 bytes) disk size: unavailable cluster_size: 65536 Format specific information: compat: 1.1 lazy refcounts: false refcount bits: 16 corrupt: false # virsh dumpxml rhel7 | grep disk -A 9 ... <disk type='network' device='disk'> <driver name='qemu' type='qcow2'/> <source protocol='iscsi' name='iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.a8d92ebb4ece/0'> <host name='10.66.7.27' port='3260'/> </source> <target dev='vdb' bus='virtio'/> <alias name='virtio-disk1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/> </disk> ... Best Regards Meina Li

1 0

[libvirt-users] [BUG] Not exiting media forced a promptly close of libvirt 3.10
by Holger Schranz 28 Dec '17

28 Dec '17

Hello, In the .xml file I use a media which is no longer available. In the past, I got the information media not available and the creation of the VM was stopped - O.k. behavior. Since 3.10 the libvirtd stopped promptly and all open consoles windows and the virt-manager closed promptly. For diagnose: etcsvms1:/kvm/CS8200/M5 # coredumpctl TIME PID UID GID SIG PRESENT EXE Fri 2017-12-22 08:16:35 CET 7056 0 0 11 * /usr/local/sbin/libvirtd Fri 2017-12-22 08:19:46 CET 10611 0 0 11 * /usr/local/sbin/libvirtd Fri 2017-12-22 09:28:48 CET 10728 0 0 11 * /usr/local/sbin/libvirtd etcsvms1:/kvm/CS8200/M5 # coredumpctl info libvirtd . . . PID: 10728 (libvirtd) UID: 0 (root) GID: 0 (root) Signal: 11 (SEGV) Timestamp: Fri 2017-12-22 09:28:39 CET (15min ago) Command Line: /usr/local/sbin/libvirtd -d Executable: /usr/local/sbin/libvirtd Control Group: / Slice: -.slice Boot ID: 01603763bc784c7380e310d5eea124d6 Machine ID: 89c660865c00403a9bacef32b6828556 Hostname: etcsvms1 Coredump: /var/lib/systemd/coredump/core.libvirtd.0.01603763bc784c7380e310 Message: Process 10728 (libvirtd) of user 0 dumped core. etcsvms1:/kvm/CS8200/M5 # coredumpctl dump libvirtd PID: 10728 (libvirtd) UID: 0 (root) GID: 0 (root) Signal: 11 (SEGV) Timestamp: Fri 2017-12-22 09:28:39 CET (16min ago) Command Line: /usr/local/sbin/libvirtd -d Executable: /usr/local/sbin/libvirtd Control Group: / Slice: -.slice Boot ID: 01603763bc784c7380e310d5eea124d6 Machine ID: 89c660865c00403a9bacef32b6828556 Hostname: etcsvms1 Coredump: /var/lib/systemd/coredump/core.libvirtd.0.01603763bc784c7380e310d5eea124d6.10728.1513931319000000.xz Message: Process 10728 (libvirtd) of user 0 dumped core. Refusing to dump core to tty. etcsvms1:/kvm/CS8200/M5 # coredumpctl gdb libvirtd PID: 10728 (libvirtd) UID: 0 (root) GID: 0 (root) Signal: 11 (SEGV) Timestamp: Fri 2017-12-22 09:28:39 CET (18min ago) Command Line: /usr/local/sbin/libvirtd -d Executable: /usr/local/sbin/libvirtd Control Group: / Slice: -.slice Boot ID: 01603763bc784c7380e310d5eea124d6 Machine ID: 89c660865c00403a9bacef32b6828556 Hostname: etcsvms1 Coredump: /var/lib/systemd/coredump/core.libvirtd.0.01603763bc784c7380e310d5eea124d6.10728.1513931319000000.xz Message: Process 10728 (libvirtd) of user 0 dumped core. GNU gdb (GDB; openSUSE Leap 42.3) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-suse-linux". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://bugs.opensuse.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/local/sbin/libvirtd...done. [New LWP 10729] [New LWP 10731] [New LWP 10733] [New LWP 10735] [New LWP 10732] [New LWP 10739] [New LWP 10730] [New LWP 10741] [New LWP 10743] [New LWP 10734] [New LWP 10736] [New LWP 11276] [New LWP 10737] [New LWP 10738] [New LWP 10728] [New LWP 10740] [New LWP 10751] [New LWP 10742] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/usr/local/sbin/libvirtd -d'. Program terminated with signal SIGSEGV, Segmentation fault. #0 virStorageFileReportBrokenChain (errcode=2, src=src@entry=0x7f0d4004ac40, parent=0x7f0d4004ac40) at storage/storage_source.c:422 422 unsigned int access_user = src->drv->uid; [Current thread is 1 (Thread 0x7f0d525ab700 (LWP 10729))] Missing separate debuginfos, use: zypper install device-mapper-debuginfo-1.02.97-77.1.x86_64 glibc-debuginfo-2.22-8.4.x86_64 krb5-debuginfo-1.12.5-12.1.x86_64 libapparmor1-debuginfo-2.10.3-16.1.x86_64 libavahi-client3-debuginfo-0.6.32-3.5.x86_64 libavahi-common3-debuginfo-0.6.32-3.5.x86_64 libblkid1-debuginfo-2.29.2-5.1.x86_64 libcap2-debuginfo-2.22-18.16.x86_64 libcom_err2-debuginfo-1.42.11-15.1.x86_64 libcurl4-debuginfo-7.37.0-23.1.x86_64 libdbus-1-3-debuginfo-1.8.22-5.1.x86_64 libffi4-debuginfo-5.3.1+r233831-10.1.x86_64 libgmp10-debuginfo-5.1.3-7.15.x86_64 libgnutls28-debuginfo-3.3.27-1.5.x86_64 libhogweed2-debuginfo-2.7.1-12.1.x86_64 libidn11-debuginfo-1.28-8.3.x86_64 libkeyutils1-debuginfo-1.5.9-7.13.x86_64 libldap-2_4-2-debuginfo-2.4.44-18.1.x86_64 liblzma5-debuginfo-5.2.2-3.15.x86_64 libnettle4-debuginfo-2.7.1-12.1.x86_64 libnl1-debuginfo-1.1.4-6.13.x86_64 libopenssl1_0_0-debuginfo-1.0.2j-16.1.x86_64 libp11-kit0-debuginfo-0.20.7-1.2.x86_64 libpciaccess0-debuginfo-0.13.4-4.3.x86_64 libpcre1-debuginfo-8.39-11.1.x86_64 libsasl2-3-debuginfo-2.1.26-14.1.x86_64 libselinux1-debuginfo-2.5-4.17.x86_64 libssh2-1-debuginfo-1.4.3-18.3.x86_64 libtasn1-6-debuginfo-4.9-1.2.x86_64 libudev1-debuginfo-228-38.1.x86_64 libuuid1-debuginfo-2.29.2-5.1.x86_64 libxml2-2-debuginfo-2.9.4-12.1.x86_64 libyajl2-debuginfo-2.0.1-21.3.x86_64 libz1-debuginfo-1.2.8-13.15.x86_64 (gdb) Best regards Holger --- Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft. https://www.avast.com/antivirus

4 7

[libvirt-users] libvirt-lxc nested containers
by ooth suresh 13 Dec '17

13 Dec '17

Hi, I am using libvirt to launch lxc containers. I would like to know if I can spawn nested container using libvirt-lxc. Is it supported ? Can some please shed some light on this ? Any pointers will be very helpful. Thanks Suresh S ‌

1 0

[libvirt-users] Inter Shared Memory ( Ivshmem ) : Cannot Bind
by Rogue S.T 12 Dec '17

12 Dec '17

Hello, friends. I encounter a problem when i use ivshmem with my guest, my ivshmem server is not start, and output a error : Example code, do not use in production ,cannot bind. Detail distribution: Today, I know ivshmem from a topic "QEMU version 2.10.93 User Documentation", Ivshmem: it can create a shared memory that guest device use, so we can use this memory to do something ourselves. First, I create host memory backend: -object memory-backend-file,size=1M,share,mem-path=/dev/shm/ivshmem,id=hostmem Twice, Bind a shared memory device to my guest: -device ivshmem-plain,memdev=hostmem Then I boot ivshmem servi ivshmem-server -p /var/run/ivshmem-server.pid -S /tmp/ivshmem_socket -M ivshmem -m /dev/shm -l 1M -n 2 Next time i get this error: *** Example code, do not use in production *** cannot bind And i search the problem on google, but nothing to get, hope you can help me solve it. following message is my host environment: host: ubuntu 1604 qemu: version 2.10.90 (v2.11.0-rc0-dirty) libvirt: libvirtd (libvirt) 3.9.0 guest: window 7 professor Refer: https://qemu.weilnetz.de/doc/qemu-doc.html#Inter_002dVM-Shared-Memory-device (topic qemu documention) https://helpmanual.io/help/ivshmem-server/ ( how to use ivshmem-server )

2 1

[libvirt-users] libvirt authentication
by Anastasiya Ruzhanskaya 11 Dec '17

11 Dec '17

Hello, I am currently trying to install certificates for tls. By this time I have got some questions: 1) Is documentation in the web docs up-to-date regarding tls server, client, ca certificates? (actually I have some problems, but maybe this is due to smth has changed in certtools and was not updated in docs, perhaps some more fields are needed now). 2) there is a error in virt-pki-validate : when determining whether host name matches CN name you assume, that CN is standing in the end. So I get an error: The server certificate does not seem to match the host name hostname: "barni" Server certificate CN: "barni,O=libvirt.org" CN field is standing at the beginning of line. Seems that these are the appropriate lines in code: 258 S_HOST=`"$CERTOOL" -i --infile "$LIBVIRT/servercert.pem" | grep Subject: | sed 's+.*CN=$[a-zA-Z\. _-]*$+\1+'` 259 if test "$S_HOST" != "`hostname -s`" && test "$S_HOST" != "`hostname`"

1 1

[libvirt-users] libvirt error messages
by Anastasiya Ruzhanskaya 10 Dec '17

10 Dec '17

Hello, I am experimenting with libvirt for my diploma. I set up an environment, where I can stop, resend, generate messages for libvirt. I am capable also standing between client and server and analyze the number of current procedure and decide what to do next ( I mean rpc procedure). So, for example I want to always drop creating snapshots and send an error to client with my custom message (NOT custom error type, but exactly custom message, I don't want to modify any libvirt code on client and adding my errors). I am operating with bare tcp traffic, so I can easily read everything in the middle. So, I noticed one error for libvirt snapshots: 'internal error: unexpected domain snapshot snapshot1 already exists' and started sending it every time I see procedure : REMOTE_PROC_DOMAIN_SNAPSHOT_CREATE_XML I thought, that this is possible to insert custom message here, but this is not true. When I change the length of the message on one symbol - it is still correct, on two -also , on three symbols - I get an error that the size of the payload is incorrect. Some other errors when I insert a message of random length. What is strange, that if I insert 'xxxxxxxxxxxxx...' message , which has the same length as 'internal error: unexpected domain snapshot snapshot1 already exists' - everything is parsed fine. So, how does this stuff work? Are there anywhere predefined lengths for error messages and checks against them, or are there checks against exact error strings? How all this stuff is regulated? I know now, that I can pad my message with ...say, space symbols and it will be ok, but I want to know how error parsing works in all cases. I have looked through files, where an overall structure and logic of errors is described but didn't find any helpful information. And I don't a good way to debug libvirt to see, where this happens.

2 1

[libvirt-users] public IP for VM
by scar 07 Dec '17

07 Dec '17

I can't seem to figure out how to setup a public IP for the VM so we could use it as a second public webserver. The host machine runs our primary webserver with CentOS 6.9 and one public ipv4 address configured on physical interface eth0. Now i have configured a new bridge interface br0: DEVICE=br0 TYPE=Bridge BOOTPROTO=static The IP settings are for a second public ipv4 address in the same network. Now i setup the VM to use br0 for the NIC and set the same IP settings inside the VM... but it doesn't work. The VM can't resolve any hosts, and if i try to ssh to the second public IP, it just sends me to the host machine instead of the VM.

5 4

[libvirt-users] public IP for VM
by Chandler 07 Dec '17

07 Dec '17

I can't seem to figure out how to setup a public IP for the VM so we could use it as a second public webserver. The host machine runs our primary webserver with CentOS 6.9 and one public ipv4 address configured on physical interface eth0. Now i have configured a new bridge interface br0: DEVICE=br0 TYPE=Bridge BOOTPROTO=static The IP settings are for a second public ipv4 address in the same network. Now i setup the VM to use br0 for the NIC and set the same IP settings inside the VM... but it doesn't work. The VM can't resolve any hosts, and if i try to ssh to the second public IP, it just sends me to the host machine instead of the VM. I read the Bridged Networking section but it seems to want to set br0 to the public IP and not use eth0. I want to use two public IP's over the same shared phys interface, eth0 with our first IP and br0 with the second IP for the VM... or another similar configuration that will have the same effect. Thanks

2 1

[libvirt-users] How to use virtio-gpu to output
by Rogue S.T 06 Dec '17

06 Dec '17

Hello, lads, owing to i study video card on my guest recently. So i have a notion that whether we can get video with virtio-vga or not. It's seem that we are using a graphics card truth. Maybe we can finish? And if this is not likelihood? Tell me why please. Thanks following is my host system environment: host: ubuntu 1604 qemu: 2.11 libvirt: 3.9 kernel: 4.14 guest: window 7 professor

1 0

[libvirt-users] problem when use tls to connect libvirt
by Yalan Zhang 06 Dec '17

06 Dec '17

Hi guys, I met a problem when I use tls to connect libvirt. When I set the CN in client.info, server.info as hostname(FDQN), the tls check will fail with ip; and vice versa, when set CN as ip address, the tls check will fail with hostname. Only use what we set in can succeed. If this is expected? or I there was some issue in my env. or setup steps? 1. set tls env with hostname, then it will fail to check with ip # virsh -c qemu+tls://192.168.122.4/system 2017-12-06 13:24:52.346+0000: 3954: info : libvirt version: x.x.x, package: 4.el7 (Red Hat, Inc. <http://bugzilla.redhat.com/bugzilla>, 2017-11-30-07:57:27, x.x.x.redhat.com) 2017-12-06 13:24:52.346+0000: 3954: info : hostname: work.englab.cn 2017-12-06 13:24:52.346+0000: 3954: warning : virNetTLSContextCheckCertificate:1125 : Certificate check failed Certificate [session] owner does not match the hostname 192.168.122.4 error: failed to connect to the hypervisor error: authentication failed: Failed to verify peer's certificate 2. use the hostname as what we set can succeed. # virsh -c qemu+tls://test.englab.cn/system Welcome to virsh, the virtualization interactive terminal. Type: 'help' for help with commands 'quit' to quit virsh # # ping test.englab.cn PING test.englab.cn (192.168.122.4) 56(84) bytes of data. 64 bytes from test.englab.cn (192.168.122.4): icmp_seq=1 ttl=64 time=0.235 ms 64 bytes from test.englab.cn (192.168.122.4): icmp_seq=2 ttl=64 time=0.204 ms ... ------- Best Regards, Yalan Zhang

2 1

[libvirt-users] Libvirt checkout graphics card
by Rogue S.T 06 Dec '17

06 Dec '17

Hello, everybody!My guest has two graphics card when it is running, one is GTX960, and other is video card that is created by qemu.But my guest use video card default, and my screen is not light. I try checkout graphics card with vnc or spice, But it is suspend.Could you help me? And may i checkout card in my host system with command? Because my connection with vnc or spice is not stable.This is my vga card message: Bus 0, device 7, function 0: VGA controller: PCI device 1234:1111 BAR0: 32 bit prefetchable memory at 0xf2000000 [0xf2ffffff]. BAR2: 32 bit memory at 0xfe09e000 [0xfe09efff]. BAR6: 32 bit memory at 0xffffffffffffffff [0x0000fffe]. id "video0" Bus 0, device 8, function 0: VGA controller: PCI device 10de:1401 IRQ 11. BAR0: 32 bit memory at 0xfd000000 [0xfdffffff]. BAR1: 64 bit prefetchable memory at 0xe0000000 [0xefffffff]. BAR3: 64 bit prefetchable memory at 0xf0000000 [0xf1ffffff]. BAR5: I/O at 0xc000 [0xc07f]. BAR6: 32 bit memory at 0xffffffffffffffff [0x0003fffe]. id "" And following message is my envireoment: host: ubuntu 1604 guest: window 7 professor qemu: 2.11.0-rc0 seabiois: 2.10.7 (qemu set) libvirt: 3.9

1 0

[libvirt-users] Guest Reboot After Plug HDMI
by Lying 04 Dec '17

04 Dec '17

Hello, Everybody. I encounter a problem when i using my guest. I booting my guest without HDMI primarily, Then i add it, but my guest is be rebooted. To know what cause it, i do it again, especially i check my guest is running normal or not with "ping" before plugging, that's well. What i was suffer? can you help me solve it? Following message is detailed!!! Guest: window 7 profession Linux: Ubuntu 1604 Qemu:1 v2.11.0-rc0 Libvirt: 3.9 method of booting: virsh start myGuest1 method of plug HDMI: virsh qemu-monitor-command myGuest1 --hmp 'device_add driver=vfio-pci,host=01:00.0,xvga=on,multifunction=yes' phenomenon: after plugging, my Guest is failed to check with "ping", for a while, my display is light and load windows. expect: my guest is running when i plug HDMI, it seem that hot add a device.

3 2

[libvirt-users] vga passthroufh fail
by Lying 28 Nov '17

28 Nov '17

Hello, I encounter a problem, my display is not light when guest running. But it's successful that i check guest with command "ping". Following message is my xml and refer topic from https://libvirt.org/formatdomain.html#elementsHostDev: <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio' /> <source> <address domain='0x0000' bus='0x06' slot='0x02' function='0x0'/> </source> </hostdev>

1 0

[libvirt-users] Export Video on Graphics Card
by Lying 21 Nov '17

21 Nov '17

I have two graphics card on my machine And i want to export my video on one card when VM switched on What should i do?

1 0

[libvirt-users] virtlock - a VM goes read-only
by Branimir Pejakovic 20 Nov '17

20 Nov '17

Dear colleagues, I am facing a problem that has been troubling me for last week and a half. Please if you are able to help or offer some guidance. I have a non-prod POC environment with 2 CentOS7 fully updated hypervisors and an NFS filer that serves as a VM image storage. The overall environment works exceptionally well. However, starting a few weeks ago I have been trying to implement virtlock in order to prevent a VM running on 2 hypervisors at the same time. Here is the description how the environment looks like in terms of virtlock configuration on both hypervisors: -- Content of /etc/libvirt/qemu.conf -- lock_manager = "lockd" Only the above line is uncommented for direct locking. # libvirtd --version; python -c "import platform; print(platform.platform())"; virtlockd -V libvirtd (libvirt) 3.2.0 Linux-3.10.0-693.2.2.el7.x86_64-x86_64-with-centos-7.4.1708-Core virtlockd (libvirt) 3.2.0 # getenforce Permissive Here is the issue: h1 # virsh list Id Name State ---------------------------------------------------- 1 test09 running h1 # virsh domblklist test09 Target Source ------------------------------------------------ vda /storage_nfs/images_001/test09.qcow2 h1 # h2 # virsh list Id Name State ---------------------------------------------------- h2 # virsh list --all | grep test09 - test09 shut off h2 # virsh start test09 error: Failed to start domain test09 error: resource busy: Lockspace resource '/storage_nfs/images_001/test09.qcow2' is locked h2 # virsh list Id Name State ---------------------------------------------------- h2 # Before I start test09 I open a console to the guest and observe what is going on in it. Once I try to start test09 (and get a message about locked resource) on h2 hypervisor, I can see the following messages in the console and the vm goes to ro mode: on test09's console: [ 567.394148] blk_update_request: I/O error, dev vda, sector 13296056 [ 567.395883] blk_update_request: I/O error, dev vda, sector 13296056 [ 572.871905] blk_update_request: I/O error, dev vda, sector 8654040 [ 572.872627] Aborting journal on device vda1-8. [ 572.873978] blk_update_request: I/O error, dev vda, sector 8652800 [ 572.874707] Buffer I/O error on dev vda1, logical block 1081344, lost sync page write [ 572.875472] blk_update_request: I/O error, dev vda, sector 2048 [ 572.876009] Buffer I/O error on dev vda1, logical block 0, lost sync page write [ 572.876727] EXT4-fs error (device vda1): ext4_journal_check_start:56: Detected aborted journal[ 572.878061] JBD2: Error -5 detected when updating journal superblock for vda1-8. [ 572.878807] EXT4-fs (vda1): Remounting filesystem read-only [ 572.879311] EXT4-fs (vda1): previous I/O error to superblock detected [ 572.880937] blk_update_request: I/O error, dev vda, sector 2048 [ 572.881538] Buffer I/O error on dev vda1, logical block 0, lost sync page write I also observe the guests'log: -- /var/log/libvirt/qemu/test09.log -- block I/O error in device 'drive-virtio-disk0': Permission denied (13) block I/O error in device 'drive-virtio-disk0': Permission denied (13) block I/O error in device 'drive-virtio-disk0': Permission denied (13) block I/O error in device 'drive-virtio-disk0': Permission denied (13) block I/O error in device 'drive-virtio-disk0': Permission denied (13) block I/O error in device 'drive-virtio-disk0': Permission denied (13) block I/O error in device 'drive-virtio-disk0': Permission denied (13) If it helps, here is the disk portion of an XML file: <disk type='file' device='disk'> <driver name='qemu' type='qcow2' cache='none'/> <source file='/storage_nfs/images_001/test09.qcow2'/> <backingStore/> <target dev='vda' bus='virtio'/> <alias name='virtio-disk0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </disk> I usually do implement SELinux on a hypervisor to isolate guests even further but this time I set it to permissive mode just to rule out SELinux factor. The same thing happens when SELinux is in enforcing mode (virt_use_nfs is set to on in that case) and audit2why doesn't report any anomalies when parsing audit logs. I have tried to use indirect locking via the same filer and with a separated export for the hashes by removing the comment in /etc/libvirt/qemu-lockd.conf for the following line: file_lockspace_dir = "/var/lib/libvirt/lockd/files" In this case the hashes are normally created on the NFS export mounted under /var/lib/libvirt/lockd/files. I have also tried playing with both QCOW2 and raw disk images for VMs (and even with XFS/ext4 based guests) but the outcome is always the same. I have a couple of KVM books - consulted them on this topic, consulted Red Hat and SUSE docs but pretty much the configuration instructions are, naturally, the same. I saw that some colleagues posted a few emails (ie https://www.redhat.com/archives/libvirt-users/2015-September/msg00004.html) to the list related to virtlock but it seems that it is not the same issue. I have also, as a last resort, completely disabled SELinux, rebooted both hypervisors, created a new vm, repeated all the steps listed above but with the same results. Now, I am pretty sure that I am missing something simple here since this is a standard feature and should work out of the box if set correctly but so far I cannot see what I am missing. I would really appreciate any tip/help. Thank you very much!! Regards, Branimir

2 2

[libvirt-users] Does libvirt-sanlock support network disk?
by Han Han 20 Nov '17

20 Nov '17

Hello, As we know, libvirt sanlock support file type storage. I wonder *if it supports network storage.* I tried *iSCSI*, but found it didn't generate any resource file: Version: *qemu-2.10 libvirt-3.9 sanlock-3.5* 1. Set configuration: qemu.conf: *lock_manager = "sanlock"* qemu-sanlock.conf: *auto_disk_leases = 1disk_lease_dir = "/var/lib/libvirt/sanlock"host_id = 1user = "sanlock"group = "sanlock"* # systemctl restart sanlock # systemctl restart libvirtd 2. Start a VM with iSCSI disk and check *resource file* VM disk xml: <disk type='network' device='disk'> <driver name='qemu' type='raw'/> <source protocol='iscsi' name='iqn.2003-01.org.linux-iscsi.localhost.x8664:sn.cb4bfb00df2f/0'> <host name='xx.xx.xx.xx' port='3260'/> </source> <target dev='vda' bus='virtio'/> <alias name='virtio-disk0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/> </disk> Start VM: # virsh start iscsi Domain iscsi started Check resource file: # ls /var/lib/libvirt/sanlock __LIBVIRT__DISKS__ No resource file generated. So, does libvirt sanlock only support file or block type storage? -- Han Han Quality Engineer Redhat. Email: hhan(a)redhat.com Phone: +861065339333

2 2

[libvirt-users] Urgent: virsh - change-media run into a promptly close of libvirt
by Holger Schranz 15 Nov '17

15 Nov '17

Hello, I use the virsh change-media command and since the combination of: etcsvms5:/kvm/CS8400/M1 # virsh version Compiled against library: libvirt 3.9.0 Using library: libvirt 3.9.0 Using API: QEMU 3.9.0 Running hypervisor: QEMU 2.10.1 etcsvms5:/kvm/CS8400/M1 # I got the following problem: ---------------------- etcsvms5:/kvm/CS8400/M1 # virsh change-media S5VCS84M1-VLP0 hdc --eject Successfully ejected media. etcsvms5:/kvm/CS8400/M1 # virsh change-media S5VCS84M1-VLP0 hdc /home/kvm/etcsdvmb/Medien/V7.0A/CS_licenses/key-cd_VCS85FTSVTL.iso --insert error: Disconnected from qemu:///system due to end of file error: Failed to complete action insert on media error: End of file while reading data: Input/output error ---------------------- journalctl -b | less shows the following: Nov 14 10:11:32 etcsvms5 kernel: libvirtd[10178]: segfault at 10 ip 00007f49ff969170 sp 00007f4a069cb940 error 4 in libvirt_driver_qemu.so[7f49ff8d9000+172000] Nov 14 10:11:37 etcsvms5 systemd-coredump[42152]: Process 10177 (libvirtd) of user 0 dumped core. ---------------------- At the end all open consoles of all virtual machines closed and the virt-manager also. A restart of the libvirtd is possible but not helpful The virsh change-media commands are in procedure andused since a long time. I need the change-media function at the installation of our test systems. Therefor I need an urgent help please Best regards Holger --- Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft. https://www.avast.com/antivirus

3 7

[libvirt-users] Issues on hibernated domains
by Francesc Guasch 15 Nov '17

15 Nov '17

Hello. I am using libvirt and KVM for a VDI project. It works fine, great job ! I have only a small issue that bothers some users from time to time. This is libvirt-bin 2.5.0-3ubuntu5.5. When restoring a saved domain that has been many hours or days down, the network address may be taken by some other virtual machine. Then both are in conflict. I found this patch: https://www.redhat.com/archives/libvir-list/2016-October/msg00561.html And I tried setting it in my host but it discards silently my settings after doing virsh net-edit. So It may not be apllied to the 2.5.0 release ? That's what I tried: <dhcp> <leasetime>24h</leasetime> <range start='192.168.122.2' end='192.168.122.254'/> </dhcp> I also tried leasetime -1 with the same results. I also found about adding infinite to the dhcp-range at /var/lib/libvirt/dnsmasq/default.conf. But this file has a comment about it shouldn't be edited and it should be done with net-edit. But I don't know how to add this tag to the network. dhcp-range=192.168.122.2,192.168.122.254,infinite Any hints ? Thank you for your time. -- Francesc Guasch ETSETB - UPC

1 0

[libvirt-users] dramatic performance slowdown due to THP allocation failure with full pagecache
by Blair Bethwaite 15 Nov '17

15 Nov '17

Hi all, This is not really a libvirt issue but I'm hoping some of the smart folks here will know more about this problem... We have noticed when running some HPC applications on our OpenStack (libvirt+KVM) cloud that the same application occasionally performs much worse (4-5x slowdown) than normal. We can reproduce this quite easily by filling pagecache (i.e. dd-ing a single large file to /dev/null) before running the application. The problem seems to be that the kernel is not freeing (or has some trouble freeing) the non-dirty and (presumably immediately) reclaimable pagecache in order to allocate THPs for the application. This behaviour is also observable on regular bare-metal, but the slowdown is only 10-20% there - the nested paging of the guest really makes THP allocation important there (1). Both current CentOS and Ubuntu guests have the issue. Some more environmental context: the VMs are tuned (CPU pinning, NUMA topology, hugepage backing), so we normally see no difference between host and guest performance. After talking to many other colleagues in the HPC space it seems common that people setup their batch schedulers to put drop_caches between jobs, which can help to workaround this and other similar issues, but no-one has been able to explain why this is happening. Hopefully someone who knows about the guts of the Linux MM can shed some light...? (1) a related and possibly dumb question: in the case of a high-performance KVM where the guest is hugepage backed and pinned in host memory anyway, why do we still have a table based resolution for guest physical to host virtual address translation - couldn't this just be done by offset? -- Cheers, ~Blairo

2 5

[libvirt-users] Help：Can libvirt restore several xen snapshots more faster at same time?
by Chenjia (C) 14 Nov '17

14 Nov '17

Dear libvirt expert, we find a blocker issue in our project. Would you please offer us some feedback? Our project have a requirement: restore as much as xen snapshot at same time. we have done the following test(our environment is cpu E52620, 256G memory, SSD hard disk. The xen snapshot is Win7 OS with 1G memory): 1) Save 40 xen snapshots to disk, then restore these snapshot at sametime, we found the restore speed is too slow, and the bottleneck is the IO speed. 2) we save all the 40 xen snapshot to ramdisk, then we got a good performance, but the space is too big, about 40G, it is too expensive . Our question is : 1) each our xen snapshot is almost same except IP address(Win7 OS with 1G memory), does there have some way to reduce the 40 snapshots space? (we find the ‘virsh resotre’ cmd have an argument ‘�xml’ , but it seems not work in source code) 2) Do you have some suggestion to improve the performance of restore as much as xen snapshot at same time? Best regards, wish your reply.

1 0

[libvirt-users] KVM guest incorrect CPU frequency
by xmbbb 13 Nov '17

13 Nov '17

Hello, I am facing an issue where the detected CPU frequencies in KVM guests are incorrect. I am using the new Core i9 7900x with base clock 3.3GHz with "host-passthrough". Both Win10 and Linux guests incorrectly detect 3.45GHz for some reason. The workaround I have found is to temporarily switch to use HPET clocksource in the HOST before starting the VM. This makes the VMs correctly detect a 3.3GHz CPU. Then I can safely switch back to TSC in the VM HOST. This mostly does not impact much for day to day use. The only reproducible bug I can find with an incorrect CPU frequency is playing Bink videos that come with PC games. If I play any Bink video cut scene from the 2013 Tomb Raider game with the incorrect CPU frequency, the video plays a little slower than intended which results in audio cut out once in a while so that the video can "catch up" to the audio. Anyone having experiences with similar issues?

1 0

[libvirt-users] how to add mount options for root filesystem inside lxc container
by mxs kolo 13 Nov '17

13 Nov '17

Hi all We use libvirt 3.0.0 + lxc, disk for container described with <filesystem/> tag, example: <filesystem type='block' accessmode='passthrough'> <source dev='/dev/data/lvm-part1'/> <target dir='/'/> </filesystem> Now we start use ssd disk and think how to provide additional options for mount root FS in container: "discard" and "nobarrier" options for XFS. All level below XFS configured for support trim command ("options raid0 devices_discard_performance=Y" and "issue_discards = 1") I try set options inside container in /etc/fstab, it's not worked: /dev/root / rootfs discard,nobarrier,defaults 0 0 or /dev/root / rootfs discard,nobarrier 0 0 or /dev/root / rootfs remount,discard,nobarrier,defaults 0 0 or /dev/root / rootfs remount,discard,nobarrier 0 0 I found 2 solutions: 1) use 2 lvm partitions - one for base OS system, and second - for data. Second lvs attach as block device /dev/vdX inside container. Now we can mount /dev/vd? with desirable options inside container 2) more tricky variant - before container start, mount her root filesystem on hardware node with desirable options. Then after container started, her filesystem would be mounted with same options as on hardware node. But probably exists another way ? Has <filesystem/> support for mount options ? b.r. Maxim Kozin

1 0

[libvirt-users] using LVM thin pool LVs as a storage for libvirt guest
by Jan Hutař 07 Nov '17

07 Nov '17

Hello, as usual, I'm few years behind trends so I have learned about LVM thin volumes recently and I especially like that your volumes can be "sparse" - that you can have 1TB thin volume on 250GB VG/thin pool. Is it somehow possible to use that with libvirt? I have found this post from 2014: https://www.redhat.com/archives/libvirt-users/2014-August/msg00010.html which says you should be able to create "sparse" volume with `virsh vol-create ...` or that libvirt should be able to see thin volumes you create yourself, but neither of that works for me (libvirt-3.2.1-6.fc26.x86_64). This way I try to create new: # vgs storage VG #PV #LV #SN Attr VSize VFree storage 1 1 0 wz--n- 267.93g 0 # lvs storage -a LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert [lvol0_pmspare] storage ewi------- 68.00m lvol1 storage twi-aotz-- 267.80g 0.00 0.44 [lvol1_tdata] storage Twi-ao---- 267.80g [lvol1_tmeta] storage ewi-ao---- 68.00m # virsh pool-dumpxml storage <pool type='logical'> <name>storage</name> <uuid>f523aed2-a7e4-4dc2-88db-0193a7337704</uuid> <capacity unit='bytes'>287687311360</capacity> <allocation unit='bytes'>287687311360</allocation> <available unit='bytes'>0</available> <source> <device path='/dev/nvme0n1p3'/> <name>storage</name> <format type='lvm2'/> </source> <target> <path>/dev/storage</path> </target> </pool> # cat /tmp/big.xml <volume> <name>big</name> <capacity>1073741824</capacity> <allocation>1048576</allocation> <target> <path>/dev/storage/big</path> </target> </volume> # virsh vol-create storage /tmp/big.xml error: Failed to create vol from /tmp/big.xml error: internal error: Child process (/usr/sbin/lvcreate --name big -L 1024K --type snapshot --virtualsize 1048576K storage) unexpected exit status 5: Volume group "storage" has insufficient free space (0 extents): 1 required. When I create thin volume manually, I do not see it: # lvcreate -n big -V 500G --thinpool storage/lvol1 Using default stripesize 64.00 KiB. WARNING: Sum of all thin volume sizes (500.00 GiB) exceeds the size of thin pool storage/lvol1 and the size of whole volume group (267.93 GiB)! For thin pool auto extension activation/thin_pool_autoextend_threshold should be below 100. Logical volume "big" created. # lvs storage -a LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert big storage Vwi-a-tz-- 500.00g lvol1 0.00 [lvol0_pmspare] storage ewi------- 68.00m lvol1 storage twi-aotz-- 267.80g 0.00 0.45 [lvol1_tdata] storage Twi-ao---- 267.80g [lvol1_tmeta] storage ewi-ao---- 68.00m # virsh vol-list storage Name Path ------------------------------------------------------------------------------ Do I understand the concept incorrectly, or is there something else to configure? At the end I want to get max IO performance with possibility to "overcommit disk space". I know I can use storage "dir", but thought there might be something faster? Thank you very much for a response, Jan -- Jan Hutar Systems Management QA jhutar(a)redhat.com Red Hat, Inc.

3 4

[libvirt-users] this function is not supported by the connection driver: virInterfaceDefineXML
by netsurfed 07 Nov '17

07 Nov '17

Hi all: I'm facing problems trying to define a bridge on Ubuntu 16.04, using libvirt 3.4.0. When I try to do: root@ubuntu-180:/tmp# virsh iface-define iface-testbr1.xml I get the following error: error: Failed to define interface from iface-testbr1.xml error: this function is not supported by the connection driver: virInterfaceDefineXML What can i do to make this function works normally? THX. The xml file as: <interface type='bridge' name='testbr1'> <mtu size='1500'/> <bridge stp='on' delay='1500'> <interface type='ethernet' name='enp9s0'> <link speed='1000' state='up'/> <mac address='0c:c4:7a:c1:63:17'/> </interface> </bridge> </interface> root@ubuntu-180:/tmp# uname -a Linux ubuntu-180 4.4.0-62-generic #83-Ubuntu SMP Wed Jan 18 14:10:15 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

2 1

Re: [libvirt-users] Live Migration Issue
by Hans Knecht 07 Nov '17

07 Nov '17

Sorry, ctrl entered. I'm hoping someone here can help me figure out what's going on here. I've got two CentOS 7 hosts with shared storage that I'm trying to do live migrations between and I'm running into an error with VMs that were originally created on a CentOS 6 host and then moved the CentOS 7 hosts. The CentOS 6 VM runs fine on the host, and can do non-live migrations without any issues, however when attempting to live migrate the VM it fails. The VM itself is CentOS 7. Live migration does work when using VMs created using CentOS 7. Error message: "libvirtd virKeepAliveTimerInternal connection closed due to keep alive timeout. Cannot acquire state change lock (held by remoteDispatchDomainMigratePrepare3params)" Surrounding error messages here: Origin Host: https://pastebin.com/fLN6DRiq Recipient Host: https://pastebin.com/xR6mnaW2 The command being run is: Virsh --connect qemu:///system migrate --live vmname qemu+SSH://host2/system Firewall is turned off, SELinux is turned off, CentOS 7 CPUs are identical, both hosts fully updated. I've tried: Converting the VM from QCOW2 to Raw Converting the VM from QCOW2 to QCOW2 to try to get it to regenerate the XML/inject CentOS 7 Drivers Installed new drivers Updated all the packages in the VM. Removed all the Devices from the VM, except the HDDs. Hans Knecht - DevOps Network Administrator Kinsale Insurance Company I 2221 Edward Holland Drive I Suite 600 I Richmond, VA 23230 (804) 289-1300 x5102 office I (804) 673-5697 fax I <mailto:hans.knecht@kinsaleins.com> hans.knecht(a)kinsaleins.com I www.kinsaleins.com From: Hans Knecht [mailto:hans.knecht@kinsaleins.com] Sent: Monday, November 06, 2017 8:38 AM To: 'libvirt-users(a)redhat.com' <libvirt-users(a)redhat.com> Subject: Live Migration Issue I'm hoping someone here can help me figure out what's going on here. I've got two CentOS 7 hosts with shared storage that I'm trying to do live migrations between and I'm running into an error with VMs that were originally created on a CentOS 6 host and then moved the CentOS 7 hosts. The CentOS 6 VM runs fine on the host, and can do non-live migrations without any issues, however when attempting to live migrate the VM it fails with the following error message: Hans Knecht - DevOps Network Administrator Kinsale Insurance Company I 2221 Edward Holland Drive I Suite 600 I Richmond, VA 23230 (804) 289-1300 x5102 office I (804) 673-5697 fax I <mailto:hans.knecht@kinsaleins.com> hans.knecht(a)kinsaleins.com I www.kinsaleins.com <http://www.kinsaleins.com/> This communication constitutes an electronic communication within the meaning of the Electronic Communications Privacy Act, 19 USC 2510, and its disclosure is strictly limited to the recipient intended by the sender of this message. This communication may contain confidential and privileged material for the sole use of the intended recipient and the disclosure to anyone other than the intended recipient does not constitute a loss of the confidential or privileged nature of the communication. If you are not the intended recipient, please contact the sender by return electronic mail and delete all copies of this communication. Please check for any defects or viruses before opening or using any attachments. There is no warranty that this e-mail is virus free or without error. No Kinsale Company is liable if an attachment is altered without its written consent. Thank you.

2 1