September 2017 - Devel - libvirt List Archives

[libvirt] [PATCH v2 1/2] conf, docs: Add qcow2 cache configuration support
by Liu Qing 05 Sep '17

05 Sep '17

Random write IOPS will drop dramatically if qcow2 l2 cache could not cover the whole disk. This patch gives libvirt user a chance to adjust the qcow2 cache configuration. Three new qcow2 driver paramters are added. They are l2-cache-size, refcount-cache-size and cache-clean-interval. The following are from qcow2-cache.txt. The amount of virtual disk that can be mapped by the L2 and refcount caches (in bytes) is: disk_size = l2_cache_size * cluster_size / 8 disk_size = refcount_cache_size * cluster_size * 8 / refcount_bits The parameter "cache-clean-interval" defines an interval (in seconds). All cache entries that haven't been accessed during that interval are removed from memory. Signed-off-by: Liu Qing <liuqing(a)huayun.com> --- docs/formatdomain.html.in | 21 +++++++++++ docs/schemas/domaincommon.rng | 24 +++++++++++++ src/conf/domain_conf.c | 30 ++++++++++++++++ src/qemu/qemu_command.c | 6 ++++ src/util/virstoragefile.c | 3 ++ src/util/virstoragefile.h | 4 +++ ...2argv-disk-drive-qcow2-cache-clean-interval.xml | 37 +++++++++++++++++++ ...qemuxml2argv-disk-drive-qcow2-l2-cache-size.xml | 37 +++++++++++++++++++ ...l2argv-disk-drive-qcow2-refcount-cache-size.xml | 37 +++++++++++++++++++ ...mlout-disk-drive-qcow2-cache-clean-interval.xml | 41 ++++++++++++++++++++++ ...muxml2xmlout-disk-drive-qcow2-l2-cache-size.xml | 41 ++++++++++++++++++++++ ...xmlout-disk-drive-qcow2-refcount-cache-size.xml | 41 ++++++++++++++++++++++ tests/qemuxml2xmltest.c | 3 ++ 13 files changed, 325 insertions(+) create mode 100644 tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-cache-clean-interval.xml create mode 100644 tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-l2-cache-size.xml create mode 100644 tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-refcount-cache-size.xml create mode 100644 tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-cache-clean-interval.xml create mode 100644 tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-l2-cache-size.xml create mode 100644 tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-refcount-cache-size.xml diff --git a/docs/formatdomain.html.in b/docs/formatdomain.html.in index 8ca7637..8f093b5 100644 --- a/docs/formatdomain.html.in +++ b/docs/formatdomain.html.in @@ -3035,6 +3035,27 @@ <a href="#elementsVirtio">Virtio-specific options</a> can also be set. (<span class="since">Since 3.5.0</span>) </li> + <li> + The optional <code>l2_cache_size</code> attribute controls how much + memory will be consumed by qcow2 l2 table cache. This option is + only valid when the driver type is qcow2. The default size is 1MB. + <span class='since'>Since 3.7.0</span> + </li> + <li> + The optional <code>refcount_cache_size</code> attribute controls + how much memory will be consumed by qcow2 reference count table + cache. This option is only valid when the driver type is qcow2. + The default size is 256KB. + <span class='since'>Since 3.7.0</span> + </li> + <li> + The optional <code>cache_clean_interval</code> attribute defines + an interval (in seconds). All cache entries that haven't been + accessed during that interval are removed from memory. This option + is only valid when the driver type is qcow2. The defaut value is 0, + which disables this feature. + <span class='since'>Since 3.7.0</span> + </li> </ul> </dd> <dt><code>backenddomain</code></dt> diff --git a/docs/schemas/domaincommon.rng b/docs/schemas/domaincommon.rng index 06c5a91..5545179 100644 --- a/docs/schemas/domaincommon.rng +++ b/docs/schemas/domaincommon.rng @@ -1797,6 +1797,15 @@ <ref name="driverIOThread"/> </optional> <optional> + <ref name="qcow2_l2_cache_size"/> + </optional> + <optional> + <ref name="qcow2_refcount_cache_size"/> + </optional> + <optional> + <ref name="qcow2_cache_clean_interval"/> + </optional> + <optional> <ref name="detect_zeroes"/> </optional> <ref name="virtioOptions"/> @@ -1895,6 +1904,21 @@ </choice> </attribute> </define> + <define name="qcow2_l2_cache_size"> + <attribute name='l2_cache_size'> + <ref name="unsignedInt"/> + </attribute> + </define> + <define name="qcow2_refcount_cache_size"> + <attribute name='refcount_cache_size'> + <ref name="unsignedInt"/> + </attribute> + </define> + <define name="qcow2_cache_clean_interval"> + <attribute name='cache_clean_interval'> + <ref name="unsignedInt"/> + </attribute> + </define> <define name="controller"> <element name="controller"> <optional> diff --git a/src/conf/domain_conf.c b/src/conf/domain_conf.c index f7574d7..f07ab72 100644 --- a/src/conf/domain_conf.c +++ b/src/conf/domain_conf.c @@ -8600,6 +8600,30 @@ virDomainDiskDefDriverParseXML(virDomainDiskDefPtr def, VIR_FREE(tmp); } + if ((tmp = virXMLPropString(cur, "l2_cache_size")) && + (virStrToLong_ui(tmp, NULL, 10, &def->src->l2_cache_size) < 0)) { + virReportError(VIR_ERR_XML_ERROR, + _("Invalid l2_cache_size attribute in disk driver element: %s"), + tmp); + goto cleanup; + } + + if ((tmp = virXMLPropString(cur, "refcount_cache_size")) && + (virStrToLong_ui(tmp, NULL, 10, &def->src->refcount_cache_size) < 0)) { + virReportError(VIR_ERR_XML_ERROR, + _("Invalid refcount_cache_size attribute in disk driver element: %s"), + tmp); + goto cleanup; + } + + if ((tmp = virXMLPropString(cur, "cache_clean_interval")) && + (virStrToLong_ui(tmp, NULL, 10, &def->src->cache_clean_interval) < 0)) { + virReportError(VIR_ERR_XML_ERROR, + _("Invalid cache_clean_interval attribute in disk driver element: %s"), + tmp); + goto cleanup; + } + if ((tmp = virXMLPropString(cur, "detect_zeroes")) && (def->detect_zeroes = virDomainDiskDetectZeroesTypeFromString(tmp)) <= 0) { virReportError(VIR_ERR_CONFIG_UNSUPPORTED, @@ -21897,6 +21921,12 @@ virDomainDiskDefFormat(virBufferPtr buf, virBufferAsprintf(&driverBuf, " iothread='%u'", def->iothread); if (def->detect_zeroes) virBufferAsprintf(&driverBuf, " detect_zeroes='%s'", detect_zeroes); + if (def->src->l2_cache_size > 0) + virBufferAsprintf(&driverBuf, " l2_cache_size='%u'", def->src->l2_cache_size); + if (def->src->refcount_cache_size > 0) + virBufferAsprintf(&driverBuf, " refcount_cache_size='%u'", def->src->refcount_cache_size); + if (def->src->cache_clean_interval > 0) + virBufferAsprintf(&driverBuf, " cache_clean_interval='%u'", def->src->cache_clean_interval); virDomainVirtioOptionsFormat(&driverBuf, def->virtio); diff --git a/src/qemu/qemu_command.c b/src/qemu/qemu_command.c index 9a27987..7996eed 100644 --- a/src/qemu/qemu_command.c +++ b/src/qemu/qemu_command.c @@ -1430,6 +1430,12 @@ qemuBuildDriveSourceStr(virDomainDiskDefPtr disk, qemuformat = "luks"; virBufferAsprintf(buf, "format=%s,", qemuformat); } + if (disk->src->format == VIR_STORAGE_FILE_QCOW2 && disk->src->l2_cache_size > 0) + virBufferAsprintf(buf, "l2-cache-size=%u,", disk->src->l2_cache_size); + if (disk->src->format == VIR_STORAGE_FILE_QCOW2 && disk->src->refcount_cache_size > 0) + virBufferAsprintf(buf, "refcount-cache-size=%u,", disk->src->refcount_cache_size); + if (disk->src->format == VIR_STORAGE_FILE_QCOW2 && disk->src->cache_clean_interval > 0) + virBufferAsprintf(buf, "cache-clean-interval=%u,", disk->src->cache_clean_interval); ret = 0; diff --git a/src/util/virstoragefile.c b/src/util/virstoragefile.c index fbc8245..c685331 100644 --- a/src/util/virstoragefile.c +++ b/src/util/virstoragefile.c @@ -2038,6 +2038,9 @@ virStorageSourceCopy(const virStorageSource *src, ret->physical = src->physical; ret->readonly = src->readonly; ret->shared = src->shared; + ret->l2_cache_size = src->l2_cache_size; + ret->refcount_cache_size = src->refcount_cache_size; + ret->cache_clean_interval = src->cache_clean_interval; /* storage driver metadata are not copied */ ret->drv = NULL; diff --git a/src/util/virstoragefile.h b/src/util/virstoragefile.h index 6c388b1..e7889d9 100644 --- a/src/util/virstoragefile.h +++ b/src/util/virstoragefile.h @@ -280,6 +280,10 @@ struct _virStorageSource { /* metadata that allows identifying given storage source */ char *nodeformat; /* name of the format handler object */ char *nodestorage; /* name of the storage object */ + + unsigned l2_cache_size; /* qcow2 l2 cache size */ + unsigned refcount_cache_size; /* qcow2 reference count table cache size */ + unsigned cache_clean_interval; /* clean unused cache entries interval */ }; diff --git a/tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-cache-clean-interval.xml b/tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-cache-clean-interval.xml new file mode 100644 index 0000000..1c3174d --- /dev/null +++ b/tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-cache-clean-interval.xml @@ -0,0 +1,37 @@ +<domain type='qemu'> + <name>QEMUGuest1</name> + <uuid>c7a5fdbd-edaf-9455-926a-d65c16db1809</uuid> + <memory unit='KiB'>219136</memory> + <currentMemory unit='KiB'>219136</currentMemory> + <vcpu placement='static'>1</vcpu> + <os> + <type arch='i686' machine='pc'>hvm</type> + <boot dev='hd'/> + </os> + <clock offset='utc'/> + <on_poweroff>destroy</on_poweroff> + <on_reboot>restart</on_reboot> + <on_crash>destroy</on_crash> + <devices> + <emulator>/usr/bin/qemu-system-i686</emulator> + <disk type='block' device='disk'> + <driver name='qemu' type='qcow2' cache='none' cache_clean_interval='900'/> + <source dev='/dev/HostVG/QEMUGuest1'/> + <target dev='hda' bus='ide'/> + <address type='drive' controller='0' bus='0' target='0' unit='0'/> + </disk> + <disk type='block' device='cdrom'> + <driver name='qemu' type='raw'/> + <source dev='/dev/HostVG/QEMUGuest2'/> + <target dev='hdc' bus='ide'/> + <readonly/> + <address type='drive' controller='0' bus='1' target='0' unit='0'/> + </disk> + <controller type='usb' index='0'/> + <controller type='ide' index='0'/> + <controller type='pci' index='0' model='pci-root'/> + <input type='mouse' bus='ps2'/> + <input type='keyboard' bus='ps2'/> + <memballoon model='none'/> + </devices> +</domain> diff --git a/tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-l2-cache-size.xml b/tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-l2-cache-size.xml new file mode 100644 index 0000000..ebe4c3c --- /dev/null +++ b/tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-l2-cache-size.xml @@ -0,0 +1,37 @@ +<domain type='qemu'> + <name>QEMUGuest1</name> + <uuid>c7a5fdbd-edaf-9455-926a-d65c16db1809</uuid> + <memory unit='KiB'>219136</memory> + <currentMemory unit='KiB'>219136</currentMemory> + <vcpu placement='static'>1</vcpu> + <os> + <type arch='i686' machine='pc'>hvm</type> + <boot dev='hd'/> + </os> + <clock offset='utc'/> + <on_poweroff>destroy</on_poweroff> + <on_reboot>restart</on_reboot> + <on_crash>destroy</on_crash> + <devices> + <emulator>/usr/bin/qemu-system-i686</emulator> + <disk type='block' device='disk'> + <driver name='qemu' type='qcow2' cache='none' l2_cache_size='2097152'/> + <source dev='/dev/HostVG/QEMUGuest1'/> + <target dev='hda' bus='ide'/> + <address type='drive' controller='0' bus='0' target='0' unit='0'/> + </disk> + <disk type='block' device='cdrom'> + <driver name='qemu' type='raw'/> + <source dev='/dev/HostVG/QEMUGuest2'/> + <target dev='hdc' bus='ide'/> + <readonly/> + <address type='drive' controller='0' bus='1' target='0' unit='0'/> + </disk> + <controller type='usb' index='0'/> + <controller type='ide' index='0'/> + <controller type='pci' index='0' model='pci-root'/> + <input type='mouse' bus='ps2'/> + <input type='keyboard' bus='ps2'/> + <memballoon model='none'/> + </devices> +</domain> diff --git a/tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-refcount-cache-size.xml b/tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-refcount-cache-size.xml new file mode 100644 index 0000000..e8835e2 --- /dev/null +++ b/tests/qemuxml2argvdata/qemuxml2argv-disk-drive-qcow2-refcount-cache-size.xml @@ -0,0 +1,37 @@ +<domain type='qemu'> + <name>QEMUGuest1</name> + <uuid>c7a5fdbd-edaf-9455-926a-d65c16db1809</uuid> + <memory unit='KiB'>219136</memory> + <currentMemory unit='KiB'>219136</currentMemory> + <vcpu placement='static'>1</vcpu> + <os> + <type arch='i686' machine='pc'>hvm</type> + <boot dev='hd'/> + </os> + <clock offset='utc'/> + <on_poweroff>destroy</on_poweroff> + <on_reboot>restart</on_reboot> + <on_crash>destroy</on_crash> + <devices> + <emulator>/usr/bin/qemu-system-i686</emulator> + <disk type='block' device='disk'> + <driver name='qemu' type='qcow2' cache='none' refcount_cache_size='524288'/> + <source dev='/dev/HostVG/QEMUGuest1'/> + <target dev='hda' bus='ide'/> + <address type='drive' controller='0' bus='0' target='0' unit='0'/> + </disk> + <disk type='block' device='cdrom'> + <driver name='qemu' type='raw'/> + <source dev='/dev/HostVG/QEMUGuest2'/> + <target dev='hdc' bus='ide'/> + <readonly/> + <address type='drive' controller='0' bus='1' target='0' unit='0'/> + </disk> + <controller type='usb' index='0'/> + <controller type='ide' index='0'/> + <controller type='pci' index='0' model='pci-root'/> + <input type='mouse' bus='ps2'/> + <input type='keyboard' bus='ps2'/> + <memballoon model='none'/> + </devices> +</domain> diff --git a/tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-cache-clean-interval.xml b/tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-cache-clean-interval.xml new file mode 100644 index 0000000..6c1934f --- /dev/null +++ b/tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-cache-clean-interval.xml @@ -0,0 +1,41 @@ +<domain type='qemu'> + <name>QEMUGuest1</name> + <uuid>c7a5fdbd-edaf-9455-926a-d65c16db1809</uuid> + <memory unit='KiB'>219136</memory> + <currentMemory unit='KiB'>219136</currentMemory> + <vcpu placement='static'>1</vcpu> + <os> + <type arch='i686' machine='pc'>hvm</type> + <boot dev='hd'/> + </os> + <clock offset='utc'/> + <on_poweroff>destroy</on_poweroff> + <on_reboot>restart</on_reboot> + <on_crash>destroy</on_crash> + <devices> + <emulator>/usr/bin/qemu-system-i686</emulator> + <disk type='block' device='disk'> + <driver name='qemu' type='qcow2' cache='none' cache_clean_interval='900'/> + <source dev='/dev/HostVG/QEMUGuest1'/> + <target dev='hda' bus='ide'/> + <address type='drive' controller='0' bus='0' target='0' unit='0'/> + </disk> + <disk type='block' device='cdrom'> + <driver name='qemu' type='raw'/> + <source dev='/dev/HostVG/QEMUGuest2'/> + <target dev='hdc' bus='ide'/> + <readonly/> + <address type='drive' controller='0' bus='1' target='0' unit='0'/> + </disk> + <controller type='usb' index='0'> + <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> + </controller> + <controller type='ide' index='0'> + <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> + </controller> + <controller type='pci' index='0' model='pci-root'/> + <input type='mouse' bus='ps2'/> + <input type='keyboard' bus='ps2'/> + <memballoon model='none'/> + </devices> +</domain> diff --git a/tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-l2-cache-size.xml b/tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-l2-cache-size.xml new file mode 100644 index 0000000..4da0e4d --- /dev/null +++ b/tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-l2-cache-size.xml @@ -0,0 +1,41 @@ +<domain type='qemu'> + <name>QEMUGuest1</name> + <uuid>c7a5fdbd-edaf-9455-926a-d65c16db1809</uuid> + <memory unit='KiB'>219136</memory> + <currentMemory unit='KiB'>219136</currentMemory> + <vcpu placement='static'>1</vcpu> + <os> + <type arch='i686' machine='pc'>hvm</type> + <boot dev='hd'/> + </os> + <clock offset='utc'/> + <on_poweroff>destroy</on_poweroff> + <on_reboot>restart</on_reboot> + <on_crash>destroy</on_crash> + <devices> + <emulator>/usr/bin/qemu-system-i686</emulator> + <disk type='block' device='disk'> + <driver name='qemu' type='qcow2' cache='none' l2_cache_size='2097152'/> + <source dev='/dev/HostVG/QEMUGuest1'/> + <target dev='hda' bus='ide'/> + <address type='drive' controller='0' bus='0' target='0' unit='0'/> + </disk> + <disk type='block' device='cdrom'> + <driver name='qemu' type='raw'/> + <source dev='/dev/HostVG/QEMUGuest2'/> + <target dev='hdc' bus='ide'/> + <readonly/> + <address type='drive' controller='0' bus='1' target='0' unit='0'/> + </disk> + <controller type='usb' index='0'> + <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> + </controller> + <controller type='ide' index='0'> + <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> + </controller> + <controller type='pci' index='0' model='pci-root'/> + <input type='mouse' bus='ps2'/> + <input type='keyboard' bus='ps2'/> + <memballoon model='none'/> + </devices> +</domain> diff --git a/tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-refcount-cache-size.xml b/tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-refcount-cache-size.xml new file mode 100644 index 0000000..bda4574 --- /dev/null +++ b/tests/qemuxml2xmloutdata/qemuxml2xmlout-disk-drive-qcow2-refcount-cache-size.xml @@ -0,0 +1,41 @@ +<domain type='qemu'> + <name>QEMUGuest1</name> + <uuid>c7a5fdbd-edaf-9455-926a-d65c16db1809</uuid> + <memory unit='KiB'>219136</memory> + <currentMemory unit='KiB'>219136</currentMemory> + <vcpu placement='static'>1</vcpu> + <os> + <type arch='i686' machine='pc'>hvm</type> + <boot dev='hd'/> + </os> + <clock offset='utc'/> + <on_poweroff>destroy</on_poweroff> + <on_reboot>restart</on_reboot> + <on_crash>destroy</on_crash> + <devices> + <emulator>/usr/bin/qemu-system-i686</emulator> + <disk type='block' device='disk'> + <driver name='qemu' type='qcow2' cache='none' refcount_cache_size='524288'/> + <source dev='/dev/HostVG/QEMUGuest1'/> + <target dev='hda' bus='ide'/> + <address type='drive' controller='0' bus='0' target='0' unit='0'/> + </disk> + <disk type='block' device='cdrom'> + <driver name='qemu' type='raw'/> + <source dev='/dev/HostVG/QEMUGuest2'/> + <target dev='hdc' bus='ide'/> + <readonly/> + <address type='drive' controller='0' bus='1' target='0' unit='0'/> + </disk> + <controller type='usb' index='0'> + <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> + </controller> + <controller type='ide' index='0'> + <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> + </controller> + <controller type='pci' index='0' model='pci-root'/> + <input type='mouse' bus='ps2'/> + <input type='keyboard' bus='ps2'/> + <memballoon model='none'/> + </devices> +</domain> diff --git a/tests/qemuxml2xmltest.c b/tests/qemuxml2xmltest.c index 311b713..a1af6e5 100644 --- a/tests/qemuxml2xmltest.c +++ b/tests/qemuxml2xmltest.c @@ -461,6 +461,9 @@ mymain(void) DO_TEST("disk-drive-cache-v2-none", NONE); DO_TEST("disk-drive-cache-directsync", NONE); DO_TEST("disk-drive-cache-unsafe", NONE); + DO_TEST("disk-drive-qcow2-l2-cache-size", NONE); + DO_TEST("disk-drive-qcow2-refcount-cache-size", NONE); + DO_TEST("disk-drive-qcow2-cache-clean-interval", NONE); DO_TEST("disk-drive-network-nbd", NONE); DO_TEST("disk-drive-network-nbd-export", NONE); DO_TEST("disk-drive-network-nbd-ipv6", NONE); -- 1.8.3.1

2 1

[libvirt] [PATCH python] Remove unused variables for event callbacks
by Daniel P. Berrange 05 Sep '17

05 Sep '17

Signed-off-by: Daniel P. Berrange <berrange(a)redhat.com> --- libvirt-override.c | 22 ---------------------- 1 file changed, 22 deletions(-) diff --git a/libvirt-override.c b/libvirt-override.c index c04ce2e..a3a0508 100644 --- a/libvirt-override.c +++ b/libvirt-override.c @@ -5182,19 +5182,11 @@ libvirt_virConnectDomainEventDeregister(PyObject *self ATTRIBUTE_UNUSED, * Event Impl *******************************************/ static PyObject *addHandleObj; -static char *addHandleName; static PyObject *updateHandleObj; -static char *updateHandleName; static PyObject *removeHandleObj; -static char *removeHandleName; static PyObject *addTimeoutObj; -static char *addTimeoutName; static PyObject *updateTimeoutObj; -static char *updateTimeoutName; static PyObject *removeTimeoutObj; -static char *removeTimeoutName; - -#define NAME(fn) ( fn ## Name ? fn ## Name : # fn ) static int libvirt_virEventAddHandleFunc(int fd, @@ -5442,12 +5434,6 @@ libvirt_virEventRegisterImpl(PyObject *self ATTRIBUTE_UNUSED, Py_XDECREF(addTimeoutObj); Py_XDECREF(updateTimeoutObj); Py_XDECREF(removeTimeoutObj); - VIR_FREE(addHandleName); - VIR_FREE(updateHandleName); - VIR_FREE(removeHandleName); - VIR_FREE(addTimeoutName); - VIR_FREE(updateTimeoutName); - VIR_FREE(removeTimeoutName); /* Parse and check arguments */ if (!PyArg_ParseTuple(args, (char *) "OOOOOO:virEventRegisterImpl", @@ -5462,14 +5448,6 @@ libvirt_virEventRegisterImpl(PyObject *self ATTRIBUTE_UNUSED, !PyCallable_Check(removeTimeoutObj)) return NULL; - /* Get argument string representations (for error reporting) */ - addHandleName = py_str(addHandleObj); - updateHandleName = py_str(updateHandleObj); - removeHandleName = py_str(removeHandleObj); - addTimeoutName = py_str(addTimeoutObj); - updateTimeoutName = py_str(updateTimeoutObj); - removeTimeoutName = py_str(removeTimeoutObj); - /* Inc refs since we're holding on to these objects until * the next call (if any) to this function. */ -- 2.13.5

2 1

[libvirt] [PATCH python] Report an error if registering an event loop twice
by Daniel P. Berrange 05 Sep '17

05 Sep '17

The C library will now ignore an attempt to register an event loop twice. It is unable to report an error in this case though due to the C API returning 'void'. To improve this we must manually report an error at the python level. Signed-off-by: Daniel P. Berrange <berrange(a)redhat.com> --- libvirt-override.c | 13 ++++++------- 1 file changed, 6 insertions(+), 7 deletions(-) diff --git a/libvirt-override.c b/libvirt-override.c index a3a0508..9eba4ed 100644 --- a/libvirt-override.c +++ b/libvirt-override.c @@ -5427,13 +5427,12 @@ static PyObject * libvirt_virEventRegisterImpl(PyObject *self ATTRIBUTE_UNUSED, PyObject *args) { - /* Unref the previously-registered impl (if any) */ - Py_XDECREF(addHandleObj); - Py_XDECREF(updateHandleObj); - Py_XDECREF(removeHandleObj); - Py_XDECREF(addTimeoutObj); - Py_XDECREF(updateTimeoutObj); - Py_XDECREF(removeTimeoutObj); + if (addHandleObj || updateHandleObj || removeHandleObj || + addTimeoutObj || updateTimeoutObj || removeTimeoutObj) { + PyErr_SetString(PyExc_RuntimeError, + "Event loop is already registered"); + return NULL; + } /* Parse and check arguments */ if (!PyArg_ParseTuple(args, (char *) "OOOOOO:virEventRegisterImpl", -- 2.13.5

2 1

[libvirt] [PATCH] maint: Fix incorrect parenthesis placement causing true/false assignment
by Erik Skultety 05 Sep '17

05 Sep '17

There were a few places in our code where the following pattern in 'if' condition occurred: if ((foo = bar() < 0)) do something; This patch adjusts the conditions to the expected format: if ((foo = bar()) < 0) do something; Resolves: https://bugzilla.redhat.com/show_bug.cgi?id=1488192 Signed-off-by: Erik Skultety <eskultet(a)redhat.com> --- This can be especially "fun" if you try to assign multiple RNG devices to a domain and then try to hot-unplug any of them but the first. Anyhow I used the regex below to find these, I haven't spent much time tuning in, so in case you can come up with a better one that yields more results like these I'm all ears :). [[:alnum:]_]+ = [[:print:]]+[^)]) < 0)) daemon/admin.c | 2 +- src/locking/lock_daemon.c | 2 +- src/locking/lock_driver_sanlock.c | 2 +- src/qemu/qemu_hotplug.c | 2 +- tests/virnettlshelpers.c | 2 +- 5 files changed, 5 insertions(+), 5 deletions(-) diff --git a/daemon/admin.c b/daemon/admin.c index c5678bb99..baf310c7b 100644 --- a/daemon/admin.c +++ b/daemon/admin.c @@ -446,7 +446,7 @@ adminDispatchConnectGetLoggingOutputs(virNetServerPtr server ATTRIBUTE_UNUSED, char *outputs = NULL; int noutputs = 0; - if ((noutputs = adminConnectGetLoggingOutputs(&outputs, args->flags) < 0)) { + if ((noutputs = adminConnectGetLoggingOutputs(&outputs, args->flags)) < 0) { virNetMessageSaveError(rerr); return -1; } diff --git a/src/locking/lock_daemon.c b/src/locking/lock_daemon.c index 6fbbf4b3d..fe3eaf903 100644 --- a/src/locking/lock_daemon.c +++ b/src/locking/lock_daemon.c @@ -1310,7 +1310,7 @@ int main(int argc, char **argv) { } srv = virNetDaemonGetServer(lockDaemon->dmn, "virtlockd"); - if ((rv = virLockDaemonSetupNetworkingSystemD(srv) < 0)) { + if ((rv = virLockDaemonSetupNetworkingSystemD(srv)) < 0) { ret = VIR_LOCK_DAEMON_ERR_NETWORK; goto cleanup; } diff --git a/src/locking/lock_driver_sanlock.c b/src/locking/lock_driver_sanlock.c index b5e69c472..7513df4d7 100644 --- a/src/locking/lock_driver_sanlock.c +++ b/src/locking/lock_driver_sanlock.c @@ -313,7 +313,7 @@ virLockManagerSanlockSetupLockspace(virLockManagerSanlockDriverPtr driver) goto error_unlink; } - if ((rv = virLockManagerSanlockInitLockspace(driver, &ls) < 0)) { + if ((rv = virLockManagerSanlockInitLockspace(driver, &ls)) < 0) { char *err = NULL; if (virLockManagerSanlockError(rv, &err)) { virReportError(VIR_ERR_INTERNAL_ERROR, diff --git a/src/qemu/qemu_hotplug.c b/src/qemu/qemu_hotplug.c index 9611df517..b365078ec 100644 --- a/src/qemu/qemu_hotplug.c +++ b/src/qemu/qemu_hotplug.c @@ -5270,7 +5270,7 @@ qemuDomainDetachRNGDevice(virQEMUDriverPtr driver, int rc; int ret = -1; - if ((idx = virDomainRNGFind(vm->def, rng) < 0)) { + if ((idx = virDomainRNGFind(vm->def, rng)) < 0) { virReportError(VIR_ERR_OPERATION_INVALID, "%s", _("device not present in domain configuration")); return -1; diff --git a/tests/virnettlshelpers.c b/tests/virnettlshelpers.c index b735c4e2f..f66205ef7 100644 --- a/tests/virnettlshelpers.c +++ b/tests/virnettlshelpers.c @@ -424,7 +424,7 @@ void testTLSWriteCertChain(const char *filename, for (i = 0; i < ncerts; i++) { size = sizeof(buffer); - if ((err = gnutls_x509_crt_export(certs[i], GNUTLS_X509_FMT_PEM, buffer, &size) < 0)) { + if ((err = gnutls_x509_crt_export(certs[i], GNUTLS_X509_FMT_PEM, buffer, &size)) < 0) { VIR_WARN("Failed to export certificate %s", gnutls_strerror(err)); unlink(filename); abort(); -- 2.13.3

3 3

[libvirt] [PATCH] Makefile.nonreentrant: Rebuild against Fedora 26
by Andrea Bolognani 04 Sep '17

04 Sep '17

According to the comments in the file and the git history, the list of forbidden symbols was originally built against Fedora 9 in 2009 (!) and pretty much never refreshed afterwards. Signed-off-by: Andrea Bolognani <abologna(a)redhat.com> --- I didn't put too much thought into this, but the results looks sane enough as we are only *adding* to the list. Makefile.nonreentrant | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/Makefile.nonreentrant b/Makefile.nonreentrant index 5cc64c0d5..a83298322 100644 --- a/Makefile.nonreentrant +++ b/Makefile.nonreentrant @@ -15,9 +15,9 @@ ## <http://www.gnu.org/licenses/>. # -# Generated by running the following on Fedora 9: +# Generated by running the following on Fedora 26: # -# nm -D --defined-only /lib/libc.so.6 \ +# nm -D --defined-only /lib64/libc.so.6 \ # | grep '_r$' \ # | awk '{print $3}' \ # | grep -v __ \ @@ -43,6 +43,7 @@ NON_REENTRANT += ether_ntoa NON_REENTRANT += fcvt NON_REENTRANT += fgetgrent NON_REENTRANT += fgetpwent +NON_REENTRANT += fgetsgent NON_REENTRANT += fgetspent NON_REENTRANT += getaliasbyname NON_REENTRANT += getaliasent @@ -72,6 +73,8 @@ NON_REENTRANT += getrpcent NON_REENTRANT += getservbyname NON_REENTRANT += getservbyport NON_REENTRANT += getservent +NON_REENTRANT += getsgent +NON_REENTRANT += getsgnam NON_REENTRANT += getspent NON_REENTRANT += getspnam NON_REENTRANT += getutent @@ -95,6 +98,7 @@ NON_REENTRANT += random NON_REENTRANT += rand NON_REENTRANT += seed48 NON_REENTRANT += setstate +NON_REENTRANT += sgetsgent NON_REENTRANT += sgetspent NON_REENTRANT += srand48 NON_REENTRANT += srandom -- 2.13.5

2 1

[libvirt] [PATCH] docs: Fix typo deamon -> daemon
by Andrea Bolognani 04 Sep '17

04 Sep '17

Suggested-by: Martin Kletzander <mkletzan(a)redhat.com> Signed-off-by: Andrea Bolognani <abologna(a)redhat.com> --- I would push this as trivial, but I feel like someone might not be okay with touching the release notes for libvirt versions that are already out. I think in this case it's perfectly justified, but if you disagree this is your chance to point it out :) docs/internals/rpc.html.in | 2 +- docs/news.xml | 2 +- src/libxl/libxl.conf | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/internals/rpc.html.in b/docs/internals/rpc.html.in index 45c07cb61..fca9cb784 100644 --- a/docs/internals/rpc.html.in +++ b/docs/internals/rpc.html.in @@ -534,7 +534,7 @@ C <-- |32| 8 | 1 | 3 | 1 | 1 | 0 | .o.oOo | <-- S (reply) <dt><code>virNetDaemonPtr</code> (virnetdaemon.h)</dt> <dd>The virNetDaemon APIs are used to manage a daemon process. A - deamon is a process that might expose one or more servers. It + daemon is a process that might expose one or more servers. It handles most process-related details, network-related should be part of the underlying server. </dd> diff --git a/docs/news.xml b/docs/news.xml index 452711717..483f9d6d1 100644 --- a/docs/news.xml +++ b/docs/news.xml @@ -195,7 +195,7 @@ Fix --verbose option for all daemons </summary> <description> - Since v3.0.0, the option had been ignored by all libvirt deamons + Since v3.0.0, the option had been ignored by all libvirt daemons (<code>libvirtd</code>, <code>virtlogd</code> and <code>virtlockd</code>); it's now working as intended once again. </description> diff --git a/src/libxl/libxl.conf b/src/libxl/libxl.conf index 5c9bdaac2..264af7cf9 100644 --- a/src/libxl/libxl.conf +++ b/src/libxl/libxl.conf @@ -28,7 +28,7 @@ # is sent to the daemon after keepalive_interval seconds of inactivity # to check if the daemon is still responding; keepalive_count is a # maximum number of keepalive messages that are allowed to be sent to -# the deamon without getting any response before the connection is +# the daemon without getting any response before the connection is # considered broken. In other words, the connection is automatically # closed after approximately keepalive_interval * (keepalive_count + 1) # seconds since the last message was received from the daemon. If -- 2.13.5

2 1

[libvirt] [PATCH v2 0/2] dac: relabel spice rendernode
by Cole Robinson 04 Sep '17

04 Sep '17

This fixes the last issue preventing qemu:///system spice GL from working out of the box: chown'ing the rendernode path so we have permissions to open it. We skip this if mount namespaces are disabled, so the chown'ing won't interfere with other rendernode users on the host. https://bugzilla.redhat.com/show_bug.cgi?id=1460804 v2: Add the MOUNT_NAMESPACE handling Drop DAC restore of rendernode Cole Robinson (2): security: add MANAGER_MOUNT_NAMESPACE flag security: dac: relabel spice rendernode src/qemu/qemu_driver.c | 2 ++ src/security/security_dac.c | 68 +++++++++++++++++++++++++++++++++++++++++ src/security/security_dac.h | 3 ++ src/security/security_manager.c | 4 ++- src/security/security_manager.h | 1 + 5 files changed, 77 insertions(+), 1 deletion(-) -- 2.13.5

2 3

[libvirt] [PATCH] Add libxslt as build requires for mingw RPMs
by Daniel P. Berrange 04 Sep '17

04 Sep '17

The libxslt package is needed since: commit 94d2d6429d686c5af95115d09c01f3c6bd5ea7c6 Author: Daniel P. Berrange <berrange(a)redhat.com> Date: Wed Jul 26 17:40:44 2017 +0100 docs: make xmllint & xsltproc compulsory The native RPM had it already, but mingw build was missing it. Signed-off-by: Daniel P. Berrange <berrange(a)redhat.com> --- Pushed as a build breaker & trivial fix mingw-libvirt.spec.in | 1 + 1 file changed, 1 insertion(+) diff --git a/mingw-libvirt.spec.in b/mingw-libvirt.spec.in index 6b0ce0bf5..dc18d055b 100644 --- a/mingw-libvirt.spec.in +++ b/mingw-libvirt.spec.in @@ -60,6 +60,7 @@ BuildRequires: mingw64-dlfcn BuildRequires: pkgconfig # Need native version for msgfmt BuildRequires: gettext +BuildRequires: libxslt BuildRequires: python %if 0%{?fedora} >= 27 BuildRequires: perl-interpreter -- 2.13.5

1 0

[libvirt] Availability of libvirt 3.7.0
by Daniel Veillard 04 Sep '17

04 Sep '17

I pushed the final version earlier today, it is tagged in git and I made available sigend tarball and rpms at the usual place: ftp://libvirt.org/libvirt/ I also rolled out the 3.7.0 version of libvirt-python bindings, those are available from: ftp://libvirt.org/libvirt/python/ This is a balanced release with new features available from virsh command line and API, as well a general improvements and a fair amount of bug fixes: * New features - qemu: Add managedsave-edit commands Using managedsave-dumpxml, managedsave-define and managedsave-edit commands, now we can dump and edit the XML configuration of domain which has managedsave image. - qemu: Add migrate-getmaxdowntime command Currently, the maximum tolerable downtime for a domain being migrated is write-only from libvirt, via migrate-setmaxdowntime. This implements a complementary migrate-getmaxdowntime command - bhyve: Support autoport for VNC ports It's no longer necessary to explicitly specify VNC port for the bhyve guests. With the autoport feature it will be allocated automatically. Please refer to the bhyve driver documentation for examples. - qemu: Added support for setting heads of virtio GPU - qemu: Added support to configure reconnect timeout for chardev devices When you have a TCP or UNIX chardev device and it's connected somewhere you can configure reconnect timeout if the connection is closed. * Improvements - qemu: Report a clear error when dropping a VM during startup "Failed to load config for domain 'DOMNAME'" is now reported if a VM config can't be parsed for some reason, and thus provides a clear indication for users (and devs). - apparmor: Update for QEMU 2.10 compatibility Starting with QEMU 2.10, disk images and NVRAM files get automatically locked to prevent them from being corrupted; however, file locking needs to be explicitly allowed through virt-aa-helper or AppArmor will reject the requests and the guest will not be able to run. - virsh: List Unix sockets in 'domdisplay' output VNC and SPICE graphics can use Unix sockets instead of TCP/IP sockets as connection endpoints, but such a configuration was not handled correctly by virsh domdisplay, causing the respective endpoints to be missing from the output. - qemu: Don't check whether offline migration is safe Since offline migration only copies the guest definition to the destination host, data corruption is not a concern and the operation can always be performed safely. - virt-host-validate: Fix IOMMU detection on ppc64 * Bug fixes - qemu: Better support for international domain names (with wide characters) There were some issues with multi-byte domains getting lost on daemon restart due to truncation, so the code now handles multi-byte names a bit better. - qemu: Support long domain names with namespaces Domains with extremely long names would fail to start due to temporary namespace paths being created with the whole name. The path is now generated with shortened name instead. - qemu: Tolerate missing emulator binary during libvirtd restart For some time libvirt required qemu capabilities being present when parsing VM configs during startup. As a side effect VM configs would fail to parse and thus vanish, if the emulator binary would be uninstalled or broken. Libvirt now tolerates when capabilities are missing during startup. - qemu: Prevent pSeries guests from disappearing in some situations pSeries guest would disappear if any of the host devices they were configured to use was not available during libvirtd startup, which could easily happen for SR-IOV Virtual Functions. This scenario is now handled correctly. - qemu: Honor <on_reboot/> setting The setting was accepted by the parser, but not actually implemented. - Fix --verbose option for all daemons Since v3.0.0, the option had been ignored by all libvirt deamons (libvirtd, virtlogd and virtlockd); it's now working as intended once again. Thanks everybody for your help with this release, be it with code, patches, review, documentation, but reports, etc ... Enjoy this release ! Daniel -- Daniel Veillard | Red Hat Developers Tools http://developer.redhat.com/ veillard(a)redhat.com | libxml Gnome XML XSLT toolkit http://xmlsoft.org/ http://veillard.com/ | virtualization library http://libvirt.org/

1 0

[libvirt] [PATCH v2] vmx: Expose VMware Managed Object Reference (moref) in
by Richard W.M. Jones 04 Sep '17

04 Sep '17

v1 -> v2: - Implemented all the review recommendations. I didn't add a test. Is it even possible to test this without a VMware server? I did however test it myself with a real server and it works as expected for me. Rich.

2 2