Re: [libvirt] Release of libvirt-2.3.0

We are a little late but that allowed us to catch a regression before it impacted the release :) I have tagged the release in git, pushed signed tarball and rpms to the usual place: ftp://libvirt.org/libvirt/ I also pushed the associated python bindings release available at: ftp://libvirt.org/libvirt/python/

This is a release of moderate size, around 250 commits, with a balance of features bugs fixes and improvements: Features: - Improvements on CPU models (Jiri Denemark) - More performance metrics and events (Qiaowei Ren, John Ferlan) Documentation: - docs: correct version requirements for <kvm><hidden='on'/></kvm> (Laine Stump) - doc: fix note about Xen credit scheduler (Jim Fehlig) - Fix various code comment typos (Nitesh Konkar) - cpu: Document missing parameters for cpuCompare* (Jiri Denemark) - libvirt-nodedev.c:fix a typo (Nitesh Konkar) - libvirt-admin.c:fix a typo (Nitesh Konkar) - driver.c:fix a typo (Nitesh Konkar) - domain_conf.c:fix the comment. (Nitesh Konkar) - domain_conf.c:fix a typo (Nitesh Konkar) - domain_conf.c:fix a typo (Nitesh Konkar) - stream.c: fix a typo (Nitesh Konkar) - config-post.h:fix a typo (Nitesh Konkar) - virsh: man: Do not document our old deprecated nodedev-dettach command (Erik Skultety) - qemu_process: fix a typo (Chen Hanxiao) - docs: expand docs on user x509 cert locations (Daniel P. Berrange) - virt-admin: Fix some English grammar in the manpage (Erik Skultety) - virt-admin: Document srv-list command in virt-admin's man page (Erik Skultety) - docs: Add libvirt-go Go bindings to binding page (Roman Mohr) Portability: - mingw: Package cputypes.rng for mingw32 too (Jiri Denemark) - mingw: Package cputypes.rng (Jiri Denemark) - Add missing 'extern' for VIR_EXPORT_VAR macro (Daniel P. Berrange) - Make sure sys/types.h is included after sys/sysmacros.h (Michal Privoznik) Bug Fixes: - qemu: vcpu: Clear vcpu order information rather than making it invalid (Peter Krempa) - qemu: Fix coldplug of vcpus (Peter Krempa) - qemu: process: Enforce 'vcpu' order range to <1,maxvcpus> (Peter Krempa) - qemu: process: Fix off-by-one in vcpu order duplicate error message (Peter Krempa) - sanlock: Properly init io_timeout (Michal Privoznik) - m4: Check for sanlock_write_lockspace (Michal Privoznik) - qemu: Only use memory-backend-file with NUMA if needed (Martin Kletzander) - vsh: Write out history on "quit" or "exit" in interactive mode (John Ferlan) - libxl: fix param assignment in domainGetSchedulerParameters (Jim Fehlig) - qemu: Fix crash in qemucapsprobe (Jiri Denemark) - qemuDomainUpdateDeviceConfig: Allow full disk update (Michal Privoznik) - libxl: find virDomainObj in libxlDomainShutdownThread (Jim Fehlig) - qemu: Update guest CPU def in live XML (Jiri Denemark) - cpu: Set nfeatures_max correctly in x86Decode (Jiri Denemark) - cpu: Drop false support for ARM cpu-model (Jiri Denemark) - migration: Document we don't copy storage during offline migration (Michal Privoznik) - qemu: driver: Don't return automatic NUMA emulator pinning data for persistentDef (Peter Krempa) - qemu: driver: Don't return automatic NUMA vCPU pinning data for persistentDef (Peter Krempa) - qemuDomainOpenGraphics: Start job early (Jiri Denemark) - virtlogd: Don't stop or restart along with libvirtd (Andrea Bolognani) - tests: fix use of fixedcontent variable (Laine Stump) - qemuBuildMemoryBackendStr: Don't crash if no hugetlbfs is mounted (Michal Privoznik) - qemu: map "virtio" video model to "virt" machtype correctly (arm/aarch64) (Laszlo Ersek) - util: Expose virHostCPUStatsAssign on non-Linux (Martin Kletzander) - qemu: domain: Don't infer vcpu state (Peter Krempa) - virDomainGetBlockJobInfo: Fix corner case when qemu reports no info (Michal Privoznik) - tests: use a fixed chardev TLS path (Daniel P. Berrange) - numa: Rename virNumaGetHostNodeset and make it return only nodes with memory (Peter Krempa) - configure: Check for major() more strictly (Michal Privoznik) - tests: fix incorrect status handling by virsh-self-test (Erik Skultety) - conf: allow hotplugging "legacy PCI" device to manually addressed PCIe slot (Laine Stump) - qemu: fix improper initialization of cgroupControllers bitmap (Laine Stump) - audit: Audit information about shmem devices (Martin Kletzander) - storage: Need to properly read the crypt offset value (John Ferlan) - log: Fix reporting OOM error incorrectly when defining a logging filter (Nikolay Shirokovskiy) - qemu: Don't use query-migrate on destination (Jiri Denemark) - util: Quiet the logging if perf file doesn't exist (John Ferlan) - qemu: hotplug: Don't wait if cdrom tray is opened forcibly (Peter Krempa) - qemu: Remove stale transient def when migration fails (Jiri Denemark) - security: Fixing wrong label in virt-aa-helper.c. (Julio Faracco) - Avoid segfault in virt-aa-helper when handling read-only filesystems (Rufo Dogav) - storage: Delete extra wrap after vol-resize error (Yanqiu Zhang) - qemu: process: Fix start with unpluggable vcpus with NUMA pinning (Peter Krempa) - virt-admin: Output srv-clients-set data as unsigned int rather than signed (Erik Skultety) - util: fix crash in virClassIsDerivedFrom for CloseCallbacks objects (Maxim Nestratov) - util: hostcpu: improve CPU freq code for FreeBSD (Roman Bogorodskiy) - util: storage: Properly set protocol type when parsing gluster json string (Peter Krempa) - conf: Fix initialization value of 'multi' in PCI address (Xian Han Yu) Improvements: - qemu: process: Don't use shifted indexes for vcpu order verification (Peter Krempa) - lock_driver_sanlock: Avoid global driver variable whenever possible (Michal Privoznik) - bhyve: chase cpuCompareXML rename (Roman Bogorodskiy) - xlconfigtest: add test for channel conversion (Joao Martins) - xenconfig: channels conversion support (Joao Martins) - libxl: channels support (Joao Martins) - conf: add xen type for channels (Joao Martins) - spec: Package cputypes.rng (Jiri Denemark) - qemu: make qemuGetCompressionProgram return int not an enum (Daniel P. Berrange) - Fix coding style issues. (Nitesh Konkar) - conf: Skip post parse callbacks when creating copy (Michal Privoznik) - domain_conf: Introduce VIR_DOMAIN_DEF_PARSE_SKIP_POST_PARSE (Michal Privoznik) - qemuDomainDefAssignAddresses: Fetch caps from domain object (Michal Privoznik) - qemuDomainDeviceDefPostParse: Fetch caps from domain object (Michal Privoznik) - qemuDomainDefPostParse: Fetch qemuCaps from domain object (Michal Privoznik) - conf: Extend virDomainDefAssignAddressesCallback for parseOpaque (Michal Privoznik) - conf: Extend virDomainDeviceDefPostParse for parseOpaque (Michal Privoznik) - virDomainDefCopy: Introduce @parseOpaque argument (Michal Privoznik) - virDomainDefParse{File,String}: Introduce @parseOpaque argument (Michal Privoznik) - virDomainDefParseNode: Introduce @parseOpaque argument (Michal Privoznik) - virDomainDefPostParse: Introduce @parseOpaque argument (Michal Privoznik) - storage_backend_rbd: remove unnessary translated message marker (Chen Hanxiao) - qemu: Get/return compressedpath program (John Ferlan) - qemu: Remove qemuCompressProgramAvailable (John Ferlan) - qemu: Use qemuGetCompressionProgram for error paths (John Ferlan) - qemu: Alter qemuGetCompressionProgram warning message (John Ferlan) - qemu: Remove getCompressionType (John Ferlan) - qemu: Introduce helper qemuGetCompressionProgram (John Ferlan) - qemu: Adjust doCoreDump to call getCompressionType (John Ferlan) - qemu: Move getCompressionType (John Ferlan) - apparmor: move qemu-bridge-helper to libvirtd profile (Cédric Bosdonnat) - libxl: increase usbdevice list only when finding such an input device (Cédric Bosdonnat) - qemuBuildHostNetStr: Realign (Michal Privoznik) - qemuhelptest: regenerate data for qemu-kvm-1.2.0 (Pavel Hrdina) - qemuhelptest: regenerate data for qemu-kvm-0.13.0 (Pavel Hrdina) - qemuhelptest: regenerate data for qemu-kvm-0.12.3 (Pavel Hrdina) - qemuhelptest: regenerate data for qemu-1.2.0 (Pavel Hrdina) - qemuhelptest: regenerate data for qemu-1.1.0 (Pavel Hrdina) - qemuhelptest: regenerate data for qemu-1.0 (Pavel Hrdina) - qemuhelptest: regenerate data for qemu-0.12.1 (Pavel Hrdina) - qemuhelptest: remove downstream test data (Pavel Hrdina) - qemu: Fix improper indention (John Ferlan) - Fix Multiple Typos (Nitesh Konkar) - Move CMT feature filtering to QEMU driver (Jiri Denemark) - cpu: Rework cpuCompare* APIs (Jiri Denemark) - cpu: Introduce virCPUCheckFeature (Jiri Denemark) - cpu: Rework virCPUDataCheckFeature (Jiri Denemark) - cpu: Rename cpuHasFeature to virCPUDataCheckFeature (Jiri Denemark) - cpu: Introduce virCPUTranslate (Jiri Denemark) - cpu: Rework cpuUpdate (Jiri Denemark) - cpu: Add x86FeatureInData (Jiri Denemark) - cpu: Report error for unknown features in x86HasFeature (Jiri Denemark) - cpu: Make x86ModelFromCPU a bit smarter (Jiri Denemark) - cpu: Make x86ModelFromCPU easier to read (Jiri Denemark) - qemu: Introduce virQEMUCapsIsCPUModeSupported (Jiri Denemark) - qemu: Introduce virQEMUCapsGetHostModel (Jiri Denemark) - Show host model in domain capabilities (Jiri Denemark) - qemu: Store host-model CPU in qemu capabilities (Jiri Denemark) - conf: Introduce virCPUDefCopyModelFilter (Jiri Denemark) - conf: Introduce virCPUDefStealModel (Jiri Denemark) - conf: Introduce virCPUDefCopyWithoutModel (Jiri Denemark) - qemu: Propagate virCapsPtr to virQEMUCapsNewForBinaryInternal (Jiri Denemark) - schema: Separate CPU related definitions into cputypes.rng (Jiri Denemark) - domcaps: Add CPU usable flag (Jiri Denemark) - domcaps: Show only CPU models supported by libvirt (Jiri Denemark) - cpu: Don't overwrite errors in cpuGetModels (Jiri Denemark) - cpu: Special case models == NULL in cpuGetModels (Jiri Denemark) - qemu: Fill in CPU domain capabilities (Jiri Denemark) - qemu: Introduce virQEMUCapsGuestIsNative (Jiri Denemark) - qemuxml2argvtest: Reorder CPU features (Jiri Denemark) - qemuxml2argvtest: Set correct architecture for KVM guests (Jiri Denemark) - qemuxml2argvtest: Properly setup CPU models in qemuCaps (Jiri Denemark) - qemu: Separate guest CPU validation from command line creation (Jiri Denemark) - testutilsqemu: Add default CPU for PPC64 architectures (Jiri Denemark) - testutilsqemu: Helpers for changing host CPU and arch (Jiri Denemark) - qemuxml2argvtest: Properly initialize qemuCaps->arch (Jiri Denemark) - qemuxml2argvtest: Update qemuCaps after parsing domain XML (Jiri Denemark) - qemuxml2argvtest: Reorder functions (Jiri Denemark) - qemuxml2argvtest: Get rid of testCompareXMLToArgvHelper (Jiri Denemark) - qemuxml2argvtest: Rename "out" labels as "cleanup" (Jiri Denemark) - qemuxml2argvtest: Rename extraFlags as qemuCaps (Jiri Denemark) - qemu: Use virDomainCapsCPUModels for cpuDefinitions (Jiri Denemark) - domcaps: Add support for listing supported CPU models (Jiri Denemark) - cpuGetModels: Switch to virArch (Jiri Denemark) - libxl: support VIR_MIGRATE_PERSIST_DEST migration flag (Jim Fehlig) - qemu_process: move graphics validation into separate function (Pavel Hrdina) - qemu_process: show shutoff reasons when debug log disabled (Chen Hanxiao) - qemu: domain: Add macro to simplify access to vm private data (Peter Krempa) - conf: Introduce virDomainObjGetOneDefState (Peter Krempa) - qemu: Ignore graphics cookie if port == 0 (Jiri Denemark) - qemu: agent: give better error messages whe agent monitor is down (Nikolay Shirokovskiy) - qemu: agent: reissue sync on garbage sync reply (Nikolay Shirokovskiy) - qemu: agent: skip outdated sync replies (Nikolay Shirokovskiy) - qemu: agent: ignore garbage while waiting for sync reply (Nikolay Shirokovskiy) - qemu: agent: ignore delayed reply when unsynced (Nikolay Shirokovskiy) - conf: Add some shmem helpers for future use (Martin Kletzander) - qemu: Add qemuAssignDeviceShmemAlias and use it (Martin Kletzander) - qemu: Rename qemuBuildShmemBackendStr to qemuBuildShmemBackendChrStr (Martin Kletzander) - qemu: Abstract shmem socket path preparation (Martin Kletzander) - qemu: Reorder shmem params nicely (Martin Kletzander) - qemu: Move common checks outside qemuBuildShmemDevLegacyStr (Martin Kletzander) - qemu: Rename qemuBuildShmemDevStr to qemuBuildShmemDevLegacyStr (Martin Kletzander) - qemu: Make qemuBuildShmemDevStr static (Martin Kletzander) - virt-admin: Add some command aliases to provide syntax sugar over ugly commands (Erik Skultety) - virt-admin: Tweak command parsing logic so that aliases point to new commands (Erik Skultety) - vsh: discard vshCmddefOptFill and move its body to vshCmddefOptParse (Erik Skultety) - vsh: Extract vshCmddefCheckInternals from vshCmddefOptParse (Erik Skultety) - vsh: vshCmddefHelp: Drop the unnecessary 'else' branch (Erik Skultety) - vsh: vshCmddefHelp: Drop unnecessary variable 'help' (Erik Skultety) - vsh: Enforce checking for missing help string (Erik Skultety) - test: update capability replies for qemu-2.7.0 (Pavel Hrdina) - Revert "configure: Check for major() more strictly" (Eric Blake) - build: update to latest gnulib (Eric Blake) - qemu: Introduce qemuGetHupageMemPath (Michal Privoznik) - qemu_agent|monitor: use different log on hangup event (Chen Hanxiao) - conf: Allow copying of shmem defs (Martin Kletzander) - schema: Allow shmem to have alias (Martin Kletzander) - qemuhotplugtest: Only read result_filename if used (Martin Kletzander) - test driver: Implement testNodeGetFreePages. (Tomáš Ryšavý) - test driver: added pages sizes into XML into test driver. (Tomáš Ryšavý) - test driver: Implement testNodeGetFreeMemory (Tomáš Ryšavý) - test driver: Implement testNodeGetCPUStats (Tomáš Ryšavý) - test driver: Implement virConnectGetType. (Tomáš Ryšavý) - test driver: Implement virConnectGetSysinfo. (Tomáš Ryšavý) - test_driver: Replace magic constant (Tomáš Ryšavý) - virhostcpu: Expose virHostCPUStatsAssign (Tomáš Ryšavý) - virsh: use virConnectGetDomainCapabilities with maxvcpus (Shivaprasad G Bhat) - tests: Use fixedcontent variable (Martin Kletzander) - hyperv: additional server 2008 wmi classes (Jason Miesionczek) - tests: Self test virt-admin (Michal Privoznik) - virsh: Move cmdSelfTest to vsh (Michal Privoznik) - qemu: monitor: Add vcpu state information to monitor data (Peter Krempa) - qemu: monitor: qemuMonitorGetCPUInfoHotplug: Add iterator 'anycpu' (Peter Krempa) - qemu: monitor: Use a more obvious iterator name (Peter Krempa) - qemuDomainGetBlockJobInfo: Move info translation into separate func (Michal Privoznik) - util: numa: Remove impossible error handling (Peter Krempa) - qemu: Add missing 'p' to qemuCgrouEmulatorAllNodesRestore (Peter Krempa) - virsh: add --keep-nvram option to undefine command (Nikolay Shirokovskiy) - qemu: add VIR_DOMAIN_UNDEFINE_KEEP_NVRAM support (Nikolay Shirokovskiy) - api: add VIR_DOMAIN_UNDEFINE_KEEP_NVRAM flag (Nikolay Shirokovskiy) - qemu: avoid parameter named 'listen' (Daniel P. Berrange) - storage: Need to refresh secret for luks volume after volume refresh (John Ferlan) - libxl: implement virConnectBaselineCPU (Joao Martins) - libxl: implement virConnectCompareCPU (Joao Martins) - libxl: describe host cpu features based on hwcaps (Joao Martins) - libxl: describe host topology in capabilities (Joao Martins) - qemu: domain: Clear startup policy for dropped removable media (Peter Krempa) - qemu: Implement virtio-net rx_queue_size (Michal Privoznik) - qemu_capabilities: Introduce virtio-net-*.rx_queue_size (Michal Privoznik) - conf: Add support for virtio-net.rx_queue_size (Michal Privoznik) - conf: Add new secret type "tls" (John Ferlan) - qemu: Add the ability to hotplug the TLS X.509 environment (John Ferlan) - qemu: Add support for TLS X.509 path to TCP chardev backend (John Ferlan) - conf: Introduce chartcp_tls_x509_cert_dir (John Ferlan) - conf: Add new default TLS X.509 certificate default directory (John Ferlan) - Add helper for removing transient definition (Jiri Denemark) - virsh: Fix *-event error string (Christophe Fergeau) - qemu: driver: Remove unnecessary condition (Peter Krempa) - qemu: cgroup: Extract temporary relaxing of cgroup setting for vcpu hotplug (Peter Krempa) - qemu: guest agent: introduce new error code VIR_ERR_AGENT_UNSYNCED (Yuri Pudgorodskiy) - tools: Pass opaque data in vshCompleter and introduce autoCompleteOpaque (Nishith Shah) - libvirt-guests.service: Add Requires=libvirtd.service (Andrea Bolognani) - libvirt-guests.service: Split After= relationship (Andrea Bolognani) - libvirt-guests.service: Improve description (Andrea Bolognani) - virtlogd.socket: Tie lifecycle to libvirtd.service (Andrea Bolognani) - tests: add missing data files for core config (Daniel P. Berrange) - qemu: Don't warn about missing device in DEVICE_DELETED event (Jiri Denemark) - qemu: allow turning off QEMU guest RAM dump globally (Daniel P. Berrange) - qemu: add a max_core setting to qemu.conf for core dump size (Daniel P. Berrange) - util: storage: Add json pseudo protocol support for legacy RBD strings (Peter Krempa) - virsh: Complete multiple options when any one option requires data (Nishith Shah) - virsh: Allow data or argument options to be completed as well (Nishith Shah) - virsh: Introduce usage of option completers to auto-complete arguments (Nishith Shah) - perf: add more perf events support (Qiaowei Ren) - perf: Adjust the perf initialization (Qiaowei Ren) - util: Move virPerfNew and virPerfFree (John Ferlan) - virsh: Rework the perf event names into a table. (John Ferlan) - virsh: Add a forward reference to perf command from domstats --perf (John Ferlan) - util: Add some comment details for virPerfEventType (Qiaowei Ren) - perf: Remove the switch from qemuDomainGetStatsPerf (Qiaowei Ren) - perf: rename qemuDomainGetStatsPerfRdt() (Qiaowei Ren) - qemu: Filter cur_balloon ABI check for certain transactions (Nikolay Shirokovskiy) - xmconfigdata: drop tests for multi serial (Bob Liu) - xlconfigdata: add tests for multi serial (Bob Liu) - xenconfig: rm format/parse multi serial for xen-xm (Bob Liu) - libxl: support serial list (Bob Liu) - virpci: support driver_override sysfs interface (Jim Fehlig) - libxl: allow vendor/product addressing for USB hostdevs (Cédric Bosdonnat) - Add virHostdevFindUSBDevice to private symbols (Cédric Bosdonnat) Thanks everybody for your help with this release, be it with patches, bug reports, documentation, patch reviews, etc ! Enjoy the release :-) Daniel