[Libvirt-announce] Release of libvirt-2.3.0

[Daniel Veillard]

  We are a little late but that allowed us to catch a regression before it impacted
the release :)
  I have tagged the release in git, pushed signed tarball and rpms to the usual place:

    ftp://libvirt.org/libvirt/

I also pushed the associated python bindings release available at:

    ftp://libvirt.org/libvirt/python/

 This is a release of moderate size, around 250 commits, with a balance of features
bugs fixes and improvements:


Features:
- Improvements on CPU models (Jiri Denemark)
- More performance metrics and events (Qiaowei Ren, John Ferlan)

Documentation:
- docs: correct version requirements for <kvm><hidden='on'/></kvm> (Laine Stump)
- doc: fix note about Xen credit scheduler (Jim Fehlig)
- Fix various code comment typos (Nitesh Konkar)
- cpu: Document missing parameters for cpuCompare* (Jiri Denemark)
- libvirt-nodedev.c:fix a typo (Nitesh Konkar)
- libvirt-admin.c:fix a typo (Nitesh Konkar)
- driver.c:fix a typo (Nitesh Konkar)
- domain_conf.c:fix the comment. (Nitesh Konkar)
- domain_conf.c:fix a typo (Nitesh Konkar)
- domain_conf.c:fix a typo (Nitesh Konkar)
- stream.c: fix a typo (Nitesh Konkar)
- config-post.h:fix a typo (Nitesh Konkar)
- virsh: man: Do not document our old deprecated nodedev-dettach command (Erik Skultety)
- qemu_process: fix a typo (Chen Hanxiao)
- docs: expand docs on user x509 cert locations (Daniel P. Berrange)
- virt-admin: Fix some English grammar in the manpage (Erik Skultety)
- virt-admin: Document srv-list command in virt-admin's man page (Erik Skultety)
- docs: Add libvirt-go Go bindings to binding page (Roman Mohr)

Portability:
- mingw: Package cputypes.rng for mingw32 too (Jiri Denemark)
- mingw: Package cputypes.rng (Jiri Denemark)
- Add missing 'extern' for VIR_EXPORT_VAR macro (Daniel P. Berrange)
- Make sure sys/types.h is included after sys/sysmacros.h (Michal Privoznik)

Bug Fixes:
- qemu: vcpu: Clear vcpu order information rather than making it invalid (Peter Krempa)
- qemu: Fix coldplug of vcpus (Peter Krempa)
- qemu: process: Enforce 'vcpu' order range to <1,maxvcpus> (Peter Krempa)
- qemu: process: Fix off-by-one in vcpu order duplicate error message (Peter Krempa)
- sanlock: Properly init io_timeout (Michal Privoznik)
- m4: Check for sanlock_write_lockspace (Michal Privoznik)
- qemu: Only use memory-backend-file with NUMA if needed (Martin Kletzander)
- vsh: Write out history on "quit" or "exit" in interactive mode (John Ferlan)
- libxl: fix param assignment in domainGetSchedulerParameters (Jim Fehlig)
- qemu: Fix crash in qemucapsprobe (Jiri Denemark)
- qemuDomainUpdateDeviceConfig: Allow full disk update (Michal Privoznik)
- libxl: find virDomainObj in libxlDomainShutdownThread (Jim Fehlig)
- qemu: Update guest CPU def in live XML (Jiri Denemark)
- cpu: Set nfeatures_max correctly in x86Decode (Jiri Denemark)
- cpu: Drop false support for ARM cpu-model (Jiri Denemark)
- migration: Document we don't copy storage during offline migration (Michal Privoznik)
- qemu: driver: Don't return automatic NUMA emulator pinning data for persistentDef (Peter Krempa)
- qemu: driver: Don't return automatic NUMA vCPU pinning data for persistentDef (Peter Krempa)
- qemuDomainOpenGraphics: Start job early (Jiri Denemark)
- virtlogd: Don't stop or restart along with libvirtd (Andrea Bolognani)
- tests: fix use of fixedcontent variable (Laine Stump)
- qemuBuildMemoryBackendStr: Don't crash if no hugetlbfs is mounted (Michal Privoznik)
- qemu: map "virtio" video model to "virt" machtype correctly (arm/aarch64) (Laszlo Ersek)
- util: Expose virHostCPUStatsAssign on non-Linux (Martin Kletzander)
- qemu: domain: Don't infer vcpu state (Peter Krempa)
- virDomainGetBlockJobInfo: Fix corner case when qemu reports no info (Michal Privoznik)
- tests: use a fixed chardev TLS path (Daniel P. Berrange)
- numa: Rename virNumaGetHostNodeset and make it return only nodes with memory (Peter Krempa)
- configure: Check for major() more strictly (Michal Privoznik)
- tests: fix incorrect status handling by virsh-self-test (Erik Skultety)
- conf: allow hotplugging "legacy PCI" device to manually addressed PCIe slot (Laine Stump)
- qemu: fix improper initialization of cgroupControllers bitmap (Laine Stump)
- audit: Audit information about shmem devices (Martin Kletzander)
- storage: Need to properly read the crypt offset value (John Ferlan)
- log: Fix reporting OOM error incorrectly when defining a logging filter (Nikolay Shirokovskiy)
- qemu: Don't use query-migrate on destination (Jiri Denemark)
- util: Quiet the logging if perf file doesn't exist (John Ferlan)
- qemu: hotplug: Don't wait if cdrom tray is opened forcibly (Peter Krempa)
- qemu: Remove stale transient def when migration fails (Jiri Denemark)
- security: Fixing wrong label in virt-aa-helper.c. (Julio Faracco)
- Avoid segfault in virt-aa-helper when handling read-only filesystems (Rufo Dogav)
- storage: Delete extra wrap after vol-resize error (Yanqiu Zhang)
- qemu: process: Fix start with unpluggable vcpus with NUMA pinning (Peter Krempa)
- virt-admin: Output srv-clients-set data as unsigned int rather than signed (Erik Skultety)
- util: fix crash in virClassIsDerivedFrom for CloseCallbacks objects (Maxim Nestratov)
- util: hostcpu: improve CPU freq code for FreeBSD (Roman Bogorodskiy)
- util: storage: Properly set protocol type when parsing gluster json string (Peter Krempa)
- conf: Fix initialization value of 'multi' in PCI address (Xian Han Yu)

Improvements:
- qemu: process: Don't use shifted indexes for vcpu order verification (Peter Krempa)
- lock_driver_sanlock: Avoid global driver variable whenever possible (Michal Privoznik)
- bhyve: chase cpuCompareXML rename (Roman Bogorodskiy)
- xlconfigtest: add test for channel conversion (Joao Martins)
- xenconfig: channels conversion support (Joao Martins)
- libxl: channels support (Joao Martins)
- conf: add xen type for channels (Joao Martins)
- spec: Package cputypes.rng (Jiri Denemark)
- qemu: make qemuGetCompressionProgram return int not an enum (Daniel P. Berrange)
- Fix coding style issues. (Nitesh Konkar)
- conf: Skip post parse callbacks when creating copy (Michal Privoznik)
- domain_conf: Introduce VIR_DOMAIN_DEF_PARSE_SKIP_POST_PARSE (Michal Privoznik)
- qemuDomainDefAssignAddresses: Fetch caps from domain object (Michal Privoznik)
- qemuDomainDeviceDefPostParse: Fetch caps from domain object (Michal Privoznik)
- qemuDomainDefPostParse: Fetch qemuCaps from domain object (Michal Privoznik)
- conf: Extend virDomainDefAssignAddressesCallback for parseOpaque (Michal Privoznik)
- conf: Extend virDomainDeviceDefPostParse for parseOpaque (Michal Privoznik)
- virDomainDefCopy: Introduce @parseOpaque argument (Michal Privoznik)
- virDomainDefParse{File,String}: Introduce @parseOpaque argument (Michal Privoznik)
- virDomainDefParseNode: Introduce @parseOpaque argument (Michal Privoznik)
- virDomainDefPostParse: Introduce @parseOpaque argument (Michal Privoznik)
- storage_backend_rbd: remove unnessary translated message marker (Chen Hanxiao)
- qemu: Get/return compressedpath program (John Ferlan)
- qemu: Remove qemuCompressProgramAvailable (John Ferlan)
- qemu: Use qemuGetCompressionProgram for error paths (John Ferlan)
- qemu: Alter qemuGetCompressionProgram warning message (John Ferlan)
- qemu: Remove getCompressionType (John Ferlan)
- qemu: Introduce helper qemuGetCompressionProgram (John Ferlan)
- qemu: Adjust doCoreDump to call getCompressionType (John Ferlan)
- qemu: Move getCompressionType (John Ferlan)
- apparmor: move qemu-bridge-helper to libvirtd profile (Cédric Bosdonnat)
- libxl: increase usbdevice list only when finding such an input device (Cédric Bosdonnat)
- qemuBuildHostNetStr: Realign (Michal Privoznik)
- qemuhelptest: regenerate data for qemu-kvm-1.2.0 (Pavel Hrdina)
- qemuhelptest: regenerate data for qemu-kvm-0.13.0 (Pavel Hrdina)
- qemuhelptest: regenerate data for qemu-kvm-0.12.3 (Pavel Hrdina)
- qemuhelptest: regenerate data for qemu-1.2.0 (Pavel Hrdina)
- qemuhelptest: regenerate data for qemu-1.1.0 (Pavel Hrdina)
- qemuhelptest: regenerate data for qemu-1.0 (Pavel Hrdina)
- qemuhelptest: regenerate data for qemu-0.12.1 (Pavel Hrdina)
- qemuhelptest: remove downstream test data (Pavel Hrdina)
- qemu: Fix improper indention (John Ferlan)
- Fix Multiple Typos (Nitesh Konkar)
- Move CMT feature filtering to QEMU driver (Jiri Denemark)
- cpu: Rework cpuCompare* APIs (Jiri Denemark)
- cpu: Introduce virCPUCheckFeature (Jiri Denemark)
- cpu: Rework virCPUDataCheckFeature (Jiri Denemark)
- cpu: Rename cpuHasFeature to virCPUDataCheckFeature (Jiri Denemark)
- cpu: Introduce virCPUTranslate (Jiri Denemark)
- cpu: Rework cpuUpdate (Jiri Denemark)
- cpu: Add x86FeatureInData (Jiri Denemark)
- cpu: Report error for unknown features in x86HasFeature (Jiri Denemark)
- cpu: Make x86ModelFromCPU a bit smarter (Jiri Denemark)
- cpu: Make x86ModelFromCPU easier to read (Jiri Denemark)
- qemu: Introduce virQEMUCapsIsCPUModeSupported (Jiri Denemark)
- qemu: Introduce virQEMUCapsGetHostModel (Jiri Denemark)
- Show host model in domain capabilities (Jiri Denemark)
- qemu: Store host-model CPU in qemu capabilities (Jiri Denemark)
- conf: Introduce virCPUDefCopyModelFilter (Jiri Denemark)
- conf: Introduce virCPUDefStealModel (Jiri Denemark)
- conf: Introduce virCPUDefCopyWithoutModel (Jiri Denemark)
- qemu: Propagate virCapsPtr to virQEMUCapsNewForBinaryInternal (Jiri Denemark)
- schema: Separate CPU related definitions into cputypes.rng (Jiri Denemark)
- domcaps: Add CPU usable flag (Jiri Denemark)
- domcaps: Show only CPU models supported by libvirt (Jiri Denemark)
- cpu: Don't overwrite errors in cpuGetModels (Jiri Denemark)
- cpu: Special case models == NULL in cpuGetModels (Jiri Denemark)
- qemu: Fill in CPU domain capabilities (Jiri Denemark)
- qemu: Introduce virQEMUCapsGuestIsNative (Jiri Denemark)
- qemuxml2argvtest: Reorder CPU features (Jiri Denemark)
- qemuxml2argvtest: Set correct architecture for KVM guests (Jiri Denemark)
- qemuxml2argvtest: Properly setup CPU models in qemuCaps (Jiri Denemark)
- qemu: Separate guest CPU validation from command line creation (Jiri Denemark)
- testutilsqemu: Add default CPU for PPC64 architectures (Jiri Denemark)
- testutilsqemu: Helpers for changing host CPU and arch (Jiri Denemark)
- qemuxml2argvtest: Properly initialize qemuCaps->arch (Jiri Denemark)
- qemuxml2argvtest: Update qemuCaps after parsing domain XML (Jiri Denemark)
- qemuxml2argvtest: Reorder functions (Jiri Denemark)
- qemuxml2argvtest: Get rid of testCompareXMLToArgvHelper (Jiri Denemark)
- qemuxml2argvtest: Rename "out" labels as "cleanup" (Jiri Denemark)
- qemuxml2argvtest: Rename extraFlags as qemuCaps (Jiri Denemark)
- qemu: Use virDomainCapsCPUModels for cpuDefinitions (Jiri Denemark)
- domcaps: Add support for listing supported CPU models (Jiri Denemark)
- cpuGetModels: Switch to virArch (Jiri Denemark)
- libxl: support VIR_MIGRATE_PERSIST_DEST migration flag (Jim Fehlig)
- qemu_process: move graphics validation into separate function (Pavel Hrdina)
- qemu_process: show shutoff reasons when debug log disabled (Chen Hanxiao)
- qemu: domain: Add macro to simplify access to vm private data (Peter Krempa)
- conf: Introduce virDomainObjGetOneDefState (Peter Krempa)
- qemu: Ignore graphics cookie if port == 0 (Jiri Denemark)
- qemu: agent: give better error messages whe agent monitor is down (Nikolay Shirokovskiy)
- qemu: agent: reissue sync on garbage sync reply (Nikolay Shirokovskiy)
- qemu: agent: skip outdated sync replies (Nikolay Shirokovskiy)
- qemu: agent: ignore garbage while waiting for sync reply (Nikolay Shirokovskiy)
- qemu: agent: ignore delayed reply when unsynced (Nikolay Shirokovskiy)
- conf: Add some shmem helpers for future use (Martin Kletzander)
- qemu: Add qemuAssignDeviceShmemAlias and use it (Martin Kletzander)
- qemu: Rename qemuBuildShmemBackendStr to qemuBuildShmemBackendChrStr (Martin Kletzander)
- qemu: Abstract shmem socket path preparation (Martin Kletzander)
- qemu: Reorder shmem params nicely (Martin Kletzander)
- qemu: Move common checks outside qemuBuildShmemDevLegacyStr (Martin Kletzander)
- qemu: Rename qemuBuildShmemDevStr to qemuBuildShmemDevLegacyStr (Martin Kletzander)
- qemu: Make qemuBuildShmemDevStr static (Martin Kletzander)
- virt-admin: Add some command aliases to provide syntax sugar over ugly commands (Erik Skultety)
- virt-admin: Tweak command parsing logic so that aliases point to new commands (Erik Skultety)
- vsh: discard vshCmddefOptFill and move its body to vshCmddefOptParse (Erik Skultety)
- vsh: Extract vshCmddefCheckInternals from vshCmddefOptParse (Erik Skultety)
- vsh: vshCmddefHelp: Drop the unnecessary 'else' branch (Erik Skultety)
- vsh: vshCmddefHelp: Drop unnecessary variable 'help' (Erik Skultety)
- vsh: Enforce checking for missing help string (Erik Skultety)
- test: update capability replies for qemu-2.7.0 (Pavel Hrdina)
- Revert "configure: Check for major() more strictly" (Eric Blake)
- build: update to latest gnulib (Eric Blake)
- qemu: Introduce qemuGetHupageMemPath (Michal Privoznik)
- qemu_agent|monitor: use different log on hangup event (Chen Hanxiao)
- conf: Allow copying of shmem defs (Martin Kletzander)
- schema: Allow shmem to have alias (Martin Kletzander)
- qemuhotplugtest: Only read result_filename if used (Martin Kletzander)
- test driver: Implement testNodeGetFreePages. (Tomáš Ryšavý)
- test driver: added pages sizes into XML into test driver. (Tomáš Ryšavý)
- test driver: Implement testNodeGetFreeMemory (Tomáš Ryšavý)
- test driver: Implement testNodeGetCPUStats (Tomáš Ryšavý)
- test driver: Implement virConnectGetType. (Tomáš Ryšavý)
- test driver: Implement virConnectGetSysinfo. (Tomáš Ryšavý)
- test_driver: Replace magic constant (Tomáš Ryšavý)
- virhostcpu: Expose virHostCPUStatsAssign (Tomáš Ryšavý)
- virsh: use virConnectGetDomainCapabilities with maxvcpus (Shivaprasad G Bhat)
- tests: Use fixedcontent variable (Martin Kletzander)
- hyperv: additional server 2008 wmi classes (Jason Miesionczek)
- tests: Self test virt-admin (Michal Privoznik)
- virsh: Move cmdSelfTest to vsh (Michal Privoznik)
- qemu: monitor: Add vcpu state information to monitor data (Peter Krempa)
- qemu: monitor: qemuMonitorGetCPUInfoHotplug: Add iterator 'anycpu' (Peter Krempa)
- qemu: monitor: Use a more obvious iterator name (Peter Krempa)
- qemuDomainGetBlockJobInfo: Move info translation into separate func (Michal Privoznik)
- util: numa: Remove impossible error handling (Peter Krempa)
- qemu: Add missing 'p' to qemuCgrouEmulatorAllNodesRestore (Peter Krempa)
- virsh: add --keep-nvram option to undefine command (Nikolay Shirokovskiy)
- qemu: add VIR_DOMAIN_UNDEFINE_KEEP_NVRAM support (Nikolay Shirokovskiy)
- api: add VIR_DOMAIN_UNDEFINE_KEEP_NVRAM flag (Nikolay Shirokovskiy)
- qemu: avoid parameter named 'listen' (Daniel P. Berrange)
- storage: Need to refresh secret for luks volume after volume refresh (John Ferlan)
- libxl: implement virConnectBaselineCPU (Joao Martins)
- libxl: implement virConnectCompareCPU (Joao Martins)
- libxl: describe host cpu features based on hwcaps (Joao Martins)
- libxl: describe host topology in capabilities (Joao Martins)
- qemu: domain: Clear startup policy for dropped removable media (Peter Krempa)
- qemu: Implement virtio-net rx_queue_size (Michal Privoznik)
- qemu_capabilities: Introduce virtio-net-*.rx_queue_size (Michal Privoznik)
- conf: Add support for virtio-net.rx_queue_size (Michal Privoznik)
- conf: Add new secret type "tls" (John Ferlan)
- qemu: Add the ability to hotplug the TLS X.509 environment (John Ferlan)
- qemu: Add support for TLS X.509 path to TCP chardev backend (John Ferlan)
- conf: Introduce chartcp_tls_x509_cert_dir (John Ferlan)
- conf: Add new default TLS X.509 certificate default directory (John Ferlan)
- Add helper for removing transient definition (Jiri Denemark)
- virsh: Fix *-event error string (Christophe Fergeau)
- qemu: driver: Remove unnecessary condition (Peter Krempa)
- qemu: cgroup: Extract temporary relaxing of cgroup setting for vcpu hotplug (Peter Krempa)
- qemu: guest agent: introduce new error code VIR_ERR_AGENT_UNSYNCED (Yuri Pudgorodskiy)
- tools: Pass opaque data in vshCompleter and introduce autoCompleteOpaque (Nishith Shah)
- libvirt-guests.service: Add Requires=libvirtd.service (Andrea Bolognani)
- libvirt-guests.service: Split After= relationship (Andrea Bolognani)
- libvirt-guests.service: Improve description (Andrea Bolognani)
- virtlogd.socket: Tie lifecycle to libvirtd.service (Andrea Bolognani)
- tests: add missing data files for core config (Daniel P. Berrange)
- qemu: Don't warn about missing device in DEVICE_DELETED event (Jiri Denemark)
- qemu: allow turning off QEMU guest RAM dump globally (Daniel P. Berrange)
- qemu: add a max_core setting to qemu.conf for core dump size (Daniel P. Berrange)
- util: storage: Add json pseudo protocol support for legacy RBD strings (Peter Krempa)
- virsh: Complete multiple options when any one option requires data (Nishith Shah)
- virsh: Allow data or argument options to be completed as well (Nishith Shah)
- virsh: Introduce usage of option completers to auto-complete arguments (Nishith Shah)
- perf: add more perf events support (Qiaowei Ren)
- perf: Adjust the perf initialization (Qiaowei Ren)
- util: Move virPerfNew and virPerfFree (John Ferlan)
- virsh: Rework the perf event names into a table. (John Ferlan)
- virsh: Add a forward reference to perf command from domstats --perf (John Ferlan)
- util: Add some comment details for virPerfEventType (Qiaowei Ren)
- perf: Remove the switch from qemuDomainGetStatsPerf (Qiaowei Ren)
- perf: rename qemuDomainGetStatsPerfRdt() (Qiaowei Ren)
- qemu: Filter cur_balloon ABI check for certain transactions (Nikolay Shirokovskiy)
- xmconfigdata: drop tests for multi serial (Bob Liu)
- xlconfigdata: add tests for multi serial (Bob Liu)
- xenconfig: rm format/parse multi serial for xen-xm (Bob Liu)
- libxl: support serial list (Bob Liu)
- virpci: support driver_override sysfs interface (Jim Fehlig)
- libxl: allow vendor/product addressing for USB hostdevs (Cédric Bosdonnat)
- Add virHostdevFindUSBDevice to private symbols (Cédric Bosdonnat)

    Thanks everybody for your help with this release, be it with patches, bug reports,
documentation, patch reviews, etc !

      Enjoy the release :-)

Daniel


-- 
Daniel Veillard      | Open Source and Standards, Red Hat
veillard at redhat.com  | libxml Gnome XML XSLT toolkit  http://xmlsoft.org/
http://veillard.com/ | virtualization library  http://libvirt.org/