October 2024 - Devel - libvirt List Archives

[PATCH] ci: Move definition of exit codes allowed to fail for cirrus jobs
by Peter Krempa 23 Oct '24

23 Oct '24

Update with latest lcitool. Update the build templates to move the definition of exit codes which are allowed to fail for cirrus jobs for cases when we run out of CI minutes. The previous location was overridden with the per-job 'allow_failure' value and thus didn't apply. Signed-off-by: Peter Krempa <pkrempa(a)redhat.com> --- Based on: https://gitlab.com/libvirt/libvirt-ci/-/merge_requests/510 example run: https://gitlab.com/libvirt/libvirt/-/pipelines/1508364775 ci/gitlab/build-templates.yml | 2 -- ci/gitlab/builds.yml | 9 ++++++--- 2 files changed, 6 insertions(+), 5 deletions(-) diff --git a/ci/gitlab/build-templates.yml b/ci/gitlab/build-templates.yml index 31a901e47c..b1e41b0783 100644 --- a/ci/gitlab/build-templates.yml +++ b/ci/gitlab/build-templates.yml @@ -282,8 +282,6 @@ image: registry.gitlab.com/libvirt/libvirt-ci/cirrus-run:latest interruptible: true needs: [] - allow_failure: - exit_codes: 3 script: - set -o allexport - source ci/cirrus/$NAME.vars diff --git a/ci/gitlab/builds.yml b/ci/gitlab/builds.yml index 771fa67501..c24421378c 100644 --- a/ci/gitlab/builds.yml +++ b/ci/gitlab/builds.yml @@ -599,7 +599,8 @@ mingw64-fedora-rawhide: x86_64-freebsd-13: extends: .cirrus_build_job needs: [] - allow_failure: false + allow_failure: + exit_codes: 3 variables: CIRRUS_VM_IMAGE_NAME: freebsd-13-3 CIRRUS_VM_IMAGE_SELECTOR: image_family @@ -613,7 +614,8 @@ x86_64-freebsd-13: x86_64-freebsd-14: extends: .cirrus_build_job needs: [] - allow_failure: false + allow_failure: + exit_codes: 3 variables: CIRRUS_VM_IMAGE_NAME: freebsd-14-0 CIRRUS_VM_IMAGE_SELECTOR: image_family @@ -627,7 +629,8 @@ x86_64-freebsd-14: aarch64-macos-14: extends: .cirrus_build_job needs: [] - allow_failure: false + allow_failure: + exit_codes: 3 variables: CIRRUS_VM_IMAGE_NAME: ghcr.io/cirruslabs/macos-runner:sonoma CIRRUS_VM_IMAGE_SELECTOR: image -- 2.47.0

2 1

[PATCH v2 0/6] ch: handle events from cloud-hypervisor
by Purna Pavan Chandra Aekkaladevi 23 Oct '24

23 Oct '24

changes from v1->v2: * Rebase on latest master * Use /* */ for comments * Remove fifo file if already exists * Address other comments from Praveen Paladugu cloud-hypervisor raises various events, including VM lifecylce operations such as boot, shutdown, pause, resume, etc. Libvirt will now read these events and take the necessary actions, such as correctly updating the domain state. A FIFO file is passed to `--event-monitor` option of cloud-hypervisor. Libvirt creates a new thread that acts as the reader of the fifo file and continuously monitors for new events. Currently, shutdown events are handled by updating the domain state appropriately. Purna Pavan Chandra Aekkaladevi (6): utils: Implement virFileIsNamedPipe ch: pass --event-monitor option to cloud-hypervisor ch: start a new thread for handling ch events ch: events: Read and parse cloud-hypervisor events ch: events: facilitate lifecycle events handling NEWS: Mention event handling support in ch driver NEWS.rst | 7 + po/POTFILES | 1 + src/ch/ch_events.c | 349 +++++++++++++++++++++++++++++++++++++++ src/ch/ch_events.h | 54 ++++++ src/ch/ch_monitor.c | 52 +++++- src/ch/ch_monitor.h | 11 ++ src/ch/meson.build | 2 + src/libvirt_private.syms | 1 + src/util/virfile.c | 8 + src/util/virfile.h | 1 + 10 files changed, 479 insertions(+), 7 deletions(-) create mode 100644 src/ch/ch_events.c create mode 100644 src/ch/ch_events.h -- 2.34.1

2 10

[PATCH (pushed)] ci: Regenerate with latest lcitool to pick up 'cirrus-ci' out of credit detection
by Peter Krempa 22 Oct '24

22 Oct '24

Allow the cirrus jobs to fail on return code '3' which is emitted if we've run out of credits. Signed-off-by: Peter Krempa <pkrempa(a)redhat.com> --- Pushed as CI fix. ci/gitlab/build-templates.yml | 2 ++ 1 file changed, 2 insertions(+) diff --git a/ci/gitlab/build-templates.yml b/ci/gitlab/build-templates.yml index b1e41b0783..31a901e47c 100644 --- a/ci/gitlab/build-templates.yml +++ b/ci/gitlab/build-templates.yml @@ -282,6 +282,8 @@ image: registry.gitlab.com/libvirt/libvirt-ci/cirrus-run:latest interruptible: true needs: [] + allow_failure: + exit_codes: 3 script: - set -o allexport - source ci/cirrus/$NAME.vars -- 2.47.0

1 0

[PATCH v2 0/3] util/xml: make xml parser error reporting less terrible
by Daniel P. Berrangé 22 Oct '24

22 Oct '24

libxml2 has terrible error reporting when failing to open files, which has led to significant wasted time on wild goose chases. This improves it by taking libxml2 out of the business of opening & reading files. Daniel P. Berrangé (3): util/xml: fix extraction of XML context util/xml: don't assume libxml2 has the filename of the document util/xml: open XML files before calling libxml2 src/util/virxml.c | 29 +++++++++++++------ .../broken-xml-invalid.x86_64-latest.err | 4 +-- .../nonexistent-file.x86_64-latest.err | 2 +- 3 files changed, 23 insertions(+), 12 deletions(-) -- 2.46.0

3 7

[PATCH] docs: permit a user's chosen identity with SoB
by Daniel P. Berrangé 22 Oct '24

22 Oct '24

The docs for submitting a patch describe using your "Legal Name" with the Signed-off-by line. In recent times, there's been a general push back[1] against the notion that use of Signed-off-by in a project automatically requires / implies the use of legal ("real") names and greater awareness of the downsides. Full discussion of the problems of such policies is beyond the scope of this commit message, but at a high level they are liable to marginalize, disadvantage, and potentially result in harm, to contributors. TL;DR: there are compelling reasons for a person to choose distinct identities in different contexts & a decision to override that choice should not be taken lightly. A number of key projects have responded to the issues raised by making it clear that a contributor is free to determine the identity used in SoB lines: * Linux has clarified[2] that they merely expect use of the contributor's "known identity", removing the previous explicit rejection of pseudonyms. * CNCF has clarified[3] that the real name is simply the identity the contributor chooses to use in the context of the community and does not have to be a legal name, nor birth name, nor appear on any government ID. Since we have no intention of ever routinely checking any form of ID documents for contributors[4], realistically we have no way of knowing anything about the name they are using, except through chance, or through the contributor volunteering the information. IOW, we almost certainly already have people using pseudonyms for contributions. This proposes to accept that reality and eliminate unnecessary friction, by following Linux & the CNCF in merely asking that a contributors' commonly known identity, of their choosing, be used with the SoB line. [1] Raised in many contexts at many times, but a decent overall summary can be read at https://drewdevault.com/2023/10/31/On-real-names.html [2] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?… [3] https://github.com/cncf/foundation/blob/659fd32c86dc/dco-guidelines.md [4] Excluding the rare GPG key signing parties for regular maintainers Signed-off-by: Daniel P. Berrangé <berrange(a)redhat.com> --- docs/governance.rst | 6 +++--- docs/hacking.rst | 9 ++++++--- 2 files changed, 9 insertions(+), 6 deletions(-) diff --git a/docs/governance.rst b/docs/governance.rst index 44dd54d4a0..04bb739237 100644 --- a/docs/governance.rst +++ b/docs/governance.rst @@ -112,9 +112,9 @@ There are no special requirements to becoming a contributor other than having the interest and ability to provide a contribution. The libvirt project **does not require** any *"Contributor License Agreement"* to be signed prior to engagement with the community. However for contributing patches, providing a -'Signed-off-by' line with the author's legal name and e-mail address to -demonstrate agreement and compliance with the `Developer Certificate of -Origin <https://developercertificate.org/>`__ is required. +'Signed-off-by' line with the author's chosen name and e-mail address to +demonstrate agreement and compliance with the `Developer Certificate +of Origin <hacking.html#developer-certificate-of-origin>`__ is required. In making a non-patch contribution to the project, the community member is implicitly stating that they accept the terms of the license under which the diff --git a/docs/hacking.rst b/docs/hacking.rst index c2e79e4501..825b8b83d2 100644 --- a/docs/hacking.rst +++ b/docs/hacking.rst @@ -83,9 +83,12 @@ Contributors to libvirt projects **must** assert that they are in compliance with the `Developer Certificate of Origin 1.1 <https://developercertificate.org/>`__. This is achieved by adding a "Signed-off-by" line containing the contributor's name -and e-mail to every commit message. The presence of this line -attests that the contributor has read the above lined DCO and -agrees with its statements. +and e-mail to every commit message. The name should be the identity +the contributor has chosen to be known as in the context of the +community. It does not need to be a legal name, nor match any +formal ID documents, but should not be anonymous, nor misrepresent +who you are. The presence of this line attests that the contributor +has read the above linked DCO and agrees with its statements. Further reading =============== -- 2.46.0

2 1

[PATCH v3 00/10] swtpm: Add support for profiles
by Stefan Berger 22 Oct '24

22 Oct '24

Upcoming libtpms v0.10 and swtpm v0.10 will have TPM profile support that allows to restrict a TPM's provided set of crypto algorithms and commands and through which backwards compatibility and migration from newer versions of libtpms to older ones (up to libtpms v0.9) is supported. For the latter to work it is necessary that the user chooses the right ('null') profile. This series adds support for passing a profile choice to swtpm_setup by setting it in the domain XML using the <profile/> XML node. An optional attribute 'remove_disabled' can be set in this node and accepts two values: "check": test a few crypto algorithms (tdes, camellia, unpadded encryption, and others) for whether they are currently disabled due to FIPS mode on the host and remove these algorithms in the 'custom' profile if they are disabled; "fips-host": do not test but remove all the possibly disabled crypto algorithms (from list above) Also extend the documentation but point the user to swtpm and libtpms documentation for further details. Follow Deniel's suggestions there's now a PR for swtpm_setup to support searching for profiles though a configurable local directory, distro directory and if no profile could be found there (with appended ".json" suffix) it will fall back to try to use a built-in profile by the provided name: https://github.com/stefanberger/swtpm/pull/918 Stefan v3: - 2/10: Adjustments to due rebase - Applied Marc-André's R-b tags - 10/10: Read back profile name from swtpm and adjust it in emulator defs Stefan Berger (10): conf: Move TPM emulator parameters into own struct qemu: Pass virQEMUDriverConfig rather than some of its fields util: Add parsing support for swtpm_setup's cmdarg-profile capability conf: Define enum virDomainTPMProfileRemoveDisabled schema: Extend schema for TPM emulator profile node conf: Add support for profile parameter on TPM emulator in domain XML docs: Add documentation for the TPM backend profile node qemu: Extend swtpm_setup command line to set a profile by its name qemu: Move adding of keys to swtpm command line into own function qemu: Read the profile name after creation of TPM instance docs/formatdomain.rst | 30 +++ src/conf/domain_conf.c | 43 +++++ src/conf/domain_conf.h | 35 ++-- src/conf/domain_validate.c | 7 + src/conf/schemas/domaincommon.rng | 25 +++ src/conf/virconftypes.h | 2 + src/qemu/qemu_extdevice.c | 5 +- src/qemu/qemu_tpm.c | 310 ++++++++++++++++++++---------- src/qemu/qemu_tpm.h | 3 +- src/util/virtpm.c | 2 + src/util/virtpm.h | 2 + tests/testutilsqemu.c | 1 + 12 files changed, 355 insertions(+), 110 deletions(-) -- 2.47.0

3 13

Help with setting up libvirt for development.
by validsudoku＠gmail.com 22 Oct '24

22 Oct '24

Hi, pardon my ignorance. I'm trying to add some changes to the libvirt codebase (https://gitlab.com/libvirt/libvirt) I've successfully built it with `meson setup /build` and a `compile_commands.json` was generated in the build folder. But vscode keeps showing that there are errors from trying to find certain files and identifiers. I have also copied the `compile_commands.json` to the root of the project with no success. I'm new to working on a large C codebase, as i'm mainly into Go. I have also installed the `meson.build` extension as prescribed in https://mesonbuild.com/IDE-integration.html, is there anything i'm missing?

2 1

[PATCH] spec: Drop nwfilter dependency in libvirt-daemon-xen
by Jim Fehlig 22 Oct '24

22 Oct '24

The libvirt xen driver does not support nwfilters. In fact, since commit d721b6840f, the driver rejects VM configuration referencing nwfilters. Drop the needless nwfilter dependency from libvirt-daemon-xen. Signed-off-by: Jim Fehlig <jfehlig(a)suse.com> --- libvirt.spec.in | 1 - 1 file changed, 1 deletion(-) diff --git a/libvirt.spec.in b/libvirt.spec.in index f26de04553..d54d2a1e3e 100644 --- a/libvirt.spec.in +++ b/libvirt.spec.in @@ -993,7 +993,6 @@ Requires: libvirt-daemon-driver-libxl = %{version}-%{release} Requires: libvirt-daemon-driver-interface = %{version}-%{release} Requires: libvirt-daemon-driver-network = %{version}-%{release} Requires: libvirt-daemon-driver-nodedev = %{version}-%{release} -Requires: libvirt-daemon-driver-nwfilter = %{version}-%{release} Requires: libvirt-daemon-driver-secret = %{version}-%{release} Requires: libvirt-daemon-driver-storage = %{version}-%{release} Requires: xen -- 2.43.0

2 1

Re: [PATCH v4 3/6] schema: add TPM emulator <source type='file' path='..'>
by Stefan Berger 22 Oct '24

22 Oct '24

> > Learn to parse a file path for the TPM state. > > Signed-off-by: Marc-André Lureau <marcandre.lureau(a)redhat.com> > --- > docs/formatdomain.rst | 19 ++++++++++++++ > src/conf/domain_conf.c | 28 +++++++++++++++++++++ > src/conf/domain_conf.h | 9 +++++++ > src/conf/schemas/domaincommon.rng | 14 +++++++++++ > tests/qemuxmlconfdata/tpm-emulator-tpm2.xml | 1 + > 5 files changed, 71 insertions(+) > > diff --git a/docs/formatdomain.rst b/docs/formatdomain.rst > index e6f09a728f..d4feb4421c 100644 > --- a/docs/formatdomain.rst > +++ b/docs/formatdomain.rst > @@ -8174,6 +8174,25 @@ Example: usage of the TPM Emulator > The default version used depends on the combination of hypervisor, > guest > architecture, TPM model and backend. > > +``source`` > + The ``source`` element specifies the location of the TPM state > storage . This > + element only works with the ``emulator`` backend. > + > + If not specified, the storage configuration is left to libvirt > discretion. IMO it would be good to mention that it is up to the user to prevent files being used by multiple VMs, especially if locking cannot be used. > + > + This element requires that swtpm v0.7 or later is installed. > + > + The following attributes are supported: > + > + ``type`` > + The type of storage. It's possible to provide "file" to utilize a > single > + file or block device where the TPM state will be stored. > + > + ``path`` > + The path to the TPM state storage. > + > + :since:`Since v10.8.0` > + > ``persistent_state`` > The ``persistent_state`` attribute indicates whether 'swtpm' TPM > state is > kept or not when a transient domain is powered off or undefined. This > diff --git a/src/conf/domain_conf.c b/src/conf/domain_conf.c > index 284a3815b3..9dd8b6b55d 100644 > --- a/src/conf/domain_conf.c > +++ b/src/conf/domain_conf.c > @@ -1322,6 +1322,12 @@ VIR_ENUM_IMPL(virDomainTPMVersion, > "2.0", > ); > > +VIR_ENUM_IMPL(virDomainTPMSourceType, > + VIR_DOMAIN_TPM_SOURCE_TYPE_LAST, > + "default", > + "file", > +); > + > VIR_ENUM_IMPL(virDomainTPMPcrBank, > VIR_DOMAIN_TPM_PCR_BANK_LAST, > "sha1", > @@ -10784,6 +10790,7 @@ virDomainTPMDefParseXML(virDomainXMLOption *xmlopt, > int nbackends; > int nnodes; > size_t i; > + xmlNodePtr source_node = NULL; > g_autofree char *path = NULL; > g_autofree char *secretuuid = NULL; > g_autofree char *persistent_state = NULL; > @@ -10857,6 +10864,22 @@ virDomainTPMDefParseXML(virDomainXMLOption *xmlopt, > def->data.emulator.hassecretuuid = true; > } > > + source_node = virXPathNode("./backend/source", ctxt); > + if (source_node) { > + if (virXMLPropEnum(source_node, "type", > + virDomainTPMSourceTypeTypeFromString, > + VIR_XML_PROP_NONZERO, > + &def->data.emulator.source_type) < 0) > + goto error; > + path = virXMLPropString(source_node, "path"); > + if (!path) { > + virReportError(VIR_ERR_XML_ERROR, "%s", > + _("missing TPM source path")); > + goto error; > + } > + def->data.emulator.source_path = g_steal_pointer(&path); > + } > + > persistent_state = virXMLPropString(backends[0], > "persistent_state"); > if (persistent_state) { > if (virStringParseYesNo(persistent_state, > @@ -25070,6 +25093,11 @@ virDomainTPMDefFormat(virBuffer *buf, > > virXMLFormatElement(&backendChildBuf, "active_pcr_banks", > NULL, &activePcrBanksBuf); > } > + if (def->data.emulator.source_type != > VIR_DOMAIN_TPM_SOURCE_TYPE_DEFAULT) { > + virBufferAsprintf(&backendChildBuf, "<source type='%s'", > + > virDomainTPMSourceTypeTypeToString(def->data.emulator.source_type)); > + virBufferEscapeString(&backendChildBuf, " path='%s'/>\n", > def->data.emulator.source_path); > + } > break; > case VIR_DOMAIN_TPM_TYPE_EXTERNAL: > if (def->data.external.source->type == VIR_DOMAIN_CHR_TYPE_UNIX) { > diff --git a/src/conf/domain_conf.h b/src/conf/domain_conf.h > index 6b27322e3e..7a70f68177 100644 > --- a/src/conf/domain_conf.h > +++ b/src/conf/domain_conf.h > @@ -1463,6 +1463,13 @@ typedef enum { > VIR_DOMAIN_TPM_PCR_BANK_LAST > } virDomainPcrBank; > > +typedef enum { > + VIR_DOMAIN_TPM_SOURCE_TYPE_DEFAULT = 0, > + VIR_DOMAIN_TPM_SOURCE_TYPE_FILE, > + > + VIR_DOMAIN_TPM_SOURCE_TYPE_LAST > +} virDomainTPMSourceType; > + > #define VIR_DOMAIN_TPM_DEFAULT_DEVICE "/dev/tpm0" > > struct _virDomainTPMDef { > @@ -1478,6 +1485,7 @@ struct _virDomainTPMDef { > struct { > virDomainTPMVersion version; > virDomainChrSourceDef *source; > + virDomainTPMSourceType source_type; > char *source_path; > char *logfile; > unsigned int debug; > @@ -4277,6 +4285,7 @@ VIR_ENUM_DECL(virDomainRNGBackend); > VIR_ENUM_DECL(virDomainTPMModel); > VIR_ENUM_DECL(virDomainTPMBackend); > VIR_ENUM_DECL(virDomainTPMVersion); > +VIR_ENUM_DECL(virDomainTPMSourceType); > VIR_ENUM_DECL(virDomainTPMPcrBank); > VIR_ENUM_DECL(virDomainMemoryModel); > VIR_ENUM_DECL(virDomainMemoryBackingModel); > diff --git a/src/conf/schemas/domaincommon.rng > b/src/conf/schemas/domaincommon.rng > index efb5f00d77..72c8b6c694 100644 > --- a/src/conf/schemas/domaincommon.rng > +++ b/src/conf/schemas/domaincommon.rng > @@ -5923,6 +5923,7 @@ > <interleave> > <ref name="tpm-backend-emulator-encryption"/> > <ref name="tpm-backend-emulator-active-pcr-banks"/> > + <ref name="tpm-backend-emulator-source"/> > </interleave> > <optional> > <attribute name="persistent_state"> > @@ -5981,6 +5982,19 @@ > </optional> > </define> > > + <define name="tpm-backend-emulator-source"> > + <optional> > + <element name="source"> > + <attribute name="type"> > + <value>file</value> > + </attribute> > + <attribute name="path"> > + <ref name="filePath"/> Should probably be absFilePath? With this nit: Reviewed-by: Stefan Berger <stefanb(a)linux.ibm.com> > + </attribute> > + </element> > + </optional> > + </define> > + > <define name="tpm-backend-emulator-encryption"> > <optional> > <element name="encryption"> > diff --git a/tests/qemuxmlconfdata/tpm-emulator-tpm2.xml > b/tests/qemuxmlconfdata/tpm-emulator-tpm2.xml > index 8a613db456..3d6300f544 100644 > --- a/tests/qemuxmlconfdata/tpm-emulator-tpm2.xml > +++ b/tests/qemuxmlconfdata/tpm-emulator-tpm2.xml > @@ -34,6 +34,7 @@ > <sha256/> > <sha512/> > </active_pcr_banks> > + <source type='file' path='/path/to/state'/> > </backend> > </tpm> > <audio id='1' type='none'/> > -- > 2.47.0

1 0

[PATCH v4 0/6] Add TPM emulator <source type='file/dir' path='..'/>
by marcandre.lureau＠redhat.com 22 Oct '24

22 Oct '24

From: Marc-André Lureau <marcandre.lureau(a)redhat.com> Hi, When swtpm capabilities reports "nvram-backend-dir", it can accepts a single file or block device where TPM state will be stored. --tpmstate must be backend-uri=file://. v4: - add "qemu: explicit swtpm state locking" - add r-b from Stefan, first patch only atm v3: - changed to <source type='file/dir' path='..'/> v2: - add <source dir='..'/> support as well (Daniel) Related: https://issues.redhat.com/browse/CNV-35250 Marc-André Lureau (6): util: check swtpm nvram-backend-{dir,file} capabilities tpm: rename 'storagepath' to 'source_path' schema: add TPM emulator <source type='file' path='..'> schema: add TPM emulator <source type='dir' path='..'> qemu_tpm: handle file/block storage source qemu: explicit swtpm state locking docs/formatdomain.rst | 20 +++ src/conf/domain_conf.c | 31 ++++- src/conf/domain_conf.h | 12 +- src/conf/schemas/domaincommon.rng | 26 ++++ src/qemu/qemu_tpm.c | 115 +++++++++++++----- src/security/security_selinux.c | 6 +- src/util/virtpm.c | 3 + src/util/virtpm.h | 3 + .../qemuxmlconfdata/tpm-emulator-tpm2-enc.xml | 1 + tests/qemuxmlconfdata/tpm-emulator-tpm2.xml | 1 + tests/testutilsqemu.c | 1 + 11 files changed, 186 insertions(+), 33 deletions(-) -- 2.47.0

2 9