On Fri, Nov 04, 2022 at 03:01:38PM +0100, Denis V. Lunev wrote:
On 11/4/22 14:41, Daniel P. Berrangé wrote:
On Fri, Nov 04, 2022 at 01:03:52PM +0100, Peter Krempa wrote:
On Fri, Nov 04, 2022 at 16:43:00 +0600, Oleg Vasilev wrote:
Hotplugging PCI devices on pc-i440fx machines is supported without additional configuration. On q35, pcie-to-pci-bridge needs to be added prior to the machine startup in order to support hotplug [1].
The idea is to support the same workflow for creating VMs in q35, as was in pc. Namely, do not require additional configuration when hotplugging is needed. Otherwise, all libvirt clients need to be updated which there are a lot and they are maintained by different parties.
Instead, a pcie-to-pci-bridge better be created by default, so that PCI slots are readily available. Might be a good idea to make it configurable in the future. The goal of q35 is to provide a PCI-e topology though, and we want devices to be exposed as PCI-e endpoints, with no legacy PCI usage by default.
When a guest XML is provided for cold boot, libvirt will ensure that all devices are placed onto the PCI-e bus via pcie-root-ports
With this proposal hotplugging a device will cause it to be placed on a PCI bus instead, if there are no spare pcie-root-port available.
This behavioural difference between cold plug and hot plug is very undesirable IMHO, as it is counter to our goal of avoiding legacy PCI on PCI-e machines.
that is an interesting point which I have initially missed. I have checked our investigation log and found that we have potentially made a mistake with making compatibility check with e1000 device instead of virtio, which is our default. This could be the reason.
virtio devices are particularly sensitive to PCI vs PCI-e placement, because if placed on PCI, they get setup in transitional-mode, where they advertize the legacy PCI IDs and virtio 0.9/1.0 is negotiated, while if placed on PCI-E, they get unconditionally setup in modern mode with the modern PCI IDs and virtio 1.0 only. With regards, Daniel -- |: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|