NVMe drive PCI passthrough and suprise hotplug

[Kalra, Ashish]

[AMD Official Use Only]

Hello Peter,

Thanks for your response, we will try with the latest fedora and possibly also with the latest libvirt 
and re-test.

Will reply with attached debug logs as mentioned below in case we still face the same issue
with re-testing.

Thanks,
Ashish

-----Original Message-----
From: Peter Krempa <pkrempa at redhat.com> 
Sent: Friday, February 4, 2022 3:21 AM
To: Kalra, Ashish <Ashish.Kalra at amd.com>
Cc: libvirt-users at redhat.com; Grimm, Jon <Jon.Grimm at amd.com>; Ma, Mang-kwan <Mang-kwan.Ma at amd.com>; Huang2, Wei <Wei.Huang2 at amd.com>
Subject: Re: NVMe drive PCI passthrough and suprise hotplug

On Thu, Feb 03, 2022 at 23:25:05 +0000, Kalra, Ashish wrote:
> [AMD Official Use Only]

Well, I hope it's okay to use it for libvirt officially too ;)

> 
> Hi,
> I am using Fedora 33, with the following KVM, qemu and libvirt versions:

Note that Fedora 33 is already end-of-life, it would be great if you can re-test with a more recent version

> QEMU 5.1.0
> libvirt 6.6.0

specifically this was released 1.5 years ago

> KVM 5.14.18
> 
> We have done pass-through of a PCIe NVMe device to the guest running 
> on FC33 using either virt-manager or virsh and then we do the 
> hot-unplug of the device while it is attached to the guest.
> 
> The device is no longer seen on the guest hardware device list on 
> virt-manager and then we hotplug the device again and we are able to 
> use it on the Host, but when we try to re-attach it to the guest, we get the following error message:
> 
> Requested operation is not valid, PCI device 0000:c4::00.0 is in use 
> by driver QEMU, Domain fedora 33.

[...]

Unfortunately the tracing you've done doesn't really help in seeing what gone wrong in libvirt.

Please attach debug logs per https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.libvirt.org%2Fkbase%2Fdebuglogs.html&data=04%7C01%7Cashish.kalra%40amd.com%7C5f355af2132945d794dd08d9e7bfa9a0%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637795632650001047%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=ksuLz1tv7dr3f3iq4v6RzQosU0Lq0pxXb11mJ7nJWfg%3D&reserved=0