[vfio-users] RX580 pcie vfio passtrough is not redirected correctly since updates

[Th3R3al]

Hey VFIO-Users and supporters,

since april I am a happy user of vfio and graphics card redirection to
Windows 10 Pro. Since the last updates I got some trouble with my setup,
that the windows vm is crashing if there is a driver and the RX 580 is
passtroughed to it.

For troubleshooting purposes I installed a fresh new Windows 8.1 Pro
machine, there the driver cant get installed because the driver setup
seems to find the wrong pci ven / pci device numbers.

The RX580 is also only detected as a "Microsoft Basic Graphics Adapter".

My old setup which was working fine for months look like this in xml and
is generated from libvirt-manager:

<domain type='kvm'>
 <name>Passtrough</name>
 <uuid>76ad470f-e9df-48bd-9b77-abee61582fe2</uuid>
 <memory unit='KiB'>8388608</memory>
 <currentMemory unit='KiB'>8388608</currentMemory>
 <memoryBacking>
   <hugepages/>
 </memoryBacking>
 <vcpu placement='static'>6</vcpu>
 <os>
   <type arch='x86_64' machine='pc-i440fx-zesty'>hvm</type>
   <loader readonly='yes'
type='pflash'>/usr/share/OVMF/OVMF_CODE.fd</loader>
   <nvram>/var/lib/libvirt/qemu/nvram/Passtrough_VARS.fd</nvram>
   <bootmenu enable='yes'/>
 </os>
 <features>
   <acpi/>
   <apic/>
   <hyperv>
     <relaxed state='on'/>
     <vapic state='on'/>
     <spinlocks state='on' retries='8191'/>
   </hyperv>
   <kvm>
     <hidden state='on'/>
   </kvm>
 </features>
 <cpu mode='custom' match='exact'>
   <model fallback='allow'>Skylake-Client</model>
   <topology sockets='1' cores='6' threads='1'/>
 </cpu>
 <clock offset='localtime'>
   <timer name='rtc' tickpolicy='catchup'/>
   <timer name='pit' tickpolicy='delay'/>
   <timer name='hpet' present='no'/>
   <timer name='hypervclock' present='yes'/>
 </clock>
 <on_poweroff>destroy</on_poweroff>
 <on_reboot>restart</on_reboot>
 <on_crash>restart</on_crash>
 <pm>
   <suspend-to-mem enabled='no'/>
   <suspend-to-disk enabled='no'/>
 </pm>
 <devices>
   <emulator>/usr/bin/kvm-spice</emulator>
   <disk type='file' device='disk'>
     <driver name='qemu' type='qcow2' cache='writeback'/>
     <source file='/mnt/blue/kvm-data/win-data.qcow2'/>
     <target dev='vda' bus='virtio'/>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x08'
function='0x0'/>
   </disk>
   <disk type='file' device='disk'>
     <driver name='qemu' type='qcow2' cache='writeback'/>
     <source file='/var/lib/libvirt/images/Passtrough.qcow2'/>
     <target dev='vdb' bus='virtio'/>
     <boot order='1'/>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
function='0x0'/>
   </disk>
   <disk type='file' device='disk'>
     <driver name='qemu' type='qcow2'/>
     <source file='/var/lib/libvirt/images/Passtrough-1.qcow2'/>
     <target dev='vdc' bus='virtio'/>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x0a'
function='0x0'/>
   </disk>
   <disk type='file' device='cdrom'>
     <driver name='qemu' type='raw'/>
     <source file='/home/brian/Downloads/virtio-win-0.1.126.iso'/>
     <target dev='sdb' bus='sata'/>
     <readonly/>
     <address type='drive' controller='0' bus='0' target='0' unit='1'/>
   </disk>
   <controller type='pci' index='0' model='pci-root'/>
   <controller type='sata' index='0'>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x06'
function='0x0'/>
   </controller>
   <controller type='usb' index='0' model='ich9-ehci1'>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x02'
function='0x7'/>
   </controller>
   <controller type='usb' index='0' model='ich9-uhci1'>
     <master startport='0'/>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x02'
function='0x0' multifunction='on'/>
   </controller>
   <controller type='usb' index='0' model='ich9-uhci2'>
     <master startport='2'/>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x02'
function='0x1'/>
   </controller>
   <controller type='usb' index='0' model='ich9-uhci3'>
     <master startport='4'/>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x02'
function='0x2'/>
   </controller>
   <input type='mouse' bus='ps2'/>
   <input type='keyboard' bus='ps2'/>
   <hostdev mode='subsystem' type='usb' managed='yes'>
     <source>
       <vendor id='0x045e'/>
       <product id='0x0084'/>
     </source>
     <address type='usb' bus='0' port='1'/>
   </hostdev>
   <hostdev mode='subsystem' type='pci' managed='yes'>
     <source>
       <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
     </source>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x03'
function='0x0'/>
   </hostdev>
   <memballoon model='virtio'>
     <address type='pci' domain='0x0000' bus='0x00' slot='0x04'
function='0x0'/>
   </memballoon>
 </devices>
</domain>

(Dont be suprised, I also tried to passtrough both pci devices -> audio
and graphics, same issue).

Just sayin that I couldnt find any errors or syslog entrys in the logs.
My vfio setup seems also to be fine:

(dmesg | grep vfio)

Command line: BOOT_IMAGE=/vmlinuz-4.10.0-26-generic
root=/dev/mapper/ubuntu--mate--vg-root ro quiet splash intel_iommu=on
vfio_iommu_type1.allow_unsafe_interrupts=1
[    0.000000] Kernel command line:
BOOT_IMAGE=/vmlinuz-4.10.0-26-generic
root=/dev/mapper/ubuntu--mate--vg-root ro quiet splash intel_iommu=on
vfio_iommu_type1.allow_unsafe_interrupts=1
[   57.925247] vfio-pci 0000:01:00.0: vgaarb: changed VGA decodes:
olddecodes=io+mem,decodes=io+mem:owns=none
[   57.944392] vfio_pci: add [1002:67df[ffff:ffff]] class 0x000000/00000000
[   57.964435] vfio_pci: add [1002:aaf0[ffff:ffff]] class 0x000000/00000000
[   58.599615] vfio-pci 0000:01:00.0: vgaarb: changed VGA decodes:
olddecodes=io+mem,decodes=io+mem:owns=none

The funny thing is, the audio device is correctly detected from the
driver. I also opened a thread on the vfio-subreddit and got redirected
to you guys.

https://www.reddit.com/r/VFIO/comments/6p6m2n/pcie_passtrough_failing_since_latest_updates_amd/

Any help is highly appreciated.

Regards

Th3R3al