[vfio-users] Something killed passthrough part 2

Mark kram321 at gmail.com
Sat Dec 30 06:48:46 UTC 2017


Recently I updated my arch linux machine and now passthrough is not working.

I've read these archives all the way back this thread, to no avail:
https://www.redhat.com/archives/vfio-users/2017-August/msg00021.html

Did a complete arch reinstall and got the code 10.  Have done a complete
fresh clean install of Fedora 27, enabled IOMMU/vfio-pci and all seems
valid, but I still am getting code 10 in windows 7 for my NVIDIA gpu.  I've
compared my xml to archived copies of the same VM xml and they are exact.
I'm starting over and have noticed if I add in the hyperv features it
crashes windows.  My current xml is at the bottom.

Please help!  If there is more info needed please ask and I will provide it.

Thanks

dmesg|grep -i vfio
[    0.000000] Command line:
BOOT_IMAGE=/boot/vmlinuz-4.14.8-300.fc27.x86_64 root=/dev/mapper/lvm-fedora
ro rd.lvm.lv=lvm/fedora rhgb quiet intel_iommu=on iommu=pt
rd.driver.pre=vfio-pci video=efifb:off
[    0.000000] Kernel command line:
BOOT_IMAGE=/boot/vmlinuz-4.14.8-300.fc27.x86_64 root=/dev/mapper/lvm-fedora
ro rd.lvm.lv=lvm/fedora rhgb quiet intel_iommu=on iommu=pt
rd.driver.pre=vfio-pci video=efifb:off
[    1.137465] VFIO - User Level meta-driver version: 0.3
[    1.144858] vfio-pci 0000:01:00.0: vgaarb: changed VGA decodes:
olddecodes=io+mem,decodes=none:owns=none
[    1.156103] vfio_pci: add [10de:1381[ffff:ffff]] class 0x000000/00000000
[    1.168073] vfio_pci: add [10de:0fbc[ffff:ffff]] class 0x000000/00000000
[    1.463371] vfio-pci 0000:01:00.0: vgaarb: changed VGA decodes:
olddecodes=none,decodes=none:owns=none
[ 2686.746442] vfio-pci 0000:01:00.0: enabling device (0000 -> 0003)
[ 2686.746603] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x1e at 0x258
[ 2686.746614] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19 at 0x900
[ 3416.041711] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x1e at 0x258
[ 3416.041721] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19 at 0x900
[ 3480.242986] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x1e at 0x258
[ 3480.242997] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19 at 0x900
[ 4590.475480] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x1e at 0x258
[ 4590.475492] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19 at 0x900

dmesg | grep -i iommu
[    0.000000] Command line:
BOOT_IMAGE=/boot/vmlinuz-4.14.8-300.fc27.x86_64 root=/dev/mapper/lvm-fedora
ro rd.lvm.lv=lvm/fedora rhgb quiet intel_iommu=on iommu=pt
rd.driver.pre=vfio-pci video=efifb:off
[    0.000000] Kernel command line:
BOOT_IMAGE=/boot/vmlinuz-4.14.8-300.fc27.x86_64 root=/dev/mapper/lvm-fedora
ro rd.lvm.lv=lvm/fedora rhgb quiet intel_iommu=on iommu=pt
rd.driver.pre=vfio-pci video=efifb:off
[    0.000000] DMAR: IOMMU enabled
[    0.021952] DMAR-IR: IOAPIC id 8 under DRHD base  0xfed91000 IOMMU 1
[    0.454780] iommu: Adding device 0000:00:00.0 to group 0
[    0.454789] iommu: Adding device 0000:00:01.0 to group 1
[    0.454794] iommu: Adding device 0000:00:02.0 to group 2
[    0.454800] iommu: Adding device 0000:00:14.0 to group 3
[    0.454807] iommu: Adding device 0000:00:16.0 to group 4
[    0.454811] iommu: Adding device 0000:00:19.0 to group 5
[    0.454816] iommu: Adding device 0000:00:1a.0 to group 6
[    0.454821] iommu: Adding device 0000:00:1b.0 to group 7
[    0.454826] iommu: Adding device 0000:00:1c.0 to group 8
[    0.454831] iommu: Adding device 0000:00:1c.3 to group 9
[    0.454836] iommu: Adding device 0000:00:1d.0 to group 10
[    0.454846] iommu: Adding device 0000:00:1f.0 to group 11
[    0.454851] iommu: Adding device 0000:00:1f.2 to group 11
[    0.454855] iommu: Adding device 0000:00:1f.3 to group 11
[    0.454858] iommu: Adding device 0000:01:00.0 to group 1
[    0.454861] iommu: Adding device 0000:01:00.1 to group 1
[    0.454866] iommu: Adding device 0000:03:00.0 to group 12

for d in /sys/kernel/iommu_groups/*/devices/*; do
 n=${d#*/iommu_groups/*}; n=${n%%/*};     printf 'IOMMU Group %s ' "$n";
  lspci -nns "${d##*/}"; done;
...
IOMMU Group 1 00:01.0 PCI bridge [0604]: Intel Corporation Xeon E3-1200
v3/4th Gen Core Processor PCI Express x16 Controller [8086:0c01] (rev 06)
IOMMU Group 1 01:00.0 VGA compatible controller [0300]: NVIDIA Corporation
GM107 [GeForce GTX 750] [10de:1381] (rev a2)
IOMMU Group 1 01:00.1 Audio device [0403]: NVIDIA Corporation Device
[10de:0fbc] (rev a1)
...

lspci -nnk -s 1:00.0
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GM107 [GeForce
GTX 750] [10de:1381] (rev a2)
Subsystem: Gigabyte Technology Co., Ltd Device [1458:3642]
Kernel driver in use: vfio-pci
Kernel modules: nouveau

Here is my current xml:

<<domain type='kvm'>
  <name>win7</name>
  <uuid>02fd1aa7-835d-4911-badf-69dd49ba8722</uuid>
  <memory unit='KiB'>4194304</memory>
  <currentMemory unit='KiB'>4194304</currentMemory>
  <vcpu placement='static'>4</vcpu>
  <os>
    <type arch='x86_64' machine='pc-i440fx-2.10'>hvm</type>
    <loader readonly='yes'
type='pflash'>/usr/share/edk2/ovmf/OVMF_CODE.fd</loader>
    <nvram>/var/lib/libvirt/qemu/nvram/win7_VARS.fd</nvram>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <kvm>
      <hidden state='on'/>
    </kvm>
    <vmport state='off'/>
  </features>
  <cpu mode='custom' match='exact' check='partial'>
    <model fallback='allow'>Haswell-noTSX</model>
    <topology sockets='1' cores='4' threads='1'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <pm>
    <suspend-to-mem enabled='no'/>
    <suspend-to-disk enabled='no'/>
  </pm>
  <devices>
    <emulator>/usr/bin/qemu-kvm</emulator>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw' cache='none' io='native'/>
      <source dev='/dev/mapper/lvm-win7'/>
      <target dev='hda' bus='ide'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/OS-ISO/X17-58997.iso'/>
      <target dev='hdb' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='0' target='0' unit='1'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03'
function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03'
function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03'
function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03'
function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pci-root'/>
    <controller type='ide' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01'
function='0x1'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04'
function='0x0'/>
    </controller>
    <serial type='pty'>
      <target port='0'/>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='spicevmc'>
      <target type='virtio' name='com.redhat.spice.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='tablet' bus='usb'>
      <address type='usb' bus='0' port='1'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <graphics type='spice' autoport='yes'>
      <listen type='address'/>
      <image compression='off'/>
    </graphics>
    <video>
      <model type='qxl' ram='65536' vram='65536' vgamem='16384' heads='1'
primary='yes'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02'
function='0x0'/>
    </video>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06'
function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07'
function='0x0'/>
    </hostdev>
    <redirdev bus='usb' type='spicevmc'>
      <address type='usb' bus='0' port='2'/>
    </redirdev>
    <redirdev bus='usb' type='spicevmc'>
      <address type='usb' bus='0' port='3'/>
    </redirdev>
    <memballoon model='virtio'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
function='0x0'/>
    </memballoon>
  </devices>
</domain>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20171229/e8ddaa10/attachment.htm>


More information about the vfio-users mailing list