[vfio-users] Trying to get PCI Express pass though working VFIO, Proxmox, AMD CPU, Nvidia Graphics

Sat Jan 16 22:06:30 UTC 2016

Hi firstly thanks so much for taking the time to read this and that this
list is available!

I'm trying to get 3d pass through on the following equipmentfor the purpose
of finally moving my last remaining windows box into VM for the purpose of
steam streaming the last games I want to play and a bit of power shell
study for work.

Sabertooth 990FX Mobo (Rev 1)

AMD FX8120

32 GB Ram

Host Graphics card: 01:00.0 VGA compatible controller [0300]: NVIDIA
Corporation GT218 [GeForce 210] [10de:0a65] (rev a2)

Guest Graphics card: 0a:00.0 VGA compatible controller [0300]: NVIDIA
Corporation GK104 [GeForce GTX 660 Ti] [10de:1183] (rev a1)

Hypervisor OS: Proxmox 3.x.x

Kernel 3.10.0-1-pve

Guest Os Windows 10 pro

1 wd black drive hypervisor and vm storage.

I also have a zfs pool 12tb in the same set up that is shared out to vms
and network via samba and nfs.

I get this error in dmesg | grep vfio

[ 19.208804] vfio_pci: Unknown parameter `ids'

But I've put the correct id's in to /etc/modprobe.d/vifo.conf

echo "options vfio-pci ids=10de:1183,10de:0e0a" > /etc/modprobe.d/vfio.conf

root at determinist:/home/iluciv# lspci -nnk | grep NVIDIA

01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GT218 [GeForce
210] [10de:0a65] (rev a2)

01:00.1 Audio device [0403]: NVIDIA Corporation High Definition Audio
Controller [10de:0be3] (rev a1)

0a:00.0 VGA compatible controller [0300]: NVIDIA Corporation GK104 [GeForce
GTX 660 Ti] [10de:1183] (rev a1)

0a:00.1 Audio device [0403]: NVIDIA Corporation GK104 HDMI Audio Controller
[10de:0e0a] (rev a1)

Note the GT218 is the host's graphics card (all I had to plug in)

I've followed the 3d pass through section on the proxmox wiki and I'm up to
this point

I've installed the windows 10 vm and I'm not yet using the virtio drivers
(was complaining about them not being signed)

When I go to power up the VM I get the following error in the proxmox gui.

kvm: -device
vfio-pci,host=0a:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,x-vga=on,multifunction=on:
vfio: error opening /dev/vfio/25: No such file or directory
kvm: -device
vfio-pci,host=0a:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,x-vga=on,multifunction=on:
vfio: failed to get group 25
kvm: -device
vfio-pci,host=0a:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,x-vga=on,multifunction=on:
Device initialization failed.
kvm: -device
vfio-pci,host=0a:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,x-vga=on,multifunction=on:
Device 'vfio-pci' could not be initialized
TASK ERROR: start failed: command '/usr/bin/kvm -id 106 -chardev
'socket,id=qmp,path=/var/run/qemu-server/106.qmp,server,nowait' -mon
'chardev=qmp,mode=control' -vnc
unix:/var/run/qemu-server/106.vnc,x509,password -pidfile
/var/run/qemu-server/106.pid -daemonize -smbios
'type=1,uuid=0f2624f4-31c0-4abc-9c00-ff8da83e300c' -name WIn10.GPU1 -smp
'4,sockets=1,cores=4,maxcpus=4' -nodefaults -boot
'menu=on,strict=on,reboot-timeout=1000' -vga none -cpu
'kvm64,kvm=off,+lahf_lm,+x2apic,+sep' -m 16028 -k en-us -readconfig
/usr/share/qemu-server/pve-q35.cfg -device
'usb-tablet,id=tablet,bus=ehci.0,port=1' -device
'vfio-pci,host=0a:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,x-vga=on,multifunction=on'
-device
'vfio-pci,host=0a:00.1,id=hostpci0.1,bus=ich9-pcie-port-1,addr=0x0.1'
-device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' -iscsi
'initiator-name=iqn.1993-08.org.debian:01:c2e559d81e41' -drive
'file=/var/lib/vz/template/iso/virtio-win-0.1.112.iso,if=none,id=drive-ide0,media=cdrom,aio=native'
-device 'ide-cd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=200'
-drive
'file=/var/lib/vz/template/iso/Win10_1511_EnglishInternational_x64.iso,if=none,id=drive-ide2,media=cdrom,aio=native'
-device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=201'
-device 'ahci,id=ahci0,multifunction=on,bus=pci.0,addr=0x7' -drive
'file=/var/lib/vz/images/106/vm-106-disk-2.qcow2,if=none,id=drive-sata1,format=qcow2,aio=native,cache=none,detect-zeroes=on'
-device 'ide-drive,bus=ahci0.1,drive=drive-sata1,id=sata1' -netdev
'type=tap,id=net0,ifname=tap106i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown'
-device
'e1000,mac=EA:59:9F:3D:0A:B7,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300'
-rtc 'driftfix=slew,base=localtime' -machine 'type=q35'' failed: exit code 1

immou is enabled in the bios ( latest bios for that revision)

my immou groups

/sys/kernel/iommu_groups/0/devices/0000:00:00.0

/sys/kernel/iommu_groups/1/devices/0000:00:02.0

/sys/kernel/iommu_groups/2/devices/0000:00:04.0

/sys/kernel/iommu_groups/3/devices/0000:00:05.0

/sys/kernel/iommu_groups/4/devices/0000:00:06.0

/sys/kernel/iommu_groups/5/devices/0000:00:09.0

/sys/kernel/iommu_groups/6/devices/0000:00:0a.0

/sys/kernel/iommu_groups/7/devices/0000:00:0d.0

/sys/kernel/iommu_groups/8/devices/0000:00:11.0

/sys/kernel/iommu_groups/9/devices/0000:00:12.0

/sys/kernel/iommu_groups/9/devices/0000:00:12.2

/sys/kernel/iommu_groups/10/devices/0000:00:13.0

/sys/kernel/iommu_groups/10/devices/0000:00:13.2

/sys/kernel/iommu_groups/11/devices/0000:00:14.0

/sys/kernel/iommu_groups/12/devices/0000:00:14.2

/sys/kernel/iommu_groups/13/devices/0000:00:14.3

/sys/kernel/iommu_groups/14/devices/0000:00:14.4

/sys/kernel/iommu_groups/14/devices/0000:0b:07.0

/sys/kernel/iommu_groups/15/devices/0000:00:14.5

/sys/kernel/iommu_groups/16/devices/0000:00:16.0

/sys/kernel/iommu_groups/16/devices/0000:00:16.2

/sys/kernel/iommu_groups/17/devices/0000:01:00.0

/sys/kernel/iommu_groups/17/devices/0000:01:00.1

/sys/kernel/iommu_groups/18/devices/0000:02:00.0

/sys/kernel/iommu_groups/19/devices/0000:03:00.0

/sys/kernel/iommu_groups/20/devices/0000:04:00.0

/sys/kernel/iommu_groups/21/devices/0000:05:00.0

/sys/kernel/iommu_groups/22/devices/0000:06:00.0

/sys/kernel/iommu_groups/23/devices/0000:07:00.0

/sys/kernel/iommu_groups/23/devices/0000:08:00.0

/sys/kernel/iommu_groups/23/devices/0000:08:00.1

/sys/kernel/iommu_groups/24/devices/0000:07:01.0

/sys/kernel/iommu_groups/24/devices/0000:09:00.0

/sys/kernel/iommu_groups/24/devices/0000:09:00.1

/sys/kernel/iommu_groups/25/devices/0000:0a:00.0

/sys/kernel/iommu_groups/25/devices/0000:0a:00.1

Can only see the graphics card in group 25

Not Sure where to go from here the amd cpu chip part of the proxmox pcie
passthough page had information that about the error but when I went back
to read it the page had been updated and it's no longer there?

It should be possible to use vfio and this version proxmox and kernel, yes?
Should I upgrade to proxmox 4 or use something else entirely (quite like
proxmox though to be honest)  ?

Any help or pointers would be greatly appreciated

Thanks!

-- 
Sincerely

Lewis Cividin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20160117/99568a15/attachment.htm>