<div dir="ltr"><div>I expect Alex to find it's a BIOS bug. Also, the ACS patch does allow the groups to be made separating the GPUs(Wendell reported it didn't work), but I haven't gotten around to testing actual passthrough to see if there's some other issue(Maybe this is what he meant). I'll report if it works tomorrow. </div></div><div class="gmail_extra"> <div class="gmail_quote">On Thu, Mar 9, 2017 at 2:14 AM, <a href="mailto:Taiidan@gmx.com">Taiidan@gmx.com</a> <<a href="mailto:Taiidan@gmx.com" target="_blank">Taiidan@gmx.com</a>> wrote: <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000"><div><div class="h5"> On 03/09/2017 12:30 AM, Nick Sarnie wrote: </div></div><blockquote type="cite"><div><div class="h5"> <pre>Hi all, My Ryzen stuff finally arrived, so I can help get GPU Passthrough working. My CPU is the 1800X and my motherboard is the Asus Prime X370-Pro. I'm on kernel 4.10.1. The IOMMU groups are indeed bad: <a class="m_-49494059267293011moz-txt-link-freetext" href="https://paste.pound-python.org/show/LGsNqdfIO3xWNNv9Mslr/" target="_blank">https://paste.pound-python.org/show/LGsNqdfIO3xWNNv9Mslr/</a> As you can see, the graphics cards are grouped together. Alex, I've linked lspci -xxx -vvv and dmesg below. Please let me know if you see anything, or need any more information. lspci: <a class="m_-49494059267293011moz-txt-link-freetext" href="https://paste.pound-python.org/show/iOgBaLrDZEGefuJjZlgy/" target="_blank">https://paste.pound-python.org/show/iOgBaLrDZEGefuJjZlgy/</a> dmesg: <a class="m_-49494059267293011moz-txt-link-freetext" href="https://paste.pound-python.org/show/3eevItiXBhgCjwDXVxQX/" target="_blank">https://paste.pound-python.org/show/3eevItiXBhgCjwDXVxQX/</a> Thanks, Sarnex </pre> <fieldset class="m_-49494059267293011mimeAttachmentHeader"></fieldset> </div></div><pre>_______________________________________________ vfio-users mailing list <a class="m_-49494059267293011moz-txt-link-abbreviated" href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a> <a class="m_-49494059267293011moz-txt-link-freetext" href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a> </pre> </blockquote> I hope this is just a bug and that AMD isn't going the intel route with making ACS a "server" feature. In comparison, my bulldozer rig with a SR5690 chipset where there is a turkey for every pot. /sys/kernel/iommu_groups/ /sys/kernel/iommu_groups/7 /sys/kernel/iommu_groups/7/devices /sys/kernel/iommu_groups/7/devices/0000:00:14.4 (7 is a pci bridge and onboard pci device) /sys/kernel/iommu_groups/7/devices/0000:08:01.0 /sys/kernel/iommu_groups/5 /sys/kernel/iommu_groups/5/devices /sys/kernel/iommu_groups/5/devices/0000:00:14.2 /sys/kernel/iommu_groups/3 /sys/kernel/iommu_groups/3/devices /sys/kernel/iommu_groups/3/devices/0000:00:14.0 /sys/kernel/iommu_groups/11 /sys/kernel/iommu_groups/11/devices /sys/kernel/iommu_groups/11/devices/0000:04:00.0 /sys/kernel/iommu_groups/1 /sys/kernel/iommu_groups/1/devices /sys/kernel/iommu_groups/1/devices/0000:00:12.2 (usb controller set) /sys/kernel/iommu_groups/1/devices/0000:00:12.0 /sys/kernel/iommu_groups/1/devices/0000:00:12.1 /sys/kernel/iommu_groups/8 /sys/kernel/iommu_groups/8/devices /sys/kernel/iommu_groups/8/devices/0000:00:14.5 /sys/kernel/iommu_groups/6 /sys/kernel/iommu_groups/6/devices /sys/kernel/iommu_groups/6/devices/0000:00:14.3 /sys/kernel/iommu_groups/4 /sys/kernel/iommu_groups/4/devices /sys/kernel/iommu_groups/4/devices/0000:00:14.1 /sys/kernel/iommu_groups/12 /sys/kernel/iommu_groups/12/devices /sys/kernel/iommu_groups/12/devices/0000:05:00.0 (video card and audio device) /sys/kernel/iommu_groups/12/devices/0000:05:00.1 /sys/kernel/iommu_groups/2 /sys/kernel/iommu_groups/2/devices /sys/kernel/iommu_groups/2/devices/0000:00:13.1 (other usb controller set) /sys/kernel/iommu_groups/2/devices/0000:00:13.2 /sys/kernel/iommu_groups/2/devices/0000:00:13.0 /sys/kernel/iommu_groups/10 /sys/kernel/iommu_groups/10/devices /sys/kernel/iommu_groups/10/devices/0000:03:00.0 /sys/kernel/iommu_groups/0 /sys/kernel/iommu_groups/0/devices /sys/kernel/iommu_groups/0/devices/0000:00:11.0 /sys/kernel/iommu_groups/9 /sys/kernel/iommu_groups/9/devices /sys/kernel/iommu_groups/9/devices/0000:01:00.0 </div> </blockquote></div> </div>