<html><head></head><body><div>I can confirm the ACS patch works. Both of my cards are now in separate iommu groups and running a Windows 10 VM with the Geforce passed through works just fine.</div><div><br></div><div>AVIC also works. My BIOS doesn't have any options related to it, passing kvm_amd.avic=1 is enough to enable it.</div><div><br></div><div>dmesg: <a href="https://paste.pound-python.org/show/5Ke182Hz0tvA22lrSlRZ/">https://paste.pound-python.org/show/5Ke182Hz0tvA22lrSlRZ/</a></div><div>lspci: <a href="https://paste.pound-python.org/show/mSBL0xwMpfO1Lp1Eu9BG/">https://paste.pound-python.org/show/mSBL0xwMpfO1Lp1Eu9BG/</a></div><div><br></div><div>Regards,</div><div>Friedrich</div><div><br></div><div>On Thu, 2017-03-09 at 02:33 -0500, Nick Sarnie wrote:</div><blockquote type="cite"><div dir="ltr"><div>I expect Alex to find it's a BIOS bug. Also, the ACS patch does allow the groups to be made separating the GPUs(Wendell reported it didn't work), but I haven't gotten around to testing actual passthrough to see if there's some other issue(Maybe this is what he meant). I'll report if it works tomorrow.<br><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Mar 9, 2017 at 2:14 AM, <a href="mailto:Taiidan@gmx.com">Taiidan@gmx.com</a> <span dir="ltr"><<a href="mailto:Taiidan@gmx.com" target="_blank">Taiidan@gmx.com</a>></span> wrote:<br><blockquote type="cite">
<div bgcolor="#FFFFFF" text="#000000"><div><div class="h5">
<p>On 03/09/2017 12:30 AM, Nick Sarnie wrote:<br>
</p>
</div></div><blockquote type="cite"><div><div class="h5">
<pre>Hi all,
My Ryzen stuff finally arrived, so I can help get GPU Passthrough working.
My CPU is the 1800X and my motherboard is the Asus Prime X370-Pro.
I'm on kernel 4.10.1.
The IOMMU groups are indeed bad:
<a class="m_-49494059267293011moz-txt-link-freetext" href="https://paste.pound-python.org/show/LGsNqdfIO3xWNNv9Mslr/" target="_blank">https://paste.pound-python.<wbr>org/show/LGsNqdfIO3xWNNv9Mslr/</a>
As you can see, the graphics cards are grouped together.
Alex, I've linked lspci -xxx -vvv and dmesg below. Please let me know if
you see anything, or need any more information.
lspci: <a class="m_-49494059267293011moz-txt-link-freetext" href="https://paste.pound-python.org/show/iOgBaLrDZEGefuJjZlgy/" target="_blank">https://paste.pound-python.<wbr>org/show/iOgBaLrDZEGefuJjZlgy/</a>
dmesg: <a class="m_-49494059267293011moz-txt-link-freetext" href="https://paste.pound-python.org/show/3eevItiXBhgCjwDXVxQX/" target="_blank">https://paste.pound-python.<wbr>org/show/3eevItiXBhgCjwDXVxQX/</a>
Thanks,
Sarnex
</pre>
<br>
<fieldset class="m_-49494059267293011mimeAttachmentHeader"></fieldset>
<br>
</div></div><pre>______________________________<wbr>_________________
vfio-users mailing list
<a class="m_-49494059267293011moz-txt-link-abbreviated" href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a>
<a class="m_-49494059267293011moz-txt-link-freetext" href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/<wbr>mailman/listinfo/vfio-users</a>
</pre>
</blockquote>
<br>
I hope this is just a bug and that AMD isn't going the intel route
with making ACS a "server" feature.<br>
<br>
In comparison, my bulldozer rig with a SR5690 chipset where there is
a turkey for every pot.<br>
<br>
/sys/kernel/iommu_groups/<br>
/sys/kernel/iommu_groups/7<br>
/sys/kernel/iommu_groups/7/<wbr>devices<br>
/sys/kernel/iommu_groups/7/<wbr>devices/0000:00:14.4 (7 is a pci bridge
and onboard pci device)<br>
/sys/kernel/iommu_groups/7/<wbr>devices/0000:08:01.0<br>
/sys/kernel/iommu_groups/5<br>
/sys/kernel/iommu_groups/5/<wbr>devices<br>
/sys/kernel/iommu_groups/5/<wbr>devices/0000:00:14.2<br>
/sys/kernel/iommu_groups/3<br>
/sys/kernel/iommu_groups/3/<wbr>devices<br>
/sys/kernel/iommu_groups/3/<wbr>devices/0000:00:14.0<br>
/sys/kernel/iommu_groups/11<br>
/sys/kernel/iommu_groups/11/<wbr>devices<br>
/sys/kernel/iommu_groups/11/<wbr>devices/0000:04:00.0<br>
/sys/kernel/iommu_groups/1<br>
/sys/kernel/iommu_groups/1/<wbr>devices<br>
/sys/kernel/iommu_groups/1/<wbr>devices/0000:00:12.2 (usb controller set)<br>
/sys/kernel/iommu_groups/1/<wbr>devices/0000:00:12.0<br>
/sys/kernel/iommu_groups/1/<wbr>devices/0000:00:12.1<br>
/sys/kernel/iommu_groups/8<br>
/sys/kernel/iommu_groups/8/<wbr>devices<br>
/sys/kernel/iommu_groups/8/<wbr>devices/0000:00:14.5<br>
/sys/kernel/iommu_groups/6<br>
/sys/kernel/iommu_groups/6/<wbr>devices<br>
/sys/kernel/iommu_groups/6/<wbr>devices/0000:00:14.3<br>
/sys/kernel/iommu_groups/4<br>
/sys/kernel/iommu_groups/4/<wbr>devices<br>
/sys/kernel/iommu_groups/4/<wbr>devices/0000:00:14.1<br>
/sys/kernel/iommu_groups/12<br>
/sys/kernel/iommu_groups/12/<wbr>devices<br>
/sys/kernel/iommu_groups/12/<wbr>devices/0000:05:00.0 (video card and
audio device)<br>
/sys/kernel/iommu_groups/12/<wbr>devices/0000:05:00.1<br>
/sys/kernel/iommu_groups/2<br>
/sys/kernel/iommu_groups/2/<wbr>devices<br>
/sys/kernel/iommu_groups/2/<wbr>devices/0000:00:13.1 (other usb
controller set)<br>
/sys/kernel/iommu_groups/2/<wbr>devices/0000:00:13.2<br>
/sys/kernel/iommu_groups/2/<wbr>devices/0000:00:13.0<br>
/sys/kernel/iommu_groups/10<br>
/sys/kernel/iommu_groups/10/<wbr>devices<br>
/sys/kernel/iommu_groups/10/<wbr>devices/0000:03:00.0<br>
/sys/kernel/iommu_groups/0<br>
/sys/kernel/iommu_groups/0/<wbr>devices<br>
/sys/kernel/iommu_groups/0/<wbr>devices/0000:00:11.0<br>
/sys/kernel/iommu_groups/9<br>
/sys/kernel/iommu_groups/9/<wbr>devices<br>
/sys/kernel/iommu_groups/9/<wbr>devices/0000:01:00.0<br>
<br>
</div>
<br></blockquote></div><br></div>
<pre>_______________________________________________
vfio-users mailing list
<a href="mailto:vfio-users@redhat.com">vfio-users@redhat.com</a>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users">https://www.redhat.com/mailman/listinfo/vfio-users</a>
</pre></blockquote></body></html>