[vfio-users] Ryzen/X370 Chipset and IOMMU Groups

[Friedrich Oslage]

I can confirm the ACS patch works. Both of my cards are now in separate
iommu groups and running a Windows 10 VM with the Geforce passed
through works just fine.
AVIC also works. My BIOS doesn't have any options related to it,
passing kvm_amd.avic=1 is enough to enable it.
dmesg: https://paste.pound-python.org/show/5Ke182Hz0tvA22lrSlRZ/lspci:
https://paste.pound-python.org/show/mSBL0xwMpfO1Lp1Eu9BG/
Regards,Friedrich
On Thu, 2017-03-09 at 02:33 -0500, Nick Sarnie wrote:
> I expect Alex to find it's a BIOS bug. Also, the ACS patch does allow
> the groups to be made separating the GPUs(Wendell reported it didn't
> work), but I haven't gotten around to testing actual passthrough to
> see if there's some other issue(Maybe this is what he meant). I'll
> report if it works tomorrow.
> 
> 
> 
> On Thu, Mar 9, 2017 at 2:14 AM, Taiidan at gmx.com <Taiidan at gmx.com>
> wrote:
> >   
> >     
> >   
> >   
> >     On 03/09/2017 12:30 AM, Nick Sarnie wrote:
> > 
> >     
> >     
> > >       Hi all,
> > > My Ryzen stuff finally arrived, so I can help get GPU Passthrough
> > > working.
> > > My CPU is the 1800X and my motherboard is the Asus Prime X370-
> > > Pro.
> > > 
> > > I'm on kernel 4.10.1.
> > > 
> > > The IOMMU groups are indeed bad:
> > > https://paste.pound-python.org/show/LGsNqdfIO3xWNNv9Mslr/
> > > 
> > > As you can see, the graphics cards are grouped together.
> > > 
> > > Alex, I've linked lspci -xxx -vvv and dmesg below. Please let me
> > > know if
> > > you see anything, or need any more information.
> > > 
> > > lspci: https://paste.pound-python.org/show/iOgBaLrDZEGefuJjZlgy/
> > > 
> > > dmesg: https://paste.pound-python.org/show/3eevItiXBhgCjwDXVxQX/
> > > 
> > > 
> > > Thanks,
> > > Sarnex
> > > 
> > > 
> > >       
> > > 
> > >       
> > >       
> > > 
> > >       _______________________________________________
> > > vfio-users mailing list
> > > vfio-users at redhat.com
> > > https://www.redhat.com/mailman/listinfo/vfio-users
> > > 
> > >     
> > 
> >     
> > 
> >     I hope this is just a bug and that AMD isn't going the intel
> > route
> >     with making ACS a "server" feature.
> > 
> >     
> > 
> >     In comparison, my bulldozer rig with a SR5690 chipset where
> > there is
> >     a turkey for every pot.
> > 
> >     
> > 
> >     /sys/kernel/iommu_groups/
> > 
> >     /sys/kernel/iommu_groups/7
> > 
> >     /sys/kernel/iommu_groups/7/devices
> > 
> >     /sys/kernel/iommu_groups/7/devices/0000:00:14.4 (7 is a pci
> > bridge
> >     and onboard pci device)
> > 
> >     /sys/kernel/iommu_groups/7/devices/0000:08:01.0
> > 
> >     /sys/kernel/iommu_groups/5
> > 
> >     /sys/kernel/iommu_groups/5/devices
> > 
> >     /sys/kernel/iommu_groups/5/devices/0000:00:14.2
> > 
> >     /sys/kernel/iommu_groups/3
> > 
> >     /sys/kernel/iommu_groups/3/devices
> > 
> >     /sys/kernel/iommu_groups/3/devices/0000:00:14.0
> > 
> >     /sys/kernel/iommu_groups/11
> > 
> >     /sys/kernel/iommu_groups/11/devices
> > 
> >     /sys/kernel/iommu_groups/11/devices/0000:04:00.0
> > 
> >     /sys/kernel/iommu_groups/1
> > 
> >     /sys/kernel/iommu_groups/1/devices
> > 
> >     /sys/kernel/iommu_groups/1/devices/0000:00:12.2 (usb controller
> > set)
> > 
> >     /sys/kernel/iommu_groups/1/devices/0000:00:12.0
> > 
> >     /sys/kernel/iommu_groups/1/devices/0000:00:12.1
> > 
> >     /sys/kernel/iommu_groups/8
> > 
> >     /sys/kernel/iommu_groups/8/devices
> > 
> >     /sys/kernel/iommu_groups/8/devices/0000:00:14.5
> > 
> >     /sys/kernel/iommu_groups/6
> > 
> >     /sys/kernel/iommu_groups/6/devices
> > 
> >     /sys/kernel/iommu_groups/6/devices/0000:00:14.3
> > 
> >     /sys/kernel/iommu_groups/4
> > 
> >     /sys/kernel/iommu_groups/4/devices
> > 
> >     /sys/kernel/iommu_groups/4/devices/0000:00:14.1
> > 
> >     /sys/kernel/iommu_groups/12
> > 
> >     /sys/kernel/iommu_groups/12/devices
> > 
> >     /sys/kernel/iommu_groups/12/devices/0000:05:00.0 (video card
> > and
> >     audio device)
> > 
> >     /sys/kernel/iommu_groups/12/devices/0000:05:00.1
> > 
> >     /sys/kernel/iommu_groups/2
> > 
> >     /sys/kernel/iommu_groups/2/devices
> > 
> >     /sys/kernel/iommu_groups/2/devices/0000:00:13.1 (other usb
> >     controller set)
> > 
> >     /sys/kernel/iommu_groups/2/devices/0000:00:13.2
> > 
> >     /sys/kernel/iommu_groups/2/devices/0000:00:13.0
> > 
> >     /sys/kernel/iommu_groups/10
> > 
> >     /sys/kernel/iommu_groups/10/devices
> > 
> >     /sys/kernel/iommu_groups/10/devices/0000:03:00.0
> > 
> >     /sys/kernel/iommu_groups/0
> > 
> >     /sys/kernel/iommu_groups/0/devices
> > 
> >     /sys/kernel/iommu_groups/0/devices/0000:00:11.0
> > 
> >     /sys/kernel/iommu_groups/9
> > 
> >     /sys/kernel/iommu_groups/9/devices
> > 
> >     /sys/kernel/iommu_groups/9/devices/0000:01:00.0
> > 
> >     
> > 
> >   
> > 
> > 
> 
> _______________________________________________
> vfio-users mailing list
> vfio-users at redhat.com
> https://www.redhat.com/mailman/listinfo/vfio-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20170323/9600f732/attachment.htm>