[vfio-users] Passthru problems with a Vega GPU

[James Courtier-Dutton]

lspci -vvv on host:
43:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI]
Vega 10 XL/XT [Radeon RX Vega 56/64] (rev c3) (prog-if 00 [VGA controller])
        Subsystem: ASUSTeK Computer Inc. Vega 10 XT [Radeon RX Vega 64]
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR+ FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 107
        NUMA node: 1
        Region 0: Memory at 80000000 (64-bit, prefetchable) [size=256M]
        Region 2: Memory at 90000000 (64-bit, prefetchable) [size=2M]
        Region 4: I/O ports at 3000 [size=256]
        Region 5: Memory at 9fe00000 (32-bit, non-prefetchable) [size=512K]
        Expansion ROM at 9fe80000 [disabled] [size=128K]

lspci -vvv on guest VM:
07:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI]
Vega 10 XT [Radeon RX Vega 64] (rev c3) (prog-if 00 [VGA controller])
Subsystem: ASUSTeK Computer Inc. Vega 10 XL/XT [Radeon RX Vega 56/64]
Physical Slot: 0-6
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 42
Region 0: Memory at 400000000 (64-bit, prefetchable) [size=8G]
Region 2: Memory at 300000000 (64-bit, prefetchable) [size=2M]
Region 4: I/O ports at d000 [size=256]
Region 5: Memory at fdc00000 (32-bit, non-prefetchable) [size=512K]
Expansion ROM at fdc80000 [disabled] [size=128K]


For "Region 0", why is it "size=8G" in guest, but "size=256M" on host

When I try to use the card in the guest, I get errors like:
[  137.290586] amdgpu 0000:07:00.0: [gfxhub] no-retry page fault (src_id:0
ring:158 vmid:8 pasid:32769, for process  pid 0 thread  pid 0)
[  137.292141] amdgpu 0000:07:00.0:   in page starting at address
0x00007f983d952000 from 27
[  137.293164] amdgpu 0000:07:00.0: VM_L2_PROTECTION_FAULT_STATUS:0x0080093C
[  137.294065] Evicting PASID 32769 queues

The same linux kernel 5.1.5 is on the host and the guest.

Now, the GPU has 8GB of RAM, but I don't see how the guest memory window
can be larger than the host can do.

Can anyone help?

Kind Regards

James
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20190530/51b4bcfd/attachment.htm>