[vfio-users] Question about iommu groups

James Courtier-Dutton james.dutton at gmail.com
Tue Jun 18 10:43:58 UTC 2019 

Hi,

In the following list of iommu groups, I am wondering why sub-functions on
the same PCIe card are not being given the same IOMMU group as I would
expect.

For example, I would have expected the GPU and the HMDI Audio for that GPU
to be in the same IOMMU group.

I am asking, because, with the current IOMMU groups, a vfio bus reset fails.

Any clues?



[    0.502902] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters
supported
[    0.502956] pci 0000:40:00.2: AMD-Vi: IOMMU performance counters
supported
[    0.503748] pci 0000:00:01.0: Adding to iommu group 0
[    0.504124] pci 0000:00:01.1: Adding to iommu group 1
[    0.504531] pci 0000:00:01.2: Adding to iommu group 2
[    0.504942] pci 0000:00:02.0: Adding to iommu group 3
[    0.505336] pci 0000:00:03.0: Adding to iommu group 4
[    0.505741] pci 0000:00:03.1: Adding to iommu group 5
[    0.506118] pci 0000:00:04.0: Adding to iommu group 6
[    0.506506] pci 0000:00:07.0: Adding to iommu group 7
[    0.506877] pci 0000:00:07.1: Adding to iommu group 8
[    0.507294] pci 0000:00:08.0: Adding to iommu group 9
[    0.507644] pci 0000:00:08.1: Adding to iommu group 10
[    0.508079] pci 0000:00:14.0: Adding to iommu group 11
[    0.508096] pci 0000:00:14.3: Adding to iommu group 11
[    0.508500] pci 0000:00:18.0: Adding to iommu group 12
[    0.508515] pci 0000:00:18.1: Adding to iommu group 12
[    0.508529] pci 0000:00:18.2: Adding to iommu group 12
[    0.508547] pci 0000:00:18.3: Adding to iommu group 12
[    0.508562] pci 0000:00:18.4: Adding to iommu group 12
[    0.508576] pci 0000:00:18.5: Adding to iommu group 12
[    0.508591] pci 0000:00:18.6: Adding to iommu group 12
[    0.508605] pci 0000:00:18.7: Adding to iommu group 12
[    0.509054] pci 0000:00:19.0: Adding to iommu group 13
[    0.509070] pci 0000:00:19.1: Adding to iommu group 13
[    0.509086] pci 0000:00:19.2: Adding to iommu group 13
[    0.509103] pci 0000:00:19.3: Adding to iommu group 13
[    0.509118] pci 0000:00:19.4: Adding to iommu group 13
[    0.509133] pci 0000:00:19.5: Adding to iommu group 13
[    0.509149] pci 0000:00:19.6: Adding to iommu group 13
[    0.509164] pci 0000:00:19.7: Adding to iommu group 13
[    0.509574] pci 0000:01:00.0: Adding to iommu group 14
[    0.509598] pci 0000:01:00.1: Adding to iommu group 14
[    0.509620] pci 0000:01:00.2: Adding to iommu group 14
[    0.509631] pci 0000:02:00.0: Adding to iommu group 14
[    0.509642] pci 0000:02:01.0: Adding to iommu group 14
[    0.509653] pci 0000:02:02.0: Adding to iommu group 14
[    0.509664] pci 0000:02:03.0: Adding to iommu group 14
[    0.509675] pci 0000:02:04.0: Adding to iommu group 14
[    0.509687] pci 0000:02:09.0: Adding to iommu group 14
[    0.509708] pci 0000:03:00.0: Adding to iommu group 14
[    0.509725] pci 0000:05:00.0: Adding to iommu group 14
[    0.509740] pci 0000:08:00.0: Adding to iommu group 14
[    0.510109] pci 0000:09:00.0: Adding to iommu group 15
[    0.510443] pci 0000:0a:00.0: Adding to iommu group 16
[    0.510817] pci 0000:0b:00.0: Adding to iommu group 17
[    0.511251] pci 0000:0c:00.0: Adding to iommu group 18
[    0.511406] pci 0000:0c:00.0: Using iommu direct mapping
[    0.511547] pci 0000:0c:00.1: Adding to iommu group 19
[    0.511902] pci 0000:0d:00.0: Adding to iommu group 20
[    0.512234] pci 0000:0d:00.2: Adding to iommu group 21
[    0.512605] pci 0000:0d:00.3: Adding to iommu group 22
[    0.512945] pci 0000:0e:00.0: Adding to iommu group 23
[    0.513323] pci 0000:0e:00.2: Adding to iommu group 24
[    0.513660] pci 0000:0e:00.3: Adding to iommu group 25
[    0.514033] pci 0000:40:01.0: Adding to iommu group 26
[    0.514407] pci 0000:40:02.0: Adding to iommu group 27
[    0.514742] pci 0000:40:03.0: Adding to iommu group 28
[    0.515121] pci 0000:40:03.1: Adding to iommu group 29
[    0.515454] pci 0000:40:04.0: Adding to iommu group 30
[    0.515867] pci 0000:40:07.0: Adding to iommu group 31
[    0.516233] pci 0000:40:07.1: Adding to iommu group 32
[    0.516575] pci 0000:40:08.0: Adding to iommu group 33
[    0.516954] pci 0000:40:08.1: Adding to iommu group 34
[    0.517292] pci 0000:41:00.0: Adding to iommu group 35
[    0.517668] pci 0000:42:00.0: Adding to iommu group 36
[    0.518050] pci 0000:43:00.0: Adding to iommu group 37
[    0.518129] pci 0000:43:00.0: Using iommu direct mapping
[    0.518298] pci 0000:43:00.1: Adding to iommu group 38
[    0.518629] pci 0000:44:00.0: Adding to iommu group 39
[    0.518970] pci 0000:44:00.2: Adding to iommu group 40
[    0.519348] pci 0000:44:00.3: Adding to iommu group 41
[    0.519686] pci 0000:45:00.0: Adding to iommu group 42
[    0.520072] pci 0000:45:00.2: Adding to iommu group 43
[    0.520306] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    0.520307] pci 0000:00:00.2: AMD-Vi: Extended features
(0xf77ef22294ada):
[    0.520308]  PPR NX GT IA GA PC GA_vAPIC
[    0.520310] pci 0000:40:00.2: AMD-Vi: Found IOMMU cap 0x40
[    0.520311] pci 0000:40:00.2: AMD-Vi: Extended features
(0xf77ef22294ada):
[    0.520311]  PPR NX GT IA GA PC GA_vAPIC
[    0.520312] AMD-Vi: Interrupt remapping enabled
[    0.520312] AMD-Vi: Virtual APIC enabled
[    0.520498] AMD-Vi: Lazy IO/TLB flushing enabled
[    0.521585] amd_uncore: AMD NB counters detected
[    0.521594] amd_uncore: AMD LLC counters detected
[    0.522255] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4
counters/bank).
[    0.522265] perf/amd_iommu: Detected AMD IOMMU #1 (2 banks, 4
counters/bank).
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20190618/d9b71bd4/attachment.htm>

More information about the vfio-users mailing list