[vfio-users] two gpus

[Roger Lawhorn]

I have the answer.

I had to change my lines from:
-device 
vfio-pci,host=0c:00.0,bus=root_port1,addr=00.0,multifunction=on,x-vga=on \
-device vfio-pci,host=0c:00.1,bus=root_port2,addr=00.1,multifunction=on \
-device vfio-pci,host=0d:00.0,bus=root_port3,addr=01.0,multifunction=on \

to:
-device 
vfio-pci,host=0c:00.0,bus=root_port1,addr=00.0,multifunction=on,x-vga=on \
-device vfio-pci,host=0c:00.1,bus=root_port2,addr=00.0,multifunction=on \
-device vfio-pci,host=0d:00.0,bus=root_port3,addr=00.0,multifunction=on \


Apparently, this is a known bug.
All cards must be on the same addr.

I have both gpus and 8gb of vmem instead of just 4gb.

Nice to know you CAN have more than one video card with gpu passthrough.



On 6/22/20 5:51 AM, Roger Lawhorn wrote:
> The card has 4gb per gpu.
> So 8gb of hbm memory.
>
>
> On 6/21/20 7:10 PM, Alex Williamson wrote:
>> On Sun, 21 Jun 2020 18:58:40 -0400
>> Roger Lawhorn <rll at twc.com> wrote:
>>
>>> ok,
>>> third try to get a new thread
>>>
>>> Anyway,
>>> I tried your global switch.
>>> I still get code 10 device failed to start on the 2nd gpu.
>>> I tried 8GB.
>>> Am I actually allocating 8GB for the pci hole or is that just a size?
>>> I did a full reinstall and factory reset on the video driver.
>>
>> AFAICT you've got 32GB between these GPUs, that would probably be the
>> minimum I'd try, maybe even 64GB.
>>
>>> On 6/21/20 6:05 PM, Alex Williamson wrote:
>>> Use:
>>>
>>> -global q35-pcihost.pci-hole64-size=<size, ex. 32G>
>>>
>>> _______________________________________________
>>> vfio-users mailing list
>>> vfio-users at redhat.com
>>> https://www.redhat.com/mailman/listinfo/vfio-users
>
> _______________________________________________
> vfio-users mailing list
> vfio-users at redhat.com
> https://www.redhat.com/mailman/listinfo/vfio-users
>