[vfio-users] z370 iommu groupings

[Nick S]

My goal is running multiple Windows OS with 3d support on those virtual
machines. I in fact already have one such server with 4 watercooled cards
on x99 chipset. The only thing I don't like with my existing Haswell-E
solution is the USB graphics I use, but there I have an option of using a
1x PCIE GPU for host because all but one GPU I use were converted to single
slot and the motherboard has 5 slots total.
For this new server I want RX 580 cards that don't have a single slot
conversion available. This means 4 cards on the board + Intel Graphics
would be an ideal combination for me. I only need 1 USB connection for that
server, so no need for more PCIE cards. Another option would be finding
some server board with graphics chip and use xeon, linus tech style. I
would prefer a single modern CPU to two old Xeons though and PCIe expansion
box likely costs thousands just by itself. I can budget what I want in
around 3 grand otherwise.

Also, Intel Graphics has its own GPU virtualization project going and while
last time I check serious 3d load was crashing my kernel, I would really
like to have an option to use it when it becomes stable.



2017-12-17 20:00 GMT-08:00 Taiidan at gmx.com <Taiidan at gmx.com>:

> No matter what you get I would advise against getting a non-server board
> where you won't be getting support for what they consider to be a server
> feature, someone with a "gamer" board who says IOMMU works may have a
> different revision than what is currently being sold - getting it working
> is always a fluke at best,
>
> What are your goals for this build? What programs will you be running?
>
>
> Honestly 4 dual slot cards on the same board is a really tall order and
> wouldn't leave you with space for peripheral cards if you want real USB
> controllers instead of emulated controllers.
> You might consider buying a GPU type PCI-e expansion system such as the
> ones from cyclone microsystems which are dual slot spaced and would leave
> you with enough room for other cards.
> http://www.cyclone.com/products/expansion_systems/600-2711.php
>
> If you don't need x86-64 and if you really need to max out the bus on your
> video cards I would consider a POWER9 machine such as the TALOS 2, the
> company who makes it has released firmware for other boards that has
> excellent IOMMU groups and they actually reply to my technical support
> emails.
> https://raptorcs.com/
>
> With two CPU present you would have 4 PCI-e 4.0 x16 slots with one of
> those x8 electrical although they aren't dual slot spaced so you would need
> either an expansion system or single slot cards such as the Radeon Pro WX
> series.
> POWER9 is about to be released and it has a variety of advantages such as
> PCI-e 4.0 and 4 SMT threads per core for sforza.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20171217/0257a126/attachment.htm>