[vfio-users] Newbie steps

[Patrick O'Callaghan]

On Sat, 2017-03-11 at 18:37 +0100, Torbjorn Jansson wrote:
> > So IOMMU group 1 contains my Nvidia GPU and audio, plus the PCIe root
> > bridge.
> > 
> > $ cat /etc/modprobe.d/local.conf
> > options vfio-pci ids=10de:ffffffff:ffffffff:ffffffff:00030000:ffff00ff,10de:ffffffff:ffffffff:ffffffff:00040300:ffffffff
> > 
> > (this is just cut-and-paste from Alex's blog. I've no idea what any of
> > the magic hex numbers mean except for the 10de of course).
> > 
> > $ cat /etc/dracut.conf.d/local.conf
> > add_drivers+="vfio vfio_iommu_type1 vfio_pci vfio_virqfd"
> > 
> > My boot line is:
> > 
> > GRUB_CMDLINE_LINUX="rd.blacklist=nvidia rd.blacklist=nouveau intel_iommu=on iommu=pt rd.driver.pre=vfio-pci vconsole.font=latarcyrheb-sun16 $([ -x /usr/sbin/rhcrashkernel-param ] && /usr/sbin/rhcrashkernel-param || :) rhgb quiet resume=U
> > UID=1431e6d2-531e-46cd-8633-1cf878c6b2a1" audit=0
> > 
> > (Note that I have the Nvidia proprietary driver so need to mask that as
> > well as Nouveau).
> > 
> > My monitor is connected to HDMI on the internal GPU and DVI on the
> > Nvidia card.
> > 
> > However on rebooting I always have the Nvidia module loaded, and don't
> > have vfio:
> > $ lsmod|egrep -i nvidia\|vfio
> > nvidia_drm             53248  1
> > nvidia_modeset        806912  8 nvidia_drm
> > nvidia              12267520  175 nvidia_modeset
> > drm_kms_helper        151552  1 nvidia_drm
> > drm                   339968  4 nvidia_drm,drm_kms_helper
> > 
> > And of course, the monitor is only active on the DVI port and not the HDMI.
> > 
> > Any suggestions on what I might try?
> > 
> > poc
> > 
> 
> looks ok, did you remember to regenerate grub config?
> if not, then your changes in /etc/default/grub did not take effect.
> 
> if i'm not mistaken you run: grub2-mkconfig -o grub.cfg
> check it first before replacing old file under /boot and make a backup 
> of it first in case you screw up.

Yes, I did that (on Fedora it's: grub2-mkconfig -o /etc/grub2.cfg). I
do have a backup. If it looks right, there must be something else I'm
missing. I've wondered if having the Nvidia drivers installed could
affect things, though I don't see why it should be necessary as long as
I can stop them being loaded. I keep them updated using akmod but even 
uninstalling akmod and the kmod-nvidia rpm it generates doesn't make
any difference, i.e. somehow the modules are still there, which is
weird in in itself. Maybe that's the root of the problem.

poc