<div dir="ltr"><div><div><div><div>Kevin,<br><br></div> Do you have any more specific information about your setup and how its configured? For example, are you using libvirt? command line? do you have config examples? I have passthrough of a gtx780 working for a Fedora 25 guest and will be trying with a gtx 980 later today. I glanced over the link to the devtalk site and didn't notice anything in the config given that was hiding the presence of KVM so that the Nvidia driver can't detect that its running in a VM (something that I always try to configure)<br></div><br></div>Regards,<br><br></div> David<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Dec 16, 2016 at 12:20 PM, Kevin Vasko <span dir="ltr"><<a href="mailto:kvasko@gmail.com" target="_blank">kvasko@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto"><div>I haven't seen any other error messages in any of the logs. </div><div id="m_224792087794049153AppleMailSignature"><br></div><div id="m_224792087794049153AppleMailSignature">Sorry, what is ovmf?<span class="HOEnZb"><font color="#888888"><br><br>-Kevin</font></span></div><div><div class="h5"><div><br>On Dec 15, 2016, at 11:02 PM, Zachary Boley <<a href="mailto:zboley00@gmail.com" target="_blank">zboley00@gmail.com</a>> wrote:<br><br></div><blockquote type="cite"><div><div dir="auto">All I can say is try vfio-pci if you haven't already, may get a 1070 but would love to know if those work, and the guest is Linux with ovmf? Not sure if it'd help but do you have the nvidia error 43 stuff in the libvirt config</div><div class="gmail_extra"><br><div class="gmail_quote">On Dec 7, 2016 11:35 PM, "Kevin Vasko" <<a href="mailto:kvasko@gmail.com" target="_blank">kvasko@gmail.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">No, the problem is that the drivers don't work on the guest (which would allow me to use the card on the guest system). I am speculating it is a passthrough issue or a GPU driver bug.<div><br></div><div>On the host the device is being recognized with lspci. I used pci-stub (since its 3.x kernel) to make sure the host system didn't attach a driver to the GPU. If I launch a guest VM to use the GPU, the guest system boots properly and sees the GPU with the lspci command (e.g. <span style="font-size:12.8px">00:05.0 VGA compatible controller: NVIDIA Corporation GM204 [GeForce GTX 980] (rev a1)). However, when I install the GPU drivers on the guest (the installation of the driver completes successfully), but when I run the nvidia-smi command (to look at the device on the guest and to make sure the guest can communicate with the GPU via passthrough) I get the error "</span><span style="font-size:12.8px">Unable to determine the device handle for GPU 0000:00:05.0: Unknown Error" and see the error messages in dmesg (which I posted in original).</span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">I have tried several different drivers, two different cards (1080 and 980), different kernels on the host and guest and still get the same error. Those error messages don't seem to lead me anywhere on google either unfortunately.<br></span><div><span style="font-size:12.8px"><br></span></div><div><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Dec 7, 2016 at 8:01 PM, Zachary Boley <span dir="ltr"><<a href="mailto:zboley00@gmail.com" target="_blank">zboley00@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">are you saying its not recognized in the host? but it works in the guest perfectly? ooor? I'm not quite understanding the problem sorry<br></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_224792087794049153m_-14935499631909562h5">On Wed, Dec 7, 2016 at 1:45 PM, Kevin Vasko <span dir="ltr"><<a href="mailto:kvasko@gmail.com" target="_blank">kvasko@gmail.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="m_224792087794049153m_-14935499631909562h5"><div dir="ltr">I am doing passthrough from Ubuntu 14.04 3.19 (Host) to an Ubuntu 14.04 guest 3.19. I have been testing with a GeForce GTX 980 and GTX 1080. I have seen people do PCI Passthrough without a problem with GeForce cards.<div><br></div><div><div>I can see device inside the guest VM:</div><div><br></div><div> lspci -vnn | grep VGA</div><div><br></div><div> 00:05.0 VGA compatible controller: NVIDIA Corporation Device 1b80 (rev a1)</div><div><br></div><div>OR if I have the GTX 980 passed through.</div><div><br></div><div>00:05.0 VGA compatible controller: NVIDIA Corporation GM204 [GeForce GTX 980] (rev a1)<br></div><div><br></div><div>I was able to successfully install the driver (370.2, latest driver). I have tried with several other driver versions with same results. It installs, but is not recognized by nvidia-smi (same result both cards):</div><div><br></div><div> nvidia-smi </div><div><br></div><div>> Unable to determine the device handle for GPU 0000:00:05.0: Unknown</div><div>> Error</div><div><br></div><div><br></div><div>Looking in dmesg I see the following error message</div><div><br></div><div>> [ 29.535583] nvidia 0000:00:05.0: irq 45 for MSI/MSI-X [ </div><div>> 29.577727] NVRM: RmInitAdapter failed! (0x23:0x56:458) [ 29.577807] NVRM: rm_init_adapter failed for device bearing minor number 0</div><div><br></div><div>Another person on the NVidia forums had the SAME exact issue as me (but no answer).</div><div><br></div><div><a href="https://devtalk.nvidia.com/default/topic/957757/gtx-1080-amp-kvm-pci-passthrough-to-guest/?offset=2#5033118" target="_blank">https://devtalk.nvidia.com/def<wbr>ault/topic/957757/gtx-1080-amp<wbr>-kvm-pci-passthrough-to-guest/<wbr>?offset=2#5033118</a></div><div><br></div><div>Is there anyway to debug this further? I'm currently trying to narrow this down to either drivers or passthrough causing it. </div><div><br></div><div><br></div></div></div> <br></div></div>______________________________<wbr>_________________<br> vfio-users mailing list<br> <a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a><br> <a href="https://www.redhat.com/mailman/listinfo/vfio-users" rel="noreferrer" target="_blank">https://www.redhat.com/mailman<wbr>/listinfo/vfio-users</a><br> <br></blockquote></div><br></div> </blockquote></div><br></div> </blockquote></div></div> </div></blockquote></div></div></div><br>______________________________<wbr>_________________<br> vfio-users mailing list<br> <a href="mailto:vfio-users@redhat.com">vfio-users@redhat.com</a><br> <a href="https://www.redhat.com/mailman/listinfo/vfio-users" rel="noreferrer" target="_blank">https://www.redhat.com/<wbr>mailman/listinfo/vfio-users</a><br> <br></blockquote></div><br></div>