[vfio-users] Another Nvidia code 43 error

Will Marler will at wmarler.com
Thu Nov 17 19:16:56 UTC 2016


Sorry about that, I just took the time to read through the full thread and
I found your updated XML. I see you've already tried with all of the hyperv
lines removed.

Early in the thread you mentioned that "if I pull the GT 430 from the box
that I can see the boot on the GTX 760." If you pull the GT 430, do you
clear up the code 43 error? This could be worth trying, though I've never
tried running a guest on a headless machine personally (I've read others
have done it).

Have you tried swapping the slots that the 760 & 430 occupy?

Maybe there's something in the BIOS... What kind of motherboard do you
have?

On Thu, Nov 17, 2016 at 11:57 AM, Thomas Mashos <thomas at mashos.com> wrote:

> Hi Will,
>
> No, I've not been able to get the NVidia drivers working at all, in any of
> my tests.
>
>
> On Thu, Nov 17, 2016 at 10:55 AM Will Marler <will at wmarler.com> wrote:
>
>> Sorry if you've said this already, but are you able to get the nVidia
>> drivers to work if you remove all hyper-v enablements?
>>
>> From http://vfio.blogspot.com/2015/05/vfio-gpu-how-to-
>> series-part-4-our-first.html:
>> "Within the <features> section, remove everything between the <hyperv>
>> tags, including the tags themselves.  In their place add the following tags:
>>
>>     <kvm>
>>       <hidden state='on'/>
>>     </kvm>
>>
>> Additionally, within the <clock> tag, find the timer named hypervclock,
>> remove the line containing this tag completely."
>>
>> You have the <kvm><hidden state='on'/></kvm> tags and you removed the
>> hypervclock within the <clock> tags, but you have
>> <features><hyperv><vendor_id state='on' value='whatever'/></hyperv>
>>
>> That might be confusing the nVidia drivers.
>>
>> If you get it working as per the blog post, then try moving forward to
>> the next increment, enabling hyperv. For reference, here are the relevant
>> sections of my XML, with hyper-v enabled (I have a GeForce 750ti)
>>
>>   <features>
>>     <acpi/>
>>     <apic/>
>>     <hyperv>
>>       <relaxed state='on'/>
>>       <vapic state='on'/>
>>       <spinlocks state='on' retries='8191'/>
>>       <vendor_id state='on' value='123456789ab'/>
>>     </hyperv>
>>     <kvm>
>>       <hidden state='on'/>
>>     </kvm>
>>     <vmport state='off'/>
>>   </features>
>>
>>   <cpu mode='host-passthrough'>
>>     <topology sockets='1' cores='2' threads='1'/>
>>   </cpu>
>>
>>   <clock offset='localtime'>
>>     <timer name='rtc' tickpolicy='catchup'/>
>>     <timer name='pit' tickpolicy='delay'/>
>>     <timer name='hpet' present='no'/>
>>     <timer name='hypervclock' present='yes'/>
>>   </clock>
>>
>> One other thing to note: the "value" string of the vendor_id tag might be
>> required to be a certain number of characters. I recall reading that
>> somewhere, but I can't quote it, so I could be wrong. It's an easy thing to
>> test though (*after* you have the nVidia driver working without hyperv
>> enabled first!)
>>
>> On Thu, Nov 17, 2016 at 10:08 AM, Thomas Mashos <thomas at mashos.com>
>> wrote:
>>
>> Hello Brett,
>>
>> I just ran GPU-Z and the UEFI box is not checked. So no UEFI it seems
>>
>> On Thu, Nov 17, 2016 at 8:33 AM Brett Peckinpaugh <erylflynn at gmail.com>
>> wrote:
>>
>> Has anyone verified if the video card has uefi firmware?
>>
>> On November 17, 2016 7:33:32 AM PST, Thomas Mashos <thomas at mashos.com>
>> wrote:
>>
>> Sorry, guess I didn't reply all last time.
>>
>> Just uninstalled the Nvidia driver and let windows search for and install
>> the driver. Let it reboot a few times, no deal. Still code 43 :(
>>
>> I'm still using the default Ubuntu kernel
>> Linux smitty 4.4.0-47-generic #68-Ubuntu SMP Wed Oct 26 19:39:52 UTC 2016
>> x86_64 x86_64 x86_64 GNU/Linux
>>
>> Here's my current XML, which I tried changing the CPU topology to match
>> yours, still getting error code 43.
>> http://termbin.com/3n44
>>
>> Not sure what else to try here, maybe I should try a Win 7 install? I
>> think I still have one of those DVD's laying around.
>>
>>
>> On Wed, Nov 16, 2016 at 10:33 PM Eddie Yen <missile0407 at gmail.com> wrote:
>>
>> OK....now things change to difficult.
>>
>> Can you post your XML again after you edit?
>> Also, did you change kernel or still using Ubuntu official version?
>> I don't want to suspect but I think it had few connection inside.
>>
>> And here is my XML code when running K420 /w Windows 7, as a reference.
>> Also don't forget to reply the mail back to VFIO milling list, maybe
>> other people can help :)
>>
>> 2016-11-17 13:34 GMT+08:00 Thomas Mashos <thomas at mashos.com>:
>>
>> Just uninstalled the Nvidia driver and let windows search for and install
>> the driver. Let it reboot a few times, no deal. Still code 43 :(
>>
>> On Wed, Nov 16, 2016 at 7:33 PM Eddie Yen <missile0407 at gmail.com> wrote:
>>
>> Roger that,
>>
>> What about try the driver version from Windows 10, not NVIDIA official
>> download?
>> I remember Windows 10 has built GeForce 700 Series driver inside.
>>
>> 2016-11-17 11:04 GMT+08:00 Thomas Mashos <thomas at mashos.com>:
>>
>> I've now tried both those options (I tried a few different machine types
>> too) with no luck.
>>
>> I forgot to mention that I also tried the setting the interrupts to MSI
>> via the registry for the GTX 760, but that didn't seem to switch it to MSI
>> on reboot.
>>
>> On Wed, Nov 16, 2016 at 6:08 PM Eddie Yen <missile0407 at gmail.com> wrote:
>>
>> Hi Thomas,
>>
>> Basically KVM <hidden state=on/> equals kvm=off, so you can keep it.
>>
>> And there is no need to reinstall NVIDIA driver whenever you change XML
>> code.
>>
>> If you already tried remove Hyper-V features and still got Code 43,
>> there're few ways you can try.
>>
>> 1. Set CPU as "host-passthrough" mode
>> 2. You can type virsh capabilities to see how many machine type you can
>> use, and try different i440fx version.
>> Some GPU may got a problem if using higher version of i440fx
>>
>> I'm running K420 on server, and guest OS is Windows 7. But I'm not using
>> third-party ppa to install newer QEMU and libvirt, all I do is compile and
>> install by myself. Using OVMF and i440fx-2.6 and it works perfectly without
>> Hyper-V (Because Windows 7 can't enable Hyper-V in OVMF mode.)
>>
>> I'm not sure these tip works on you or not, just give it a try :)
>>
>> 2016-11-17 9:40 GMT+08:00 Thomas Mashos <thomas at mashos.com>:
>>
>> Hi Eddie,
>>
>> XML Dump is here  http://termbin.com/mwwd it's a Windows 10 Home 64-bit
>> guest. I've previously tried with the hyperv features section removed, I
>> can try that again if you want. As for the kvm=off, is that different that
>> setting kvm's hidden state to on?
>>
>> This might be a dumb question, but do I need to reinstall the nvidia
>> drivers after each of these changes I test in the XML file? I've just been
>> shutting down the VM, making the change and booting it again, then checking
>> device manager.
>>
>>
>>
>>
>>
>>
>>
>> On Wed, Nov 16, 2016 at 5:32 PM Eddie Yen <missile0407 at gmail.com> wrote:
>>
>> OK, forgot the previous message.
>>
>> Try to remove Hyper-V features, only leave kvm=off and try.
>>
>> Thanks,
>>
>> 2016-11-17 9:30 GMT+08:00 Eddie Yen <missile0407 at gmail.com>:
>>
>> Hi
>>
>> Can you post your XML file? Also call tell which Windows version you're
>> using on guest?
>>
>> Thanks,
>>
>> 2016-11-17 9:18 GMT+08:00 Thomas Mashos <thomas at mashos.com>:
>>
>> I've gone through reinstalls and multiple guides (
>> http://vfio.blogspot.com/2015/05/vfio-gpu-how-to-series-part-3-host.html a
>> few times) and I'm not sure what to do next, no matter what I try I always
>> get the error code 43.
>>
>> My setup. I have a "server" in my closet that has 2 nvidia cards in (a
>> GeForce GT 430 to run the system, a GeForce GTX 760 dedicated to the VM).
>> I've setup the GTX 760 to use the stub (see below). The processor I have is
>> a 'Intel(R) Xeon(R) CPU E5-2640 v2 @ 2.00GHz', so no integrated graphics on
>> that and the motherboard doesn't have any integrated graphics either. The
>> server runs Ubuntu Server 16.04.1, but has libvirt and qemu updated from a
>> PPA (see versions below). The VM is a Win 10 64-bit Home install with the
>> NVidia 375.70 drivers installed from their website.
>>
>> I've verified that if I pull the GT 430 from the box that I can see the
>> boot on the GTX 760. If I leave both cards in, I don't see anything on the
>> GTX 760 ever. One thing to note is that I setup the VM using virt-manager
>> 1.3.2 from a 16.10 machine, so in the XML it mentions "machine='pc-i440fx-yakkety'".
>> I'm not sure if that could be causing any issues, but I've been working on
>> this for about a week and need a fresh set of eyes.
>>
>> ---- lspci -nnk -----
>> 01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GF108
>> [GeForce GT 430] [10de:0de1] (rev a1)
>> Subsystem: ZOTAC International (MCO) Ltd. GF108 [GeForce GT 430]
>> [19da:1167]
>> Kernel driver in use: nouveau
>> Kernel modules: nvidiafb, nouveau
>> 01:00.1 Audio device [0403]: NVIDIA Corporation GF108 High Definition
>> Audio Controller [10de:0bea] (rev a1)
>> Subsystem: ZOTAC International (MCO) Ltd. GF108 High Definition Audio
>> Controller [19da:1167]
>> Kernel driver in use: snd_hda_intel
>> Kernel modules: snd_hda_intel
>> 02:00.0 VGA compatible controller [0300]: NVIDIA Corporation GK104
>> [GeForce GTX 760] [10de:1187] (rev a1)
>> Subsystem: Micro-Star International Co., Ltd. [MSI] GK104 [GeForce GTX
>> 760] [1462:2847]
>> Kernel driver in use: vfio-pci
>> Kernel modules: nvidiafb, nouveau
>> 02:00.1 Audio device [0403]: NVIDIA Corporation GK104 HDMI Audio
>> Controller [10de:0e0a] (rev a1)
>> Subsystem: Micro-Star International Co., Ltd. [MSI] GK104 HDMI Audio
>> Controller [1462:2847]
>> Kernel driver in use: vfio-pci
>> Kernel modules: snd_hda_intel
>>
>> -----  package lists from server -----
>> thomas at smitty:~$ dpkg -l | grep libvirt
>> ii  libvirt-bin                        2.2.0-0~16.04~ppa0
>>                 amd64        programs for the libvirt library
>> ii  libvirt-clients                    2.2.0-0~16.04~ppa0
>>                 amd64        Programs for the libvirt library
>> ii  libvirt-daemon                     2.2.0-0~16.04~ppa0
>>                 amd64        Virtualization daemon
>> ii  libvirt-daemon-system              2.2.0-0~16.04~ppa0
>>                 amd64        Libvirt daemon configuration files
>> ii  libvirt0:amd64                     2.2.0-0~16.04~ppa0
>>                 amd64        library for interfacing with different
>> virtualization systems
>> thomas at smitty:~$ dpkg -l | grep qemu
>> ii  ipxe-qemu                          1.0.0+git-20150424.a25a16d-1ubuntu1
>>                all          PXE boot firmware - ROM images for qemu
>> ii  qemu-block-extra:amd64             1:2.6.2+dfsg-0~16.04~ppa0
>>                  amd64        extra block backend modules for qemu-system
>> and qemu-utils
>> ii  qemu-kvm                           1:2.6.2+dfsg-0~16.04~ppa0
>>                  amd64        QEMU Full virtualization
>> ii  qemu-system-common                 1:2.6.2+dfsg-0~16.04~ppa0
>>                  amd64        QEMU full system emulation binaries (common
>> files)
>> ii  qemu-system-x86                    1:2.6.2+dfsg-0~16.04~ppa0
>>                  amd64        QEMU full system emulation binaries (x86)
>> ii  qemu-utils                         1:2.6.2+dfsg-0~16.04~ppa0
>>                  amd64        QEMU utilities
>>
>> ----- Current VM XML dump ----
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20161117/4a9d92b1/attachment.htm>


More information about the vfio-users mailing list