<div dir="ltr">Thanks for the encouragement guys. I think I'm going to try some scrounge for some other hardware just to make sure my GPU isn't the problem. The only other cards I have are AMD which besides rebooting actually work solidly.</div><br><div class="gmail_quote"><div dir="ltr">On Tue, Jan 26, 2016 at 11:36 AM Ruben Felgenhauer <<a href="mailto:4felgenh@informatik.uni-hamburg.de">4felgenh@informatik.uni-hamburg.de</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
Hi, Ryan!<br>
<br>
Installing an older Kernel is probably easier than you might think.<br>
On Ubuntu you should be able to find out which kernels are in the
repos with apt-cache,<br>
but I sadly don't know the params, so maybe take a look at the
manpage.<br>
And afterwards you should be able to install a specific version with
'apt-get install packagename=version'<br>
<br>
On Debian there is simply <a href="http://snapshot.debian.org/package/linux/" target="_blank">http://snapshot.debian.org/package/linux/</a>
which is how I downgraded from 4.3 to 4.1 on my Debian testing.<br>
You can just download the deb files there and install them with
dpkg.<br>
Maybe if you search for a testing system that is similar to Ubuntu,
you could give that a try.<br>
<br>
But keep in mind that this doesn't uninstall the old kernel, so you
will have a fallback.<br>
You might need to select the right kernel at GRUB though.<br>
<br>
Best regards,<br>
Ruben</div><div text="#000000" bgcolor="#FFFFFF"><br>
<br>
<div>Am 26.01.2016 um 18:11 schrieb Will
Marler:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Well, you run Linux and you're experimenting with
VGA passthrough ... you're resourceful! What about picking up a
<a href="http://www.amazon.com/Samsung-16GB-Solid-State-Drive/dp/B003YMJPE8/ref=sr_1_3?ie=UTF8&qid=1453827934&sr=8-3&keywords=16GB+SSD" target="_blank">16GB
SSD for $15</a> and installing Arch (or Fedora, or Gentoo...
whatever suits) side by side with Ubuntu? Presumably your VM can
be launched either way without any configuration changes ...
when you get tired/frustrated of the Arch/Fedora/Gentoo way you
reboot back. If it works, you've found the answer, if it
doesn't, you've improved your Linux-fu for not much (monetary)
cost.
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Jan 26, 2016 at 10:03 AM, Ryan
Flagler <span dir="ltr"><<a href="mailto:ryan.flagler@gmail.com" target="_blank">ryan.flagler@gmail.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Yea, that's just a major jump. Wish I had a
dedicated test system to try more things. ;)</div>
<div>
<div><br>
<div class="gmail_quote">
<div dir="ltr">On Tue, Jan 26, 2016 at 10:34 AM Will
Marler <<a href="mailto:will@wmarler.com" target="_blank">will@wmarler.com</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Next up would be Kernel, it sounds
like...</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Jan 26, 2016 at
8:27 AM, Ryan Flagler <span dir="ltr"><<a href="mailto:ryan.flagler@gmail.com" target="_blank"><a href="mailto:ryan.flagler@gmail.com" target="_blank">ryan.flagler@gmail.com</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Thanks for this info Will.
Tried matching your qemu/libvirt versions
and I still get the driver crashes. I'm not
sure what else to try.</div>
<div>
<div><br>
<div class="gmail_quote">
<div dir="ltr">On Mon, Jan 25, 2016 at
9:20 PM Will Marler <<a href="mailto:will@wmarler.com" target="_blank"><a href="mailto:will@wmarler.com" target="_blank">will@wmarler.com</a></a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hey Ryan,
<div><br>
</div>
<div>Here are the answers to your
questions:</div>
<div><br>
</div>
<div><span style="font-family:monospace"><span style="color:rgb(178,178,178)">20:06:27
</span><span style="color:rgb(24,178,24)">will</span><span style="color:rgb(0,0,0)"> </span><span style="font-weight:bold;color:rgb(84,84,255)">~</span><span style="color:rgb(0,0,0)">%
uname -a
</span><br>
Linux haze 4.3.3-2-ARCH #1 SMP
PREEMPT Wed Dec 23 20:09:18 CET
2015 x86_64 GNU/Linux<br>
</span></div>
<div><span style="font-family:monospace"><span style="color:rgb(178,178,178)">20:07:01 </span><span style="color:rgb(24,178,24)">will</span><span style="color:rgb(0,0,0)"> </span><span style="font-weight:bold;color:rgb(84,84,255)">~</span><span style="color:rgb(0,0,0)">%
pacman -Q | egrep
'^linux|^libvirt|^qemu'
</span><br>
libvirt 1.3.1-1
<br>
libvirt-glib 0.2.2-1
<br>
libvirt-python 1.3.1-1
<br>
linux 4.3.3-2
<br>
linux-api-headers 4.1.4-1
<br>
linux-firmware
20151207.bbe4917-1
<br>
qemu 2.4.1-2<br>
<br>
</span></div>
<div>And here is the pastebin to my
XML file: <a href="http://pastebin.com/nB3DPkEr" target="_blank"><a href="http://pastebin.com/nB3DPkEr" target="_blank">http://pastebin.com/nB3DPkEr</a></a><br>
</div>
<div><br>
</div>
<div>As far as the guest drivers are
concerned, they're the "GeForce
Game Ready Driver" version 361.43.</div>
<div><br>
</div>
<div>HTH!</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Jan
25, 2016 at 10:12 AM, Ryan Flagler
<span dir="ltr"><<a href="mailto:ryan.flagler@gmail.com" target="_blank"><a href="mailto:ryan.flagler@gmail.com" target="_blank">ryan.flagler@gmail.com</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Thanks Will. Here
is my info with the guest that
crashes.
<div><br>
</div>
<div>
<div>Host OS Info</div>
<div> ubuntu - 14.04.03</div>
<div> kernel - 3.19.0-47</div>
<div><br>
</div>
<div>virsh version</div>
<div> Compiled against
library: libvirt 1.2.18</div>
<div> Using library: libvirt
1.2.18</div>
<div> Using API: QEMU 1.2.18</div>
<div> Running hypervisor:
QEMU 2.5.0</div>
<div><br>
</div>
<div>patches</div>
<div> I did not manually
apply any patches to Qemu.
Built directly from
source.</div>
<div><br>
</div>
<div>Guest Info</div>
<div> Windows 10</div>
<div> nVidia Graphics Driver
361.43</div>
<div><br>
</div>
<div>Guest Event Viewer
Entry On Driver Crash</div>
<div> Source - nvlddmkm</div>
<div> Event ID - 14</div>
<div> Info - \Device\Video3
CMDre 00000004 0000011c
bad0011f 00000000 00d0011f</div>
</div>
<div><br>
</div>
<div>Guest XML - Attached</div>
<div>
<div>
<div><br>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr">On Mon,
Jan 25, 2016 at 10:18
AM Will Marler <<a href="mailto:will@wmarler.com" target="_blank"><a href="mailto:will@wmarler.com" target="_blank">will@wmarler.com</a></a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">On
Mon, Jan 25,
2016 at 9:07 AM,
Ryan Flagler <span dir="ltr"><<a href="mailto:ryan.flagler@gmail.com" target="_blank"><a href="mailto:ryan.flagler@gmail.com" target="_blank">ryan.flagler@gmail.com</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">Will,
could you tell
us the
following?</p>
<p dir="ltr">What
Linux
distribution
on host?<br>
</p>
</blockquote>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>Arch </div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">
What kernel
are you using
on host?<br>
What libvirt
version on
host?<br>
What qemu
version on
host?<br>
</p>
</blockquote>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>Will have
to check when
I'm home from
work & the
kids are
asnooze, but
it's
whatever's
latest (and
I'm not using
the
linux-vfio-lts
kernel) </div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">
What OS on
guest?<br>
</p>
</blockquote>
<div>Windows 10.</div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">
What nvidia
graphics
driver version
on guest?</p>
</blockquote>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>Again, I'll
have to check.
But the latest
or nearly
latest. </div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">My
machines gpu
driver crashes
constantly and
I'm trying to
narrow down
why. Thanks!</p>
</blockquote>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>How
frustrating :
(. I'll also
get a pastebin
of my XML for
you, in case
that will
help. I've
been running
"stable" since
mid 2015. I
use the quotes
because some
things tripped
me up (guest
machine can't
"sleep," can
only power on
& power
off; when host
machine goes
to sleep with
guest running,
on host
wake-up the
guest is
non-responsive
and 100%
CPU). </div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div><br>
</div>
<div>Will</div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div> </div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div>
<br>
<div class="gmail_quote">
<div dir="ltr">On
Mon, Jan 25,
2016, 10:02
AM Will Marler
<<a href="mailto:will@wmarler.com" target="_blank"><a href="mailto:will@wmarler.com" target="_blank">will@wmarler.com</a></a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">This
is discussed
in <a href="http://vfio.blogspot.com/2015/05/vfio-gpu-how-to-series-part-4-our-first.html" target="_blank"><a href="http://vfio.blogspot.com/2015/05/vfio-gpu-how-to-series-part-4-our-first.html" target="_blank">http://vfio.blogspot.com/2015/05/vfio-gpu-how-to-series-part-4-our-first.html</a></a>.
You have to do
more than
<kvm><hidden
state='on'/></kvm>:<br>
<div><br>
</div>
<div>"The
GeForce card
is nearly as
easy, but we
first need to
work around
some of the
roadblocks
Nvidia has put
in place to
prevent you
from using the
hardware
you've
purchased in
the way that
you desire
(and by my
reading
conforms to
the EULA for
their
software, but
IANAL). For
this step we
again need to
run virsh edit
on the VM.
Within the
<features>
section,
remove
everything
between the
<hyperv>
tags,
including the
tags
themselves.
In their place
add the
following
tags:</div>
</div>
<div dir="ltr">
<div><br>
</div>
<div>
<kvm></div>
<div>
<hidden
state='on'/></div>
<div>
</kvm></div>
<div><br>
</div>
</div>
<div dir="ltr">
<div>Additionally,
within the
<clock>
tag, find the
timer named
hypervclock,
remove the
line
containing
this tag
completely.
Save and exit
the edit
session."</div>
<div><br>
</div>
<div>I can
confirm it
works, I've
been getting a
lot of mileage
from my
passed-through
750Ti lately
since getting
a Steam Link
:-D.</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Sun, Jan 24,
2016 at 7:32
AM, Ruben
Felgenhauer <span dir="ltr"><<a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank"><a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank">4felgenh@informatik.uni-hamburg.de</a></a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"> Hi,<br>
<br>
finally I had
time to this
again. I tried
out
virt-manager
and after a
bit of playing
around with
it, it
/somewhat/
worked:<br>
<br>
The machine is
at least
booting. I
still have a
standard vga
card enabled
in the
virt-manager
config window.<br>
After the
machine has
booted, I can
see that the
device gets
recognized as
750ti.<br>
However, the
gpu doesn't
get used,
because of
'Code 43'.<br>
Code 43 is a
generic error,
so any idea
what it could
mean in this
case?<br>
<br>
Of course I
added the
<kvm><hidden
state='on'/></kvm>
lines at the
associated
position.<br>
<br>
Best regards,<br>
Ruben
<div>
<div><br>
<br>
<div>Am
18.01.2016 um
22:27 schrieb
Will Marler:<br>
</div>
<blockquote type="cite">
<div dir="ltr">I'm
not sure what
correct
command-line
syntax is.
Have you tried
using libvirt
and
VirtManager to
handle your VM
rather than
command line,
and modifying
the XML rather
than the
command line?
I think that's
generally the
preferred
method these
days (it's
certainly
easier from my
point of view,
and the way I
got my 750 Ti
to pass
through).</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Mon, Jan 18,
2016 at 11:04
AM, Ruben
Felgenhauer <span dir="ltr"><<a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank"><a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank">4felgenh@informatik.uni-hamburg.de</a></a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"> Hi, Alex!<br>
<br>
Thanks for
your reply!<br>
My GPU indeed
has a seperate
audio device
located at
01:00.1.<br>
<br>
However, just
adding -device
vfio-pci,host=01:00.1
doesn't seem
to do the
trick.<br>
Of course the
corresponding
device is
already
blacklisted
and bound to
vfio.<br>
<br>
The Debian
Wiki entry
about VGA
passthrough (<a href="https://wiki.debian.org/VGAPassthrough" target="_blank"><a href="https://wiki.debian.org/VGAPassthrough" target="_blank">https://wiki.debian.org/VGAPassthrough</a></a>)
mentions QEMU
arguments like
"-device
vfio-pci,host=01:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on,romfile=...
-device
vfio-pci,host=01:00.1,bus=pcie.0"
which seems to
address GPUs
with audio
devices, but
if I try to do
something
similar, the
buses 'root'
and 'pcie'
couldn't be
found. Maybe I
missed
something very
important?<br>
<br>
On the same
article, it
says that the
"HDMI
soundcard
[...] needs to
be unbound
from its
driver":<br>
# echo
'0000:01:00.1'
| sudo tee
/sys/bus/pci/devices/0000:01:00.1/driver/unbind<br>
I figured the
vfio-bind
script from
the Arch Linux
Forum thread (<a href="https://bbs.archlinux.org/viewtopic.php?id=162768" target="_blank"><a href="https://bbs.archlinux.org/viewtopic.php?id=162768" target="_blank">https://bbs.archlinux.org/viewtopic.php?id=162768</a></a>)
would do
exactly this
thing, so I
didn't
explicitly do
so for the
audio device.
Is that okay?<br>
<br>
Best regards,<br>
Ruben
<div>
<div><br>
<br>
<div>Am
18.01.2016 um
08:31 schrieb
Alexander
Petrenz:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi
Ruben,
<div><br>
</div>
<div>I guess
your 750ti
also has some
audio device.
You should
pass through
this too. It
should be
something like
01:00.1. There
are many
command line
examples you
can find about
that.</div>
<div>Also I´m
not quite
sure, if you
should remove
the x-vga=on.</div>
<div><br>
</div>
<div>Regards</div>
<div>Alex</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Sun, Jan 17,
2016 at 11:12
PM, Ruben
Felgenhauer <span dir="ltr"><<a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank"><a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank">4felgenh@informatik.uni-hamburg.de</a></a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi,<br>
<br>
I am trying to
pass my nVidia
GTX 750ti to
my QEMU guest.<br>
<br>
Problem is:
After the QEMU
monitor pops
up, nothing
happens. The
GPU's output
is dead, and
the vm won't
be accessible
via SSH
anymore, so
it's very
likely that
the VM isn't
booting up at
all. Also,
there are no
error messages
from QEMU on
the console
whatsoever
which makes
debugging it
especially
hard.<br>
<br>
This is how I
start the vm
with normal
vga emulation:<br>
qemu-system-x86_64
-hda vm.ovl
-boot c
-enable-kvm -m
1024 -cpu
host,kvm=off
-smp
cores=4,threads=2
-redir
tcp:5022::22<br>
Everything
runs fine in
this case. To
do the
passthrough, I
add this:<br>
-device
vfio-pci,host=01:00.0,multifunction=on,x-vga=on
-vga none<br>
This brings
said problems
with it. I
also tried out
multiple
different
combinations
of -device's
arguments or
even adding a
romfile for
the GPU, but
none of these
steps changed
anything at
all.<br>
<br>
Obviously, I
am using a
BIOS
installation
and I'm
well-aware
with this bug:
<a href="https://bugzilla.kernel.org/show_bug.cgi?id=107561" target="_blank"><a href="https://bugzilla.kernel.org/show_bug.cgi?id=107561" target="_blank">https://bugzilla.kernel.org/show_bug.cgi?id=107561</a></a>,
but neither
using less RAM
(as you can
see I am using
1GB now) nor
switching to
an older
Kernel changed
anything about
the problem. I
have tried
Kernel 4.1.0
and 4.3.0.<br>
<br>
Host is Debian
testing with
QEMU 2.5.0.<br>
I tried both
Debian and
Windows 7 as a
guest, but
both are
showing
exactly the
same
behaviour.<br>
Mainboard is
an ASUS
Z87-PLUS. The
750ti is
produced by
ASUS aswell.<br>
<br>
Any idea how I
could get
passthrough
running?<br>
<br>
_______________________________________________<br>
vfio-users
mailing list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank"><a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a></a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" rel="noreferrer" target="_blank"><a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a></a><br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
vfio-users
mailing list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank"><a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a></a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" rel="noreferrer" target="_blank"><a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a></a><br>
<br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
_______________________________________________<br>
vfio-users
mailing list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank"><a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a></a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" rel="noreferrer" target="_blank"><a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a></a><br>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div></blockquote></div>