<div dir="ltr">I did some more testing and removing my static vcpu placement and all vcpupin entries has greatly increased my stability. So far "knock on wood" the server hasn't crashed or hung up due to gpu driver crashes.</div><br><div class="gmail_quote"><div dir="ltr">On Thu, Jan 28, 2016 at 1:18 PM Nicolas Roy-Renaud <<a href="mailto:nicolas.roy-renaud.1@ens.etsmtl.ca">nicolas.roy-renaud.1@ens.etsmtl.ca</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
Have you checked what "dmesg -w" shows while you start up a VM with
your GPU passed to it? I was having similar issues before, and it
turned out that I had to get libvirt to append the GPU to the VM
after it was done booting because of some invalid rom issues. Could
be worth a shot.</div><div bgcolor="#FFFFFF" text="#000000"><br>
<br>
<div>On 2016-01-27 11:13, Ryan Flagler
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">I pulled some different hardware from an unused
machine and did some testing. So far, on my initial test, I am
no longer seeing the driver crashes. It must have something to
do with my motherboard. That's frustrating, because it was a
Xeon E5 platform which I think Alex recommended in general.
<div><br>
</div>
<div>Thanks for all the advice everyone.<br>
<br>
<div class="gmail_quote">
<div dir="ltr">On Tue, Jan 26, 2016 at 11:56 AM Ryan Flagler
<<a href="mailto:ryan.flagler@gmail.com" target="_blank">ryan.flagler@gmail.com</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Thanks for the encouragement guys. I think
I'm going to try some scrounge for some other hardware
just to make sure my GPU isn't the problem. The only
other cards I have are AMD which besides rebooting
actually work solidly.</div>
<br>
<div class="gmail_quote">
<div dir="ltr">On Tue, Jan 26, 2016 at 11:36 AM Ruben
Felgenhauer <<a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank">4felgenh@informatik.uni-hamburg.de</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"> Hi, Ryan!<br>
<br>
Installing an older Kernel is probably easier than
you might think.<br>
On Ubuntu you should be able to find out which
kernels are in the repos with apt-cache,<br>
but I sadly don't know the params, so maybe take a
look at the manpage.<br>
And afterwards you should be able to install a
specific version with 'apt-get install
packagename=version'<br>
<br>
On Debian there is simply <a href="http://snapshot.debian.org/package/linux/" target="_blank">http://snapshot.debian.org/package/linux/</a>
which is how I downgraded from 4.3 to 4.1 on my
Debian testing.<br>
You can just download the deb files there and
install them with dpkg.<br>
Maybe if you search for a testing system that is
similar to Ubuntu, you could give that a try.<br>
<br>
But keep in mind that this doesn't uninstall the old
kernel, so you will have a fallback.<br>
You might need to select the right kernel at GRUB
though.<br>
<br>
Best regards,<br>
Ruben</div>
<div text="#000000" bgcolor="#FFFFFF"><br>
<br>
<div>Am 26.01.2016 um 18:11 schrieb Will Marler:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Well, you run Linux and you're
experimenting with VGA passthrough ... you're
resourceful! What about picking up a <a href="http://www.amazon.com/Samsung-16GB-Solid-State-Drive/dp/B003YMJPE8/ref=sr_1_3?ie=UTF8&qid=1453827934&sr=8-3&keywords=16GB+SSD" target="_blank">16GB SSD for $15</a> and
installing Arch (or Fedora, or Gentoo...
whatever suits) side by side with Ubuntu?
Presumably your VM can be launched either way
without any configuration changes ... when you
get tired/frustrated of the Arch/Fedora/Gentoo
way you reboot back. If it works, you've found
the answer, if it doesn't, you've improved your
Linux-fu for not much (monetary) cost.
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Jan 26, 2016 at
10:03 AM, Ryan Flagler <span dir="ltr"><<a href="mailto:ryan.flagler@gmail.com" target="_blank"><a href="mailto:ryan.flagler@gmail.com" target="_blank">ryan.flagler@gmail.com</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Yea, that's just a major
jump. Wish I had a dedicated test system
to try more things. ;)</div>
<div>
<div><br>
<div class="gmail_quote">
<div dir="ltr">On Tue, Jan 26, 2016 at
10:34 AM Will Marler <<a href="mailto:will@wmarler.com" target="_blank"><a href="mailto:will@wmarler.com" target="_blank">will@wmarler.com</a></a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Next up would be
Kernel, it sounds like...</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue,
Jan 26, 2016 at 8:27 AM, Ryan
Flagler <span dir="ltr"><<a href="mailto:ryan.flagler@gmail.com" target="_blank"><a href="mailto:ryan.flagler@gmail.com" target="_blank">ryan.flagler@gmail.com</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Thanks for this
info Will. Tried matching
your qemu/libvirt versions
and I still get the driver
crashes. I'm not sure what
else to try.</div>
<div>
<div><br>
<div class="gmail_quote">
<div dir="ltr">On Mon,
Jan 25, 2016 at 9:20
PM Will Marler <<a href="mailto:will@wmarler.com" target="_blank"><a href="mailto:will@wmarler.com" target="_blank">will@wmarler.com</a></a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hey
Ryan,
<div><br>
</div>
<div>Here are the
answers to your
questions:</div>
<div><br>
</div>
<div><span style="font-family:monospace"><span style="color:rgb(178,178,178)">20:06:27 </span><span style="color:rgb(24,178,24)">will</span><span style="color:rgb(0,0,0)"> </span><span style="font-weight:bold;color:rgb(84,84,255)">~</span><span style="color:rgb(0,0,0)">% uname -a </span><br>
Linux haze
4.3.3-2-ARCH #1
SMP PREEMPT Wed
Dec 23 20:09:18
CET 2015 x86_64
GNU/Linux<br>
</span></div>
<div><span style="font-family:monospace"><span style="color:rgb(178,178,178)">20:07:01 </span><span style="color:rgb(24,178,24)">will</span><span style="color:rgb(0,0,0)"> </span><span style="font-weight:bold;color:rgb(84,84,255)">~</span><span style="color:rgb(0,0,0)">% pacman -Q | egrep '^linux|^libvirt|^qemu' </span><br>
libvirt 1.3.1-1
<br>
libvirt-glib
0.2.2-1 <br>
libvirt-python
1.3.1-1 <br>
linux 4.3.3-2 <br>
linux-api-headers
4.1.4-1 <br>
linux-firmware
20151207.bbe4917-1
<br>
qemu 2.4.1-2<br>
<br>
</span></div>
<div>And here is the
pastebin to my XML
file: <a href="http://pastebin.com/nB3DPkEr" target="_blank"><a href="http://pastebin.com/nB3DPkEr" target="_blank">http://pastebin.com/nB3DPkEr</a></a><br>
</div>
<div><br>
</div>
<div>As far as the
guest drivers are
concerned, they're
the "GeForce Game
Ready Driver"
version 361.43.</div>
<div><br>
</div>
<div>HTH!</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Mon, Jan 25, 2016
at 10:12 AM, Ryan
Flagler <span dir="ltr"><<a href="mailto:ryan.flagler@gmail.com" target="_blank"><a href="mailto:ryan.flagler@gmail.com" target="_blank">ryan.flagler@gmail.com</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Thanks
Will. Here is
my info with
the guest that
crashes.
<div><br>
</div>
<div>
<div>Host OS
Info</div>
<div> ubuntu -
14.04.03</div>
<div> kernel -
3.19.0-47</div>
<div><br>
</div>
<div>virsh
version</div>
<div> Compiled
against
library:
libvirt 1.2.18</div>
<div> Using
library:
libvirt 1.2.18</div>
<div> Using
API: QEMU
1.2.18</div>
<div> Running
hypervisor:
QEMU 2.5.0</div>
<div><br>
</div>
<div>patches</div>
<div> I did
not manually
apply any
patches to
Qemu. Built
directly from
source.</div>
<div><br>
</div>
<div>Guest
Info</div>
<div> Windows
10</div>
<div> nVidia
Graphics
Driver 361.43</div>
<div><br>
</div>
<div>Guest
Event Viewer
Entry On
Driver Crash</div>
<div> Source -
nvlddmkm</div>
<div> Event ID
- 14</div>
<div> Info -
\Device\Video3
CMDre
00000004
0000011c
bad0011f
00000000
00d0011f</div>
</div>
<div><br>
</div>
<div>Guest XML
- Attached</div>
<div>
<div>
<div><br>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr">On
Mon, Jan 25,
2016 at 10:18
AM Will Marler
<<a href="mailto:will@wmarler.com" target="_blank"><a href="mailto:will@wmarler.com" target="_blank">will@wmarler.com</a></a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">On
Mon, Jan 25,
2016 at 9:07
AM, Ryan
Flagler <span dir="ltr"><<a href="mailto:ryan.flagler@gmail.com" target="_blank"><a href="mailto:ryan.flagler@gmail.com" target="_blank">ryan.flagler@gmail.com</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">Will,
could you tell
us the
following?</p>
<p dir="ltr">What
Linux
distribution
on host?<br>
</p>
</blockquote>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>Arch </div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">
What kernel
are you using
on host?<br>
What libvirt
version on
host?<br>
What qemu
version on
host?<br>
</p>
</blockquote>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>Will have
to check when
I'm home from
work & the
kids are
asnooze, but
it's
whatever's
latest (and
I'm not using
the
linux-vfio-lts
kernel) </div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">
What OS on
guest?<br>
</p>
</blockquote>
<div>Windows
10.</div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">
What nvidia
graphics
driver version
on guest?</p>
</blockquote>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>Again,
I'll have to
check. But the
latest or
nearly
latest. </div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">My
machines gpu
driver crashes
constantly and
I'm trying to
narrow down
why. Thanks!</p>
</blockquote>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div>How
frustrating :
(. I'll also
get a pastebin
of my XML for
you, in case
that will
help. I've
been running
"stable" since
mid 2015. I
use the quotes
because some
things tripped
me up (guest
machine can't
"sleep," can
only power on
& power
off; when host
machine goes
to sleep with
guest running,
on host
wake-up the
guest is
non-responsive
and 100%
CPU). </div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div><br>
</div>
<div>Will</div>
</div>
</div>
</div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div> </div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div> <br>
<div class="gmail_quote">
<div dir="ltr">On
Mon, Jan 25,
2016, 10:02
AM Will Marler
<<a href="mailto:will@wmarler.com" target="_blank"><a href="mailto:will@wmarler.com" target="_blank">will@wmarler.com</a></a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">This
is discussed
in <a href="http://vfio.blogspot.com/2015/05/vfio-gpu-how-to-series-part-4-our-first.html" target="_blank"><a href="http://vfio.blogspot.com/2015/05/vfio-gpu-how-to-series-part-4-our-first.html" target="_blank">http://vfio.blogspot.com/2015/05/vfio-gpu-how-to-series-part-4-our-first.html</a></a>.
You have to do
more than
<kvm><hidden
state='on'/></kvm>:<br>
<div><br>
</div>
<div>"The
GeForce card
is nearly as
easy, but we
first need to
work around
some of the
roadblocks
Nvidia has put
in place to
prevent you
from using the
hardware
you've
purchased in
the way that
you desire
(and by my
reading
conforms to
the EULA for
their
software, but
IANAL). For
this step we
again need to
run virsh edit
on the VM.
Within the
<features>
section,
remove
everything
between the
<hyperv>
tags,
including the
tags
themselves.
In their place
add the
following
tags:</div>
</div>
<div dir="ltr">
<div><br>
</div>
<div>
<kvm></div>
<div>
<hidden
state='on'/></div>
<div>
</kvm></div>
<div><br>
</div>
</div>
<div dir="ltr">
<div>Additionally,
within the
<clock>
tag, find the
timer named
hypervclock,
remove the
line
containing
this tag
completely.
Save and exit
the edit
session."</div>
<div><br>
</div>
<div>I can
confirm it
works, I've
been getting a
lot of mileage
from my
passed-through
750Ti lately
since getting
a Steam Link
:-D.</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Sun, Jan 24,
2016 at 7:32
AM, Ruben
Felgenhauer <span dir="ltr"><<a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank"><a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank">4felgenh@informatik.uni-hamburg.de</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"> Hi,<br>
<br>
finally I had
time to this
again. I tried
out
virt-manager
and after a
bit of playing
around with
it, it
/somewhat/
worked:<br>
<br>
The machine is
at least
booting. I
still have a
standard vga
card enabled
in the
virt-manager
config window.<br>
After the
machine has
booted, I can
see that the
device gets
recognized as
750ti.<br>
However, the
gpu doesn't
get used,
because of
'Code 43'.<br>
Code 43 is a
generic error,
so any idea
what it could
mean in this
case?<br>
<br>
Of course I
added the
<kvm><hidden
state='on'/></kvm>
lines at the
associated
position.<br>
<br>
Best regards,<br>
Ruben
<div>
<div><br>
<br>
<div>Am
18.01.2016 um
22:27 schrieb
Will Marler:<br>
</div>
<blockquote type="cite">
<div dir="ltr">I'm
not sure what
correct
command-line
syntax is.
Have you tried
using libvirt
and
VirtManager to
handle your VM
rather than
command line,
and modifying
the XML rather
than the
command line?
I think that's
generally the
preferred
method these
days (it's
certainly
easier from my
point of view,
and the way I
got my 750 Ti
to pass
through).</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Mon, Jan 18,
2016 at 11:04
AM, Ruben
Felgenhauer <span dir="ltr"><<a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank"><a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank">4felgenh@informatik.uni-hamburg.de</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"> Hi, Alex!<br>
<br>
Thanks for
your reply!<br>
My GPU indeed
has a seperate
audio device
located at
01:00.1.<br>
<br>
However, just
adding -device
vfio-pci,host=01:00.1
doesn't seem
to do the
trick.<br>
Of course the
corresponding
device is
already
blacklisted
and bound to
vfio.<br>
<br>
The Debian
Wiki entry
about VGA
passthrough (<a href="https://wiki.debian.org/VGAPassthrough" target="_blank"><a href="https://wiki.debian.org/VGAPassthrough" target="_blank">https://wiki.debian.org/VGAPassthrough</a></a>)
mentions QEMU
arguments like
"-device
vfio-pci,host=01:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on,romfile=...
-device
vfio-pci,host=01:00.1,bus=pcie.0"
which seems to
address GPUs
with audio
devices, but
if I try to do
something
similar, the
buses 'root'
and 'pcie'
couldn't be
found. Maybe I
missed
something very
important?<br>
<br>
On the same
article, it
says that the
"HDMI
soundcard
[...] needs to
be unbound
from its
driver":<br>
# echo
'0000:01:00.1'
| sudo tee
/sys/bus/pci/devices/0000:01:00.1/driver/unbind<br>
I figured the
vfio-bind
script from
the Arch Linux
Forum thread (<a href="https://bbs.archlinux.org/viewtopic.php?id=162768" target="_blank"><a href="https://bbs.archlinux.org/viewtopic.php?id=162768" target="_blank">https://bbs.archlinux.org/viewtopic.php?id=162768</a></a>)
would do
exactly this
thing, so I
didn't
explicitly do
so for the
audio device.
Is that okay?<br>
<br>
Best regards,<br>
Ruben
<div>
<div><br>
<br>
<div>Am
18.01.2016 um
08:31 schrieb
Alexander
Petrenz:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi
Ruben,
<div><br>
</div>
<div>I guess
your 750ti
also has some
audio device.
You should
pass through
this too. It
should be
something like
01:00.1. There
are many
command line
examples you
can find about
that.</div>
<div>Also I´m
not quite
sure, if you
should remove
the x-vga=on.</div>
<div><br>
</div>
<div>Regards</div>
<div>Alex</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Sun, Jan 17,
2016 at 11:12
PM, Ruben
Felgenhauer <span dir="ltr"><<a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank"><a href="mailto:4felgenh@informatik.uni-hamburg.de" target="_blank">4felgenh@informatik.uni-hamburg.de</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi,<br>
<br>
I am trying to
pass my nVidia
GTX 750ti to
my QEMU guest.<br>
<br>
Problem is:
After the QEMU
monitor pops
up, nothing
happens. The
GPU's output
is dead, and
the vm won't
be accessible
via SSH
anymore, so
it's very
likely that
the VM isn't
booting up at
all. Also,
there are no
error messages
from QEMU on
the console
whatsoever
which makes
debugging it
especially
hard.<br>
<br>
This is how I
start the vm
with normal
vga emulation:<br>
qemu-system-x86_64
-hda vm.ovl
-boot c
-enable-kvm -m
1024 -cpu
host,kvm=off
-smp
cores=4,threads=2
-redir
tcp:5022::22<br>
Everything
runs fine in
this case. To
do the
passthrough, I
add this:<br>
-device
vfio-pci,host=01:00.0,multifunction=on,x-vga=on
-vga none<br>
This brings
said problems
with it. I
also tried out
multiple
different
combinations
of -device's
arguments or
even adding a
romfile for
the GPU, but
none of these
steps changed
anything at
all.<br>
<br>
Obviously, I
am using a
BIOS
installation
and I'm
well-aware
with this bug:
<a href="https://bugzilla.kernel.org/show_bug.cgi?id=107561" target="_blank"><a href="https://bugzilla.kernel.org/show_bug.cgi?id=107561" target="_blank">https://bugzilla.kernel.org/show_bug.cgi?id=107561</a></a>,
but neither
using less RAM
(as you can
see I am using
1GB now) nor
switching to
an older
Kernel changed
anything about
the problem. I
have tried
Kernel 4.1.0
and 4.3.0.<br>
<br>
Host is Debian
testing with
QEMU 2.5.0.<br>
I tried both
Debian and
Windows 7 as a
guest, but
both are
showing
exactly the
same
behaviour.<br>
Mainboard is
an ASUS
Z87-PLUS. The
750ti is
produced by
ASUS aswell.<br>
<br>
Any idea how I
could get
passthrough
running?<br>
<br>
_______________________________________________<br>
vfio-users
mailing list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank"><a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a></a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank"><a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a></a><br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
vfio-users
mailing list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank"><a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a></a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank"><a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a></a><br>
<br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
_______________________________________________<br>
vfio-users
mailing list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank"><a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a></a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank"><a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a></a><br>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div>
</blockquote>
</div>
</blockquote>
</div>
</div>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
vfio-users mailing list
<a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a>
</pre>
</blockquote>
<br>
</div></blockquote></div>