<div dir="ltr">I use virsh:<div><br></div><div>===SNIP===</div><div><div> <vcpu placement='static'>3</vcpu></div><div> <cputune></div><div> <vcpupin vcpu='0' cpuset='1'/></div><div> <vcpupin vcpu='1' cpuset='2'/></div><div> <vcpupin vcpu='2' cpuset='3'/></div><div> <emulatorpin cpuset='6-7'/></div><div> </cputune></div><div>===SNAP===</div><div><br></div><div>I have a prepare script running:</div><div><br></div><div><div>===SNIP===</div><div>sudo mkdir /cpuset</div><div>sudo mount -t cpuset none /cpuset/</div><div>cd /cpuset</div><div>echo 0 | sudo tee -a cpuset.cpu_exclusive<br></div><div>echo 0 | sudo tee -a cpuset.mem_exclusive</div><div><br></div><div>sudo mkdir sys</div><div>echo 'Building shield for core system... threads 0 and 4, and we place all runnning tasks there'</div><div>/bin/echo 0,4 | sudo tee -a sys/cpuset.cpus</div><div>/bin/echo 0 | sudo tee -a sys/cpuset.mems</div><div>/bin/echo 0 | sudo tee -a sys/cpuset.cpu_exclusive</div><div>/bin/echo 0 | sudo tee -a sys/cpuset.mem_exclusive</div><div>for T in `cat tasks`; do sudo bash -c "/bin/echo $T > sys/tasks">/dev/null 2>&1 ; done</div><div>cd -</div></div><div>===SNAP===</div><div><br></div><div>Note that i use this command line for the kernel</div><div><div>nohz_full=1,2,3,4,5,6,7 rcu_nocbs=1,2,3,4,5,6,7 default_hugepagesz=1G hugepagesz=1G hugepages=12</div></div></div><div><br></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr">--<div>Deldycke Quentin<br></div><div><div><br></div></div></div></div></div>
<br><div class="gmail_quote">On 9 January 2016 at 15:40, rndbit <span dir="ltr"><<a href="mailto:rndbit@sysret.net" target="_blank">rndbit@sysret.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
Mind posting actual commands how you achieved this?<br>
<br>
All im doing now is this:<br>
<blockquote type="cite">cset set -c 0-3 system<br>
cset proc -m -f root -t system -k<br>
</blockquote><span class="">
<blockquote type="cite"> <vcpu
placement='static'>4</vcpu><br>
<cputune><br>
<vcpupin vcpu='0' cpuset='4'/><br>
<vcpupin vcpu='1' cpuset='5'/><br>
<vcpupin vcpu='2' cpuset='6'/><br>
<vcpupin vcpu='3' cpuset='7'/><br>
<emulatorpin cpuset='0-3'/><br>
</cputune></blockquote></span>
Basically this puts most of threads to 0-3 cores including emulator
threads. Some threads cant be moved though so they remain on 4-7
cores. VM is given 4-7 cores. It works better but there is still
much to be desired.<div><div class="h5"><br>
<br>
<br>
<div>On 2016.01.09 15:59, Quentin Deldycke
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hello,
<div><br>
</div>
<div>Using cpuset, i was using the vm with:</div>
<div><br>
</div>
<div>Core 0: threads 0 & 4: linux + emulator pin</div>
<div>Core 1,2,3: threads 1,2,3,5,6,7: windows</div>
<div><br>
</div>
<div>I tested with:</div>
<div>Core 0: threads 0 & 4: linux</div>
<div>Core 1,2,3: threads 1,2,3: windows</div>
<div>Core 1,2,3: threads 5,6,7: emulator</div>
<div><br>
</div>
<div>The difference between both is huge (DPC latency is mush
more stable):</div>
<div>Performance on single core went up to 50% (cinebench ratio
by core from 100 to 150 points)</div>
<div>Performance on gpu went up to 20% (cinebench from 80fps to
100+)</div>
<div>Performance on "heroes of the storm" went from 20~30 fps to
stable 60 (and much time more than 100)</div>
<div><br>
</div>
<div>(performance of Unigine Heaven went from 2700 points to
3100 points)</div>
<div><br>
</div>
<div>The only sad thing is that i have the 3 idle threads which
are barely used... Is there any way to put them back to
windows?</div>
<div><br>
</div>
<div class="gmail_extra">
<div>
<div>
<div dir="ltr">--
<div>Deldycke Quentin<br>
</div>
<div>
<div><br>
</div>
</div>
</div>
</div>
</div>
<br>
<div class="gmail_quote">On 29 December 2015 at 17:38, Michael
Bauer <span dir="ltr"><<a href="mailto:michael@m-bauer.org" target="_blank">michael@m-bauer.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"> I noticed that
attaching a DVD-Drive from the host leads to HUGE
delays. I had attached my /dev/sr0 to the guest and even
without a DVD in the drive this was causing huge lag
about once per second.<br>
<br>
Best regards<span><font color="#888888"><br>
Michael</font></span>
<div>
<div><br>
<br>
<div>Am 28.12.2015 um 19:30 schrieb rndbit:<br>
</div>
<blockquote type="cite"> 4000μs-16000μs here, its
terrible.<br>
Tried whats said on <a href="https://lime-technology.com/forum/index.php?topic=43126.15" target="_blank">https://lime-technology.com/forum/index.php?topic=43126.15</a><br>
Its a bit better with this:<br>
<blockquote type="cite"> <vcpu
placement='static'>4</vcpu><br>
<cputune><br>
<vcpupin vcpu='0' cpuset='4'/><br>
<vcpupin vcpu='1' cpuset='5'/><br>
<vcpupin vcpu='2' cpuset='6'/><br>
<vcpupin vcpu='3' cpuset='7'/><br>
<emulatorpin cpuset='0-3'/><br>
</cputune></blockquote>
I tried <i>isolcpus</i> but it did not yield
visible benefits. <i>ndis.sys</i> is big offender
here but i dont really understand why. Removing
network interface from VM makes <i>usbport.sys</i>
take over as biggest offender. All this happens
with <i>performance</i> governor of all cpu
cores:<br>
<blockquote type="cite">echo performance | tee
/sys/devices/system/cpu/cpu*/cpufreq/scaling_governor
>/dev/null</blockquote>
Cores remain clocked at 4k mhz. I dont know what
else i could try. Does anyone have any ideas..?<br>
<br>
<div>On 2015.10.29 08:03, Eddie Yen wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">I tested again with VM reboot, I
found that this time is about 1000~1500<span style="font-size:12.8000001907349px">μs.</span><br>
<div><span style="font-size:12.8000001907349px">Also
I found that it easily get high while hard
drive is loading, but only few times.</span></div>
<div><br>
</div>
<div><span style="font-size:12.8000001907349px">Which
specs you're using? Maybe it depends on
CPU or patches.</span></div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2015-10-29 13:44
GMT+08:00 Blank Field <span dir="ltr"><<a href="mailto:ihatethisfield@gmail.com" target="_blank"></a><a href="mailto:ihatethisfield@gmail.com" target="_blank">ihatethisfield@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">If i understand it right,
this software has a fixed latency error
of 1 ms(1000us) in windows 8-10 due to
different kernel timer implementation.
So i guess your latency is very good.</p>
<div>
<div>
<div class="gmail_quote">On Oct 29,
2015 8:40 AM, "Eddie Yen" <<a href="mailto:missile0407@gmail.com" target="_blank"></a><a href="mailto:missile0407@gmail.com" target="_blank">missile0407@gmail.com</a>>
wrote:<br type="attribution">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Thanks for
information! And sorry I don'r
read carefully at beginning
message.
<div><br>
</div>
<div>For my result, I got about
1000<span style="font-size:12.8000001907349px">μs
below and only few times got
1000</span><span style="font-size:12.8000001907349px">μs
above when idling.</span></div>
<div><span style="font-size:12.8000001907349px"><br>
</span></div>
<div><span style="font-size:12.8000001907349px">I'm
using 4820K and used 4
threads to VM, also I set
these 4 threads as 4 cores
in VM settings.</span></div>
<div><span style="font-size:12.8000001907349px">The
OS is Windows 10.</span></div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2015-10-29
13:21 GMT+08:00 Blank Field <span dir="ltr"><<a href="mailto:ihatethisfield@gmail.com" target="_blank"></a><a href="mailto:ihatethisfield@gmail.com" target="_blank">ihatethisfield@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">I think they're
using this:<br>
<a href="http://www.thesycon.de/deu/latency_check.shtml" target="_blank">www.thesycon.de/deu/latency_check.shtml</a></p>
<div>
<div>
<div class="gmail_quote">On
Oct 29, 2015 6:11 AM,
"Eddie Yen" <<a href="mailto:missile0407@gmail.com" target="_blank"></a><a href="mailto:missile0407@gmail.com" target="_blank">missile0407@gmail.com</a>>
wrote:<br type="attribution">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Sorry,
but how to check
DPC Latency?</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2015-10-29
10:08 GMT+08:00
Nick Sukharev <span dir="ltr"><<a href="mailto:nicksukharev@gmail.com" target="_blank"></a><a href="mailto:nicksukharev@gmail.com" target="_blank">nicksukharev@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">I
just checked
on W7 and I
get <span style="font-size:12.8px">3000</span><span style="font-size:12.8px">μs-4000</span><span style="font-size:12.8px">μs
one one of the
guests when 3
guests are
running.</span></div>
<div class="gmail_extra"><br>
<div class="gmail_quote">
<div>
<div>On Wed,
Oct 28, 2015
at 4:52 AM,
Sergey Vlasov
<span dir="ltr"><<a href="mailto:sergey@vlasov.me" target="_blank"></a><a href="mailto:sergey@vlasov.me" target="_blank">sergey@vlasov.me</a>></span>
wrote:<br>
</div>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div>
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote"><span>On
27 October
2015 at 18:38,
LordZiru <span dir="ltr"><<a href="mailto:lordziru@gmail.com" target="_blank"></a><a href="mailto:lordziru@gmail.com" target="_blank">lordziru@gmail.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div>I have
brutal DPC
Latency on
qemu, no
matter if
using
pci-assign or
vfio-pci or
without any
passthrought,
<br>
</div>
<br>
my DPC Latency
is like:<br>
<div>10000,500,8000,6000,800,300,12000,9000,700,2000,9000<br>
</div>
<div>and on
native windows
7 is like: <br>
20,30,20,50,20,30,20,20,30<br>
</div>
</div>
</blockquote>
<div> </div>
</span>In<span>
Windows 10
guest I
constantly
have red bars
around 3000</span><span><span>μ</span>s
(microseconds),
spiking
sometimes up
to 10000</span><span><span>μ</span>s</span>.<span><br>
<div><span><br>
</span></div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div><br>
I don't know
how to fix it.<br>
</div>
<div>this
matter for me
because i are
using USB
Sound Card for
my VMs, <br>
and i get
sound
drop-outs
every 0-4
secounds<br>
</div>
<div><br>
</div>
</div>
</blockquote>
<div><br>
</div>
</span>
<div>That bugs
me a lot too.
I also use an
external USB
card and my
DAW
periodically
drops out :(<br>
<br>
I haven't
tried CPU
pinning yet
though. And
perhaps I
should try
Windows 7.<br>
</div>
</div>
<br>
</div>
</div>
<br>
</div>
</div>
_______________________________________________<br>
vfio-users
mailing list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank"></a><a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank"></a><a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
_______________________________________________<br>
vfio-users
mailing list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank"></a><a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" rel="noreferrer" target="_blank"></a><a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
_______________________________________________<br>
vfio-users mailing
list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank"></a><a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" rel="noreferrer" target="_blank"></a><a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a><br>
<br>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
vfio-users mailing list
<a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a>
</pre>
</blockquote>
<br>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
vfio-users mailing list
<a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a>
</pre>
</blockquote>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
vfio-users mailing list<br>
<a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
vfio-users mailing list
<a href="mailto:vfio-users@redhat.com" target="_blank">vfio-users@redhat.com</a>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a>
</pre>
</blockquote>
<br>
</div></div></div>
<br>_______________________________________________<br>
vfio-users mailing list<br>
<a href="mailto:vfio-users@redhat.com">vfio-users@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/vfio-users" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/vfio-users</a><br>
<br></blockquote></div><br></div>