<div dir="ltr">so I was able to upgrade to the indicated versions. Had to go to Fedora 25, since it natively supports these versions, and centos doesn't. upgrading centos proved to be unreasonably difficult for me.<div><br></div><div>After upgrading I added the syntax as described in the docs. I have configured 4 vcpus and 2 numa nodes. Node 0 has vcpus 0-1 and node 1 has vcpus 2-3. Configured two pci-expander-buses: index 1 assigned to node 0 and index 2 assigned to node 1.</div><div><br></div><div>I use these indices for the bus values in the interfaces. But on booting up the system, only the interfaces connected to node 1 are visible to the guest OS.</div><div><br></div><div>Not sure why that would be.</div><div><br></div><div>If there are any ideas, that would be great.</div><div><br></div><div>Happy thanksgiving to the US folks.</div></div><div class="gmail_extra"><br><div class="gmail_quote">On 22 November 2016 at 08:04, Amir Shehata <span dir="ltr"><<a href="mailto:amir.shehata.whamcloud@gmail.com" target="_blank">amir.shehata.whamcloud@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Laine,<div><br></div><div>Thanks. You're correct that I haven't gotten to use the new pci bus yet.</div><div><br></div><div>I'm currently trying to upgrade to the versions you specified. Just having a bunch of problems... I'll let you know the results of the experiment once I sort them out.</div><div><br></div><div>thanks</div><span class="HOEnZb"><font color="#888888"><div>amir</div></font></span></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On 21 November 2016 at 14:06, Laine Stump <span dir="ltr"><<a href="mailto:laine@laine.org" target="_blank">laine@laine.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span>On 11/21/2016 04:48 PM, Amir Shehata wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Laine,<br>
<br>
Thank you for your response.<br>
<br>
I did use the numa element instead of using qemu commandline and that worked:<br>
<br>
16 <cpu mode='custom' match='exact'><br>
...<br>
34 <numa><br>
35 <cell id='0' cpus='0-1' memory='1048576' unit='KiB'/><br>
36 <cell id='1' cpus='2-3' memory='1048576' unit='KiB'/><br>
37 </numa><br>
38 </cpu><br>
<br>
However, whenever I try to use the pci-expander-bus I get:<br>
error: XML document failed to validate against schema: Unable to validate doc against /usr/share/libvirt/schemas/dom<wbr>ain.rng<br>
Extra element devices in interleave<br>
Element domain failed to validate content<br>
</blockquote>
<br></span>
Sorry, I forgot to mention that pci-expander-bus is a fairly recent addition to libvirt and qemu. For libvirt support of that controller, you'll need at least libvirt 1.3.4, and qemu 2.4.0. Anything earlier than that and the guest OS won't have any visibility to the NUMA node of specific devices.<span><br>
<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
I tried the following<br>
<br>
93 <controller type='pci' index='1' model='pci-expander-bus'><br>
94 <address type='pci' domain='0x0000' bus='0x00' slot='0x0b' function='0x0'/><br>
95 </controller><br>
<br>
and<br>
<br>
93 <controller type='pci' index='1' model='pci-expander-bus'><br>
94 <target busNr='254'><br>
95 <node>1</node><br>
96 </target><br>
97 <address type='pci' domain='0x0000' bus='0x00' slot='0x0b' function='0x0'/><br>
98 </controller><br>
<br>
<br>
I got the syntax from: <a href="https://www.redhat.com/archives/libvir-list/2016-March/msg01224.html" rel="noreferrer" target="_blank">https://www.redhat.com/archive<wbr>s/libvir-list/2016-March/msg01<wbr>224.html</a><br>
<br>
Just to give you a bit more info. This is running on:<br>
Linux ashehata-DellPE 3.19.0-51-generic #58-Ubuntu SMP Fri Feb 26 21:22:26 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux<br>
</blockquote>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
below is a dump of the working XML file I'm using<br>
</blockquote>
<br></span>
I notice you don't have any device with pci bus='1'. I'm assuming you just hadn't gotten to that part of the experiment yet, correct?<br>
<br>
<br>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>