<html> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> </head> <body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""> <span class="">Hi all:<br class=""> </span><span class=""><br class=""> </span><span class="">As we are know Intel® Xeon phi targets high-performance computing and other parallel workloads.<br class=""> </span><span class="">Now qemu has supported phi virtualization，it is time for libvirt to support phi.<br class=""> </span><span class=""><br class=""> </span><span class="">Different from the traditional X86 server, There is a special numa node with Multi-Channel DRAM (MCDRAM) on Phi, but without any CPU .<br class=""> </span><span class=""><br class=""> </span><span class="">Now libvirt requires nonempty cpus argument for NUMA node, such as. <br class=""> </span><span class=""><numa><br class=""> </span><span class=""> <cell id='0' cpus='0-239' memory='80' unit='GiB'/> <br class=""> </span><span class=""> <cell id='1' cpus='240-243' memory='16' unit='GiB'/><br class=""> </span><span class=""></numa><br class=""> </span><span class=""><br class=""> </span><span class="">In order to support phi virtualization, libvirt needs to allow a numa cell definition without 'cpu' attribution.<br class=""> </span><span class="">Such as:<br class=""> </span><span class=""><numa><br class=""> </span><span class=""> <cell id='0' cpus='0-239' memory='80' unit='GiB'/><br class=""> </span><span class=""> <cell id='1' memory='16' unit='GiB'/><br class=""> </span><span class=""></numa><br class=""> </span><span class="">When a cell without 'cpu', qemu will allocate memory by default MCDRAM instead of DDR.<br class=""> </span><span class=""><br class=""> </span><span class="">Now here I'd like to discuss these questions:<br class=""> </span><span class="">1. This feature is only for Phi at present, but we will check Phi platform for CPU-less NUMA node.<br class=""> </span><span class=""> The NUMA node without CPU indicates MCDRAM node. And for now MCDRAM is available only for PHI.<br class=""> </span><span class="">However, there is no reason that any other platform couldn’t define CPU-less NUMA node using libvirt, so there is no reason to check if PHI is used or not.<br class=""> </span><span class=""><br class=""> </span><span class="">2. Type of memory of CPU-less NUMA node will not be checked during machine creation/configuration step.<br class=""> </span><span class=""> There is no reliable way to distinguish if the node is MCDRAM or regular DDR. This step is not concerned with type of the memory, only with NUMA assignment.<br class=""> </span><span class=""><br class=""> </span><span class="">3. Unlike traditional memory assign to a VM, MCDRAM do not support over commit<br class=""> If the memory of a virtual NUMA node is going to be explicitly bound to physical NUMA node then it shouldn’t exceed the size of its corresponding NUMA node, doesn’t matter if it is MCDRAM or DDR.<br class=""> <br class=""> 4. Make sure at least one numa must include a CPU info field be passed to qemu.<br class=""> At least one NUMA node must define list of CPUs assigned, or if none has it assigned by default assign all CPUs to virtual NUMA node 0.<br class=""> </span><span class=""><br class=""> </span> <div class=""><span class="">More info for phi:<br class=""> </span></div> <div class=""> <table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="768" style="width: 6.4in; margin-left: 15.05pt; border-collapse: collapse;"> <tbody class=""> <tr class=""> <td width="469" valign="top" style="width: 281.65pt; border-style: none solid solid; border-right-color: windowtext; border-bottom-color: windowtext; border-left-color: windowtext; border-right-width: 1pt; border-bottom-width: 1pt; border-left-width: 1pt; background-color: rgb(47, 84, 150); padding: 0in 5.4pt; background-position: initial initial; background-repeat: initial initial;" class=""> <div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""> <span style="color: white;" class="">Knights Landing Key Information <o:p class=""></o:p></span></div> </td> <td width="458" valign="top" style="width: 274.65pt; border-style: none solid solid none; border-bottom-color: windowtext; border-bottom-width: 1pt; border-right-color: windowtext; border-right-width: 1pt; background-color: rgb(47, 84, 150); padding: 0in 5.4pt; background-position: initial initial; background-repeat: initial initial;" class=""> <div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""> <span style="color: white;" class="">Software Resources</span><span style="color: rgb(0, 113, 197);" class=""><o:p class=""></o:p></span></div> </td> </tr> <tr style="height: 201.5pt;" class=""> <td width="469" valign="top" style="width: 281.65pt; border-style: none solid solid; border-right-color: windowtext; border-bottom-color: windowtext; border-left-color: windowtext; border-right-width: 1pt; border-bottom-width: 1pt; border-left-width: 1pt; background-color: white; padding: 0in 5.4pt; height: 201.5pt; background-position: initial initial; background-repeat: initial initial;" class=""> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="http://www.intel.com/content/www/us/en/processors/xeon/xeon-phi-detail.html" style="color: purple;" class="">Intel® Xeon Phi™ Product Family Main Page</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><o:p class=""></o:p></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="https://newsroom.intel.com/press-kits/intel-isc/" style="color: purple;" class="">Intel® Xeon Phi™ Processor Press Kit</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><o:p class=""></o:p></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="http://mark.intel.com/products/family/92650/Intel-Xeon-Phi-Product-Family-x200#@Server" style="color: purple;" class="">Intel® Xeon Phi™ Processor SKU Details</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><o:p class=""></o:p></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span style="font-size: 6pt; font-family: Symbol;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span><b class=""><i class=""><span style="color: red;" class="">Updated</span></i></b> <a href="https://software.intel.com/en-us/articles/intel-xeon-phi-processor-applications-performance-proof-points" style="color: purple;" class="">Intel® Xeon Phi™ Application Proof Points</a><o:p class=""></o:p></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="http://www.intel.com/content/www/us/en/benchmarks/server/xeon-phi/xeon-phi-competitive-performance.html" style="color: purple;" class="">Intel® Xeon Phi™ Public Performance Data</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><o:p class=""></o:p></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span style="font-size: 6pt; font-family: Symbol;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span><a href="http://dap.xeonphi.com/#platformspecs" style="color: purple;" class="">Developer Access Program (DAP)</a><o:p class=""></o:p></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="https://software.intel.com/en-us/articles/what-disclosures-has-intel-made-about-knights-landing" style="color: purple;" class="">Knights Landing – Public Disclosures</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><o:p class=""></o:p></span></div> <div style="margin: 0in 0in 0.0001pt 0.1in; font-size: 12pt; font-family: 'Times New Roman', serif; page-break-after: avoid;" class=""> <span style="font-size: 9pt; color: rgb(0, 32, 96);" class=""> </span></div> </td> <td width="458" valign="top" style="width: 274.65pt; border-style: none solid solid none; border-bottom-color: windowtext; border-bottom-width: 1pt; border-right-color: windowtext; border-right-width: 1pt; padding: 0in 5.4pt; height: 201.5pt;" class=""> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="https://software.intel.com/en-us/modern-code" style="color: purple;" class="">Intel® Modern Code</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><o:p class=""></o:p></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="https://software.intel.com/en-us/xeon-phi/x200-processor" style="color: purple;" class="">Intel® Xeon Phi™ Software Code Recipes</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><o:p class=""></o:p></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="https://software.intel.com/en-us/xeon-phi/x200-processor" style="color: purple;" class="">Intel® Xeon Phi™ SW Tools and Libraries</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><o:p class=""></o:p></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span style="font-size: 6pt; font-family: Symbol; color: rgb(0, 32, 96);" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span><a href="https://software.intel.com/en-us/machine-learning" style="color: purple;" class="">Machine Learning</a><span style="color: rgb(0, 32, 96);" class=""><o:p class=""></o:p></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span style="font-size: 6pt; font-family: Symbol; color: rgb(0, 32, 96);" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span><a href="https://software.intel.com/en-us/articles/intel-xeon-phi-processor-software" style="color: purple;" class=""><span lang="EN" class="">Intel® Xeon Phi™ Processor Software</span></a><u class=""><span style="color: rgb(0, 32, 96);" class=""><o:p class=""></o:p></span></u></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; color: rgb(0, 32, 96); text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="http://software.intel.com/en-us/articles/intel-software-tools-technical-webinar-series" style="color: purple;" class="">Intel® Software Tools Technical Webinar Series</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="color: rgb(0, 32, 96);" class=""><o:p class=""></o:p></span></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; color: rgb(0, 32, 96); text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="https://software.intel.com/en-us/articles/intel-xeon-phi-coprocessor-applications-and-solutions-catalog" style="color: purple;" class="">Intel® Xeon Phi™ Coprocessor – Applications and Solutions Catalog</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="color: rgb(0, 32, 96);" class=""><o:p class=""></o:p></span></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="font-size: 6pt; font-family: Symbol; color: rgb(0, 32, 96); text-decoration: none;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span></span><a href="http://software.intel.com/mic-developer" style="color: purple;" class="">Intel® MIC Developer Zone</a><span class="MsoHyperlink" style="color: blue; text-decoration: underline;"><span style="color: rgb(0, 32, 96);" class=""><o:p class=""></o:p></span></span></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span style="font-size: 6pt; font-family: Symbol;" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span><a href="https://software.intel.com/en-us/xeon-phi-nda/tools" style="color: purple;" class="">Intel® Xeon Phi™ Processor Product Family Early Release Software and Tools</a> (request access to the site <a href="https://software.intel.com/en-us/form/intel-xeon-phi-nda-site-access-request" style="color: purple;" class="">here</a>)<o:p class=""></o:p></div> <div style="margin: 0in 0in 0.0001pt 0.2in; font-size: 11pt; font-family: 'Intel Clear', sans-serif; text-indent: -0.1in; page-break-after: avoid;" class=""> <span style="font-size: 6pt; font-family: Symbol; color: rgb(0, 32, 96);" class="">ð<span style="font-size: 7pt; font-family: 'Times New Roman';" class=""> </span></span><a href="https://software.intel.com/en-us/free_tools_and_libraries" style="color: purple;" class="">Intel® Parallel Studio XE Tools and Libraries</a><span style="color: rgb(0, 32, 96);" class=""><o:p class=""></o:p></span></div> </td> </tr> </tbody> </table> <div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""> <span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""> </span></div> <div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""> <a name="_MailEndCompose" class=""><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""><br class=""> </span></a></div> </div> </body> </html>