[libvirt] [PATCH] nodeinfo: Get the correct CPU number on AMD Magny Cours platform

Osier Yang jyang at redhat.com
Fri May 11 14:28:21 UTC 2012


"Instead of developing one CPU with 12 cores, the Magny Cours is
actually two 6 core “Bulldozer” CPUs combined in to one package"

I.e, each package has two NUMA nodes, and the two numa nodes share
the same core ID set (0-6), which means parsing the cores number
from sysfs doesn't work in this case.

And the wrong CPU number could cause three problems for libvirt:

1) performance lost

  A domain without "cpuset" or "placement='auto'" (to drive numad)
specified will be only pinned to part of the CPUs.

2) domain can be started

  If a domain uses numad, and the advisory nodeset returned from
numad contains node which exceeds the range of wrong total CPU
number. The domain will fail to start, as the bitmask passed to
sched_setaffinity could be fully filled with zero.

3) wrong CPU number affects lots of stuffs.

  E.g. for command "virsh vcpuinfo", "virsh vcpupin", it will always
output with the truncated CPU list.

For more details:

https://www.redhat.com/archives/libvir-list/2012-May/msg00607.html

This patch is to fix the problem by parsing /proc/cpuinfo to get
the value of field "cpu cores", and use it as nodeinfo->cores if
it's greater than the cores number from sysfs.
---
 src/nodeinfo.c |   28 ++++++++++++++++++++++++++++
 1 files changed, 28 insertions(+), 0 deletions(-)

diff --git a/src/nodeinfo.c b/src/nodeinfo.c
index 56b9f54..87a6ad6 100644
--- a/src/nodeinfo.c
+++ b/src/nodeinfo.c
@@ -211,6 +211,7 @@ int linuxNodeInfoCPUPopulate(FILE *cpuinfo,
     cpu_set_t core_mask;
     cpu_set_t socket_mask;
     int online;
+    unsigned int cpu_cores = 0;
 
     nodeinfo->cpus = 0;
     nodeinfo->mhz = 0;
@@ -251,6 +252,23 @@ int linuxNodeInfoCPUPopulate(FILE *cpuinfo,
                 && (*p == '\0' || *p == '.' || c_isspace(*p)))
                 nodeinfo->mhz = ui;
         }
+
+        if (STRPREFIX(buf, "cpu cores")) {
+            char *p;
+            unsigned int ui;
+            buf += 9;
+            while (*buf && c_isspace(*buf))
+                buf++;
+            if (*buf != ':' || !buf[1]) {
+                nodeReportError(VIR_ERR_INTERNAL_ERROR,
+                                "%s", _("parsing cpuinfo cpu MHz"));
+                return -1;
+            }
+            if (virStrToLong_ui(buf+1, &p, 10, &ui) == 0
+                /* Accept trailing fractional part.  */
+                && (*p == '\0' || *p == '.' || c_isspace(*p)))
+                cpu_cores = ui;
+         }
 # elif defined(__powerpc__) || \
       defined(__powerpc64__)
         char *buf = line;
@@ -353,6 +371,16 @@ int linuxNodeInfoCPUPopulate(FILE *cpuinfo,
         return -1;
     }
 
+    /* Platform like AMD Magny Cours has two NUMA nodes each package, and
+     * the two nodes share the same core ID set, it results in the cores
+     * number calculated from sysfs is not the actual cores number. Use
+     * "cpu cores" in /proc/cpuinfo as the cores number instead in this case.
+     * More details about the problem:
+     * https://www.redhat.com/archives/libvir-list/2012-May/msg00607.html
+     */
+    if (cpu_cores && (cpu_cores > nodeinfo->cores))
+        nodeinfo->cores = cpu_cores;
+
     /* nodeinfo->sockets is supposed to be a number of sockets per NUMA node,
      * however if NUMA nodes are not composed of whole sockets, we just lie
      * about the number of NUMA nodes and force apps to check capabilities XML
-- 
1.7.7.3




More information about the libvir-list mailing list