<div dir="ltr"><div class="gmail_default" style=""><div class="gmail_default" style="font-family:georgia,serif">I am using 1G huge pages and as i have 2 numa node configuration, i am ensuring that VM memory is pinned to numazone 1( coz my bus is in numazone 1)</div><div class="gmail_default" style="font-family:georgia,serif"><br></div><div class="gmail_default" style="font-family:georgia,serif">[root@localhost vcr]# cat /proc/meminfo</div><div class="gmail_default" style="font-family:georgia,serif">MemTotal: 396231416 kB</div><div class="gmail_default" style="font-family:georgia,serif">MemFree: 272286932 kB</div><div class="gmail_default" style="font-family:georgia,serif">MemAvailable: 284401916 kB</div><div class="gmail_default" style="font-family:georgia,serif">Buffers: 2508 kB</div><div class="gmail_default" style="font-family:georgia,serif">Cached: 11876580 kB</div><div class="gmail_default" style="font-family:georgia,serif">SwapCached: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">Active: 11108860 kB</div><div class="gmail_default" style="font-family:georgia,serif">Inactive: 10023144 kB</div><div class="gmail_default" style="font-family:georgia,serif">Active(anon): 9261072 kB</div><div class="gmail_default" style="font-family:georgia,serif">Inactive(anon): 9464 kB</div><div class="gmail_default" style="font-family:georgia,serif">Active(file): 1847788 kB</div><div class="gmail_default" style="font-family:georgia,serif">Inactive(file): 10013680 kB</div><div class="gmail_default" style="font-family:georgia,serif">Unevictable: 16372 kB</div><div class="gmail_default" style="font-family:georgia,serif">Mlocked: 16372 kB</div><div class="gmail_default" style="font-family:georgia,serif">SwapTotal: 4194300 kB</div><div class="gmail_default" style="font-family:georgia,serif">SwapFree: 4194300 kB</div><div class="gmail_default" style="font-family:georgia,serif">Dirty: 256 kB</div><div class="gmail_default" style="font-family:georgia,serif">Writeback: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">AnonPages: 9277540 kB</div><div class="gmail_default" style="font-family:georgia,serif">Mapped: 268960 kB</div><div class="gmail_default" style="font-family:georgia,serif">Shmem: 11248 kB</div><div class="gmail_default" style="font-family:georgia,serif">Slab: 677860 kB</div><div class="gmail_default" style="font-family:georgia,serif">SReclaimable: 499240 kB</div><div class="gmail_default" style="font-family:georgia,serif">SUnreclaim: 178620 kB</div><div class="gmail_default" style="font-family:georgia,serif">KernelStack: 16368 kB</div><div class="gmail_default" style="font-family:georgia,serif">PageTables: 46688 kB</div><div class="gmail_default" style="font-family:georgia,serif">NFS_Unstable: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">Bounce: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">WritebackTmp: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">CommitLimit: 151978360 kB</div><div class="gmail_default" style="font-family:georgia,serif">Committed_AS: 11918316 kB</div><div class="gmail_default" style="font-family:georgia,serif">VmallocTotal: 34359738367 kB</div><div class="gmail_default" style="font-family:georgia,serif">VmallocUsed: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">VmallocChunk: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">HardwareCorrupted: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">AnonHugePages: 8521728 kB</div><div class="gmail_default" style="font-family:georgia,serif">CmaTotal: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">CmaFree: 0 kB</div><div class="gmail_default" style="font-family:georgia,serif">HugePages_Total: 96</div><div class="gmail_default" style="font-family:georgia,serif">HugePages_Free: 94</div><div class="gmail_default" style="font-family:georgia,serif">HugePages_Rsvd: 0</div><div class="gmail_default" style="font-family:georgia,serif">HugePages_Surp: 0</div><div class="gmail_default" style=""><div class="gmail_default" style="font-family:georgia,serif">[root@localhost vcr]# cat /sys/class/net/enp170s0f0/device/numa_node</div><div class="gmail_default" style="font-family:georgia,serif">1</div><div class="gmail_default" style="font-family:georgia,serif">JFYI, </div><div style=""><div style=""><font face="georgia, serif">[root@localhost vcr]# lscpu</font></div><div style=""><font face="georgia, serif">Architecture: x86_64</font></div><div style=""><font face="georgia, serif">CPU op-mode(s): 32-bit, 64-bit</font></div><div style=""><font face="georgia, serif">Byte Order: Little Endian</font></div><div style=""><font face="georgia, serif">CPU(s): 40</font></div><div style=""><font face="georgia, serif">On-line CPU(s) list: 0-39</font></div><div style=""><font face="georgia, serif">Thread(s) per core: 2</font></div><div style=""><font face="georgia, serif">Core(s) per socket: 10</font></div><div style=""><font face="georgia, serif">Socket(s): 2</font></div><div style=""><font face="georgia, serif">NUMA node(s): 2</font></div><div style=""><font face="georgia, serif">Vendor ID: GenuineIntel</font></div><div style=""><font face="georgia, serif">CPU family: 6</font></div><div style=""><font face="georgia, serif">Model: 62</font></div><div style=""><font face="georgia, serif">Model name: Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz</font></div><div style=""><font face="georgia, serif">Stepping: 4</font></div><div style=""><font face="georgia, serif">CPU MHz: 1267.109</font></div><div style=""><font face="georgia, serif">CPU max MHz: 3600.0000</font></div><div style=""><font face="georgia, serif">CPU min MHz: 1200.0000</font></div><div style=""><font face="georgia, serif">BogoMIPS: 5593.24</font></div><div style=""><font face="georgia, serif">Virtualization: VT-x</font></div><div style=""><font face="georgia, serif">L1d cache: 32K</font></div><div style=""><font face="georgia, serif">L1i cache: 32K</font></div><div style=""><font face="georgia, serif">L2 cache: 256K</font></div><div style=""><font face="georgia, serif">L3 cache: 25600K</font></div><div style=""><font face="georgia, serif">NUMA node0 CPU(s): 0-9,20-29</font></div><div style=""><font face="georgia, serif">NUMA node1 CPU(s): 10-19,30-39</font></div><div style=""><font face="georgia, serif">Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm ida arat epb pln pts dtherm tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt</font></div></div><div style="font-family:georgia,serif"><br></div></div><div class="gmail_default" style="font-family:georgia,serif">Hugepagesize: 1048576 kB</div><div class="gmail_default" style="font-family:georgia,serif">DirectMap4k: 335552 kB</div><div class="gmail_default" style="font-family:georgia,serif">DirectMap2M: 5875712 kB</div><div class="gmail_default" style="font-family:georgia,serif">DirectMap1G: 398458880 kB</div><div style="font-family:georgia,serif"><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 27, 2016 at 12:12 PM, Alex Williamson <span dir="ltr"><<a href="mailto:alex.williamson@redhat.com" target="_blank">alex.williamson@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">On Fri, 27 May 2016 11:57:38 -0400<br> chintu hetam <<a href="mailto:rometoroam@gmail.com">rometoroam@gmail.com</a>> wrote:<br> <br> > Hi Alex,<br> ><br> > Thank you for the quick response.<br> ><br> > i have 370+G RAM in the system<br> ><br> > [root@localhost vcr]# cat /proc/meminfo<br> > MemTotal: 396231416 kB<br> > MemFree: 272301316 kB<br> <br> </span>The QEMU command line indicates you're using hugepages, how many<br> hugepages do you have available? It should be at least 16384 for a 32G<br> guest with 2MB pages. Try increasing or not using hugepages so<br> we can attempt to isolate whether that's the problem. Thanks,<br> <br> Alex<br> </blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><font size="2" face="georgia, serif">-chintu-</font></div></div> </div>