[vfio-users] Low Level Memory Allocation Error: qemu-system-x86: page allocation failure: order:4, mode:0x260c0c0

Jeff bungee91 at gmail.com
Thu Jul 7 22:40:38 UTC 2016 

Attempting to diagnose an issue I've been getting in my syslog, really
hoping someone can shed some light on this for me.
I'm running the latest beta of UnRAID, with some exceptions I'm kind of
stuck with the "one size fits most" implementation here =P.

It looks like this over and over, attached my complete syslog at the bottom:

Jul  4 12:47:22 Server kernel: qemu-system-x86: page allocation failure:
order:4, mode:0x260c0c0
Jul  4 12:47:22 Server kernel: CPU: 9 PID: 13787 Comm: qemu-system-x86
Tainted: G        W       4.4.13-unRAID #1
Jul  4 12:47:22 Server kernel: Hardware name: Gigabyte Technology Co., Ltd.
To be filled by O.E.M./X99-SLI-CF, BIOS F21a 01/12/2016
Jul  4 12:47:22 Server kernel: 0000000000000000 ffff8807b7eef7a8
ffffffff81369dde 0000000000000001
Jul  4 12:47:22 Server kernel: 0000000000000004 ffff8807b7eef840
ffffffff810bcc2f 000000010260c0c0
Jul  4 12:47:22 Server kernel: ffff8807f794e000 0000000400000040
0000000000eef7e0 0000000000000004
Jul  4 12:47:22 Server kernel: Call Trace:
Jul  4 12:47:22 Server kernel: [<ffffffff81369dde>] dump_stack+0x61/0x7e
Jul  4 12:47:22 Server kernel: [<ffffffff810bcc2f>]
warn_alloc_failed+0x10f/0x127
Jul  4 12:47:22 Server kernel: [<ffffffff810bfc46>]
__alloc_pages_nodemask+0x870/0x8ca
Jul  4 12:47:22 Server kernel: [<ffffffff810bfe4a>]
alloc_kmem_pages_node+0x4b/0xb3
Jul  4 12:47:22 Server kernel: [<ffffffff810f4434>]
kmalloc_large_node+0x24/0x52
Jul  4 12:47:22 Server kernel: [<ffffffff810f6bd3>]
__kmalloc_node+0x22/0x153
Jul  4 12:47:22 Server kernel: [<ffffffff810209af>]
reserve_ds_buffers+0x18c/0x33d
Jul  4 12:47:22 Server kernel: [<ffffffff8101b3f0>]
x86_reserve_hardware+0x135/0x147
Jul  4 12:47:22 Server kernel: [<ffffffff8101b452>]
x86_pmu_event_init+0x50/0x1c9
Jul  4 12:47:22 Server kernel: [<ffffffff810ae064>]
perf_try_init_event+0x41/0x72
Jul  4 12:47:22 Server kernel: [<ffffffff810ae4b5>]
perf_event_alloc+0x420/0x66e
Jul  4 12:47:22 Server kernel: [<ffffffffa06435ab>] ?
kvm_perf_overflow+0x35/0x35 [kvm]
Jul  4 12:47:22 Server kernel: [<ffffffff810b042b>]
perf_event_create_kernel_counter+0x22/0x112
Jul  4 12:47:22 Server kernel: [<ffffffffa06436c1>]
pmc_reprogram_counter+0xbf/0x104 [kvm]
Jul  4 12:47:22 Server kernel: [<ffffffffa064382f>]
reprogram_gp_counter+0x129/0x146 [kvm]
Jul  4 12:47:22 Server kernel: [<ffffffffa0783b1e>]
intel_pmu_set_msr+0x2bd/0x2ca [kvm_intel]
Jul  4 12:47:22 Server kernel: [<ffffffffa0643b14>]
kvm_pmu_set_msr+0x15/0x17 [kvm]
Jul  4 12:47:22 Server kernel: [<ffffffffa0625a55>]
kvm_set_msr_common+0x921/0x983 [kvm]
Jul  4 12:47:22 Server kernel: [<ffffffffa07833ba>] vmx_set_msr+0x2ec/0x2fe
[kvm_intel]
Jul  4 12:47:22 Server kernel: [<ffffffffa0622422>] kvm_set_msr+0x61/0x63
[kvm]
Jul  4 12:47:22 Server kernel: [<ffffffffa077c9ba>] handle_wrmsr+0x3b/0x62
[kvm_intel]
Jul  4 12:47:22 Server kernel: [<ffffffffa07815f9>]
vmx_handle_exit+0xfbb/0x1053 [kvm_intel]
Jul  4 12:47:22 Server kernel: [<ffffffffa07830bf>] ?
vmx_vcpu_run+0x30e/0x31d [kvm_intel]
Jul  4 12:47:22 Server kernel: [<ffffffffa062bf76>]
kvm_arch_vcpu_ioctl_run+0x38a/0x1080 [kvm]
Jul  4 12:47:22 Server kernel: [<ffffffffa06269fe>] ?
kvm_arch_vcpu_load+0x133/0x173 [kvm]
Jul  4 12:47:22 Server kernel: [<ffffffffa061e0ec>]
kvm_vcpu_ioctl+0x178/0x499 [kvm]
Jul  4 12:47:22 Server kernel: [<ffffffffa063a7b9>] ? em_rsm+0x14d/0x14d
[kvm]
Jul  4 12:47:22 Server kernel: [<ffffffff81117b95>] do_vfs_ioctl+0x3a3/0x416
Jul  4 12:47:22 Server kernel: [<ffffffff8111fb96>] ? __fget+0x72/0x7e
Jul  4 12:47:22 Server kernel: [<ffffffff81117c46>] SyS_ioctl+0x3e/0x5c
Jul  4 12:47:22 Server kernel: [<ffffffff81622c6e>]
entry_SYSCALL_64_fastpath+0x12/0x6d
Jul  4 12:47:22 Server kernel: Mem-Info:
Jul  4 12:47:22 Server kernel: active_anon:1901834 inactive_anon:8722
isolated_anon:0
Jul  4 12:47:22 Server kernel: active_file:554774 inactive_file:652966
isolated_file:0
Jul  4 12:47:22 Server kernel: unevictable:4604002 dirty:1121 writeback:0
unstable:0
Jul  4 12:47:22 Server kernel: slab_reclaimable:273978
slab_unreclaimable:32005
Jul  4 12:47:22 Server kernel: mapped:31631 shmem:137162 pagetables:16790
bounce:0
Jul  4 12:47:22 Server kernel: free:89952 free_pcp:4 free_cma:0
Jul  4 12:47:22 Server kernel: Node 0 DMA free:15896kB min:64kB low:80kB
high:96kB active_anon:0kB inactive_anon:0kB active_file:0kB
inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
present:15980kB managed:15896kB mlocked:0kB dirty:0kB writeback:0kB
mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB
kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB
local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0
all_unreclaimable? yes
Jul  4 12:47:22 Server kernel: lowmem_reserve[]: 0 667 31899 31899
Jul  4 12:47:22 Server kernel: Node 0 DMA32 free:127368kB min:2824kB
low:3528kB high:4236kB active_anon:298168kB inactive_anon:1092kB
active_file:968kB inactive_file:736kB unevictable:367324kB
isolated(anon):0kB isolated(file):0kB present:831172kB managed:821456kB
mlocked:367324kB dirty:0kB writeback:0kB mapped:1508kB shmem:8440kB
slab_reclaimable:16520kB slab_unreclaimable:1760kB kernel_stack:448kB
pagetables:2484kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB
free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul  4 12:47:22 Server kernel: lowmem_reserve[]: 0 0 31231 31231
Jul  4 12:47:22 Server kernel: Node 0 Normal free:216544kB min:132272kB
low:165340kB high:198408kB active_anon:7309168kB inactive_anon:33796kB
active_file:2218128kB inactive_file:2611128kB unevictable:18048684kB
isolated(anon):0kB isolated(file):0kB present:32505856kB managed:31981696kB
mlocked:18048684kB dirty:4484kB writeback:0kB mapped:125016kB
shmem:540208kB slab_reclaimable:1079392kB slab_unreclaimable:126260kB
kernel_stack:12800kB pagetables:64676kB unstable:0kB bounce:0kB
free_pcp:8kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:56
all_unreclaimable? no
Jul  4 12:47:22 Server kernel: lowmem_reserve[]: 0 0 0 0
Jul  4 12:47:22 Server kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U)
0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (U)
3*4096kB (M) = 15896kB
Jul  4 12:47:22 Server kernel: Node 0 DMA32: 264*4kB (UME) 287*8kB (UME)
329*16kB (UME) 265*32kB (UME) 247*64kB (UME) 152*128kB (UME) 99*256kB (UME)
49*512kB (UME) 22*1024kB (ME) 1*2048kB (E) 0*4096kB = 127368kB
Jul  4 12:47:22 Server kernel: Node 0 Normal: 35582*4kB (UME) 9014*8kB
(UME) 163*16kB (UME) 12*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB
0*2048kB 0*4096kB = 217432kB
Jul  4 12:47:22 Server kernel: 1344821 total pagecache pages
Jul  4 12:47:22 Server kernel: 0 pages in swap cache
Jul  4 12:47:22 Server kernel: Swap cache stats: add 0, delete 0, find 0/0
Jul  4 12:47:22 Server kernel: Free swap  = 0kB
Jul  4 12:47:22 Server kernel: Total swap = 0kB
Jul  4 12:47:22 Server kernel: 8338252 pages RAM
Jul  4 12:47:22 Server kernel: 0 pages HighMem/MovableOnly
Jul  4 12:47:22 Server kernel: 133490 pages reserved

Similar issue, supposedly fixed and should be included in the current
kernel
https://bugzilla.kernel.org/show_bug.cgi?id=93251]https://bugzilla.kernel.org/show_bug.cgi?id=93251

"Fixed in v4.0
commit 744961341d472db6272ed9b42319a90f5a2aa7c4
    kvm: avoid page allocation failure in kvm_set_memory_region()"

Full Syslog:
https://drive.google.com/file/d/0B0_CMCHyY8iWTWNxTDdGRG1Vbmc/view?usp=sharing

Thanks for any help/input you may provide, has me baffled!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20160707/265c230c/attachment.htm>

More information about the vfio-users mailing list