<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Hi,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Recently my colleague ran into a kernel crash problem when he tried to assign 4 nics to 4 vms separately.<o:p></o:p></p>
<p class="MsoNormal">Unfortunately he didn’t collect related logs and we only can see the dmesg log when core dump currently.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Here the info:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:Consolas">linux:~ # lspci | grep -i eth<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">02:00.0 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">02:00.1 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">02:00.2 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">02:00.3 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">81:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">81:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">82:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">82:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">He used the last four nics.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Dmesg:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.519354] general protection fault: 0000 [#1] SMP<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.682056] CPU: 8 PID: 26794 Comm: qemu-kvm Tainted: G OE ---- ------- 3.10.0-514.44.5.10_44.x86_64 #1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.692900] Hardware name: Huawei RH2288H V3/BC11HGSA0, BIOS 3.87 02/02/2018<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.700115] task: ffff880e63172f10 ti: ffff880de5424000 task.ti: ffff880de5424000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.707932] RIP: 0010:[<ffffffff8156a6fc>] [<ffffffff8156a6fc>] domain_remove_one_dev_info+0x9c/0x250<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.717586] RSP: 0018:ffff880de5427c88 EFLAGS: 00010093<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.723064] RAX: 0000000000000246 RBX: dead000000000100 RCX: ffff88203e49c258<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.730359] RDX: dead000000000100 RSI: 0000000000000001 RDI: ffff88203e46da40<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.737656] RBP: ffff880de5427cd8 R08: 0000000000000001 R09: 000000018040003c<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.744954] R10: 000000003e46da01 R11: ffffea0080f91b40 R12: ffff88203e46da40<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.752250] R13: ffff88203e49c240 R14: ffff88203ebe3098 R15: ffff88017fd17200<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.759548] FS: 00007fb9304e6c00(0000) GS:ffff88203f280000(0000) knlGS:0000000000000000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.767966] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.773877] CR2: 00000000004bc020 CR3: 0000001de0324000 CR4: 00000000001627e0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.781173] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.788469] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.795768] Call Trace:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.798387] [<ffffffff8156d6b9>] intel_iommu_attach_device+0x209/0x240<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.805159] [<ffffffff8155beb1>] __iommu_attach_device+0x21/0x80<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.811418] [<ffffffff8155d174>] __iommu_attach_group+0x54/0x80<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.817590] [<ffffffff8155d1cb>] iommu_attach_group+0x2b/0x40<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.823592] [<ffffffffa0222268>] vfio_iommu_type1_attach_group+0x1c8/0x652 [vfio_iommu_type1]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.832542] [<ffffffffa01f4aea>] vfio_fops_unl_ioctl+0x1ba/0x300 [vfio]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.839398] [<ffffffff81229cd8>] do_vfs_ioctl+0x2e8/0x4d0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.845046] [<ffffffff81234c07>] ? __fd_install+0x47/0x60<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.850686] [<ffffffff81229f61>] SyS_ioctl+0xa1/0xc0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.855908] [<ffffffff816c22ef>] system_call_fastpath+0x1c/0x21<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.862075] Code: 39 cb 48 8b 13 48 89 df 74 2d 49 89 dc 48 89 d3 4d 39 7c 24 30 75 e8 0f b6 75 ce 41 38 74 24 20 74 5d 48 39 cb 41 b8 01 00 00 00 <48> 8b 13 48 89 df 75 d7 0f 1f 40 00 48 89 c6 48 c7
c7 80 d0 fd<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.882792] RIP [<ffffffff8156a6fc>] domain_remove_one_dev_info+0x9c/0x250<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.889940] RSP <ffff880de5427c88><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3449.894065] ---[ end trace e389931a63bcab52 ]---<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3450.471060] Kernel panic - not syncing: Fatal exception<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3451.512156] Shutting down cpus with NMI<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[ 3452.068904] die even has been record!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Any suggestion will be appreciated!<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal">Zongyong Wu<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>