<html> <head> <meta http-equiv="Content-Type" content="text/html; charset=Windows-1252"> </head> <body> <div> <div> <div dir="ltr" style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"> Good question! I don’t have much experience with that, but let me see what my Googling skills can turn up.</div> </div> <div id="ms-outlook-mobile-signature"> <div> </div> <div style="direction: ltr;">- Bret</div> </div> </div> <hr style="display:inline-block;width:98%" tabindex="-1"> <div id="divRplyFwdMsg" dir="ltr">From: Shi, Steven <steven.shi@intel.com> Sent: Thursday, July 1, 2021 6:36:31 PM To: Bret Barkelew <Bret.Barkelew@microsoft.com>; devel@edk2.groups.io <devel@edk2.groups.io>; rebecca@nuviainc.com <rebecca@nuviainc.com> Subject: RE: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in Linux? <div> </div> </div> <style>  </style> <div lang="EN-US" link="blue" vlink="#954F72" style="word-wrap:break-word"> <div class="x_WordSection1"> I already installed mono, but NuGet.exe still fails to work in my side. I’m behind a proxy but don’t know how to configure the NuGet.exe proxy in .pytool. Below is my verbose error message. (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ stuart_update -c .pytool/CISettings.py TOOL_CHAIN_TAG=GCC5 -v … … SECTION - Start Invocable Tool SECTION - Initial update of environment DEBUG - --- self_describing_environment.update_extdeps() DEBUG - Verify 'mu_nasm' returning 'False'. DEBUG - Verify 'edk2-acpica-iasl' returning 'False'. DEBUG - Creating 5 threads for the SDE update UpdatingDEBUG - Verify 'gcc_aarch64_linux' returning 'True'. DEBUG - Verify 'gcc_riscv64_unknown' returning 'True'. DEBUG - Verify 'mu_nasm' returning 'False'. DEBUG - Verify 'gcc_arm_linux' returning 'True'. DEBUG - Verify 'edk2-acpica-iasl' returning 'False'. DEBUG - Cleaning dependency directory for 'mu_nasm'... DEBUG - Cleaning dependency directory for 'edk2-acpica-iasl'... INFO - Cmd to run is: mono /home/jshi19/wksp_efi/unit_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe locals global-packages -list INFO - Cmd to run is: mono /home/jshi19/wksp_efi/unit_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe locals global-packages -list INFO - ------------------------------------------------ INFO - ------------------------------------------------ INFO - --------------Cmd Output Starting--------------- INFO - --------------Cmd Output Starting--------------- INFO - ------------------------------------------------ INFO - ------------------------------------------------ ...INFO - Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. INFO - Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. INFO - Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. INFO - Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. INFO - Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. INFO - System.AggregateException: One or more errors occurred. (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) ---> System.IO.FileNotFoundException: Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. INFO - --- End of inner exception stack trace --- … … If I run the Cmd manually, I get below error: (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ mono /home/jshi19/wksp_efi/unit_test_env/lib/python3.8/site-packages/edk2toolext/bin/NuGet.exe locals global-packages -list Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. System.AggregateException: One or more errors occurred. (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) (Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.) ---> System.IO.FileNotFoundException: Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. --- End of inner exception stack trace --- at NuGet.CommandLine.Program.Initialize (NuGet.IFileSystem fileSystem, NuGet.CommandLine.IConsole console) [0x000ce] in <ff502667b3fe4a85827635c6fe6b0d0d>:0 at NuGet.CommandLine.Program.MainCore (System.String workingDirectory, System.String[] args) [0x000d8] in <ff502667b3fe4a85827635c6fe6b0d0d>:0 ---> (Inner Exception #0) System.IO.FileNotFoundException: Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'<--- ---> (Inner Exception #1) System.IO.FileNotFoundException: Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'<--- ---> (Inner Exception #2) System.IO.FileNotFoundException: Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'<--- ---> (Inner Exception #3) System.IO.FileNotFoundException: Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'<--- ---> (Inner Exception #4) System.IO.FileNotFoundException: Could not load file or assembly 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. File name: 'System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'<--- <div> Thanks Steven Shi </div> <div style="border:none; border-left:solid blue 1.5pt; padding:0in 0in 0in 4.0pt"> <div> <div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in"> From: Bret Barkelew <Bret.Barkelew@microsoft.com> Sent: Friday, July 2, 2021 9:04 AM To: Shi, Steven <steven.shi@intel.com>; devel@edk2.groups.io; rebecca@nuviainc.com Subject: RE: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in Linux? </div> </div> I believe the Azure DevOps build agents that are used by the EDK2 CI pipeline already have mono installed. - Bret <div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in"> From: <a href="mailto:steven.shi@intel.com">Shi, Steven</a> Sent: Thursday, July 1, 2021 5:54 PM To: <a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a>; <a href="mailto:Bret.Barkelew@microsoft.com"> Bret Barkelew</a>; <a href="mailto:rebecca@nuviainc.com">rebecca@nuviainc.com</a> Subject: RE: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in Linux? </div> Hi Bret, Rebecca, Thanks for the info. Does edk2 CI run the .pytool unit tests in Linux? If yes, how does edk2 CI solve the nuget dependency problem in Linux right now? <div> Thanks Steven Shi </div> <div> <div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in"> From: <a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a> <<a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a>> On Behalf Of Bret Barkelew via groups.io Sent: Wednesday, June 30, 2021 1:02 AM To: <a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a>; <a href="mailto:rebecca@nuviainc.com"> rebecca@nuviainc.com</a>; Shi, Steven <<a href="mailto:steven.shi@intel.com">steven.shi@intel.com</a>> Subject: Re: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in Linux? </div> </div> <div> <div> <div> Hmmm. If that works well, we might be able to investigate carrying both and picking based on the host OS. </div> </div> <div id="x_ms-outlook-mobile-signature"> <div> </div> <div> - Bret </div> </div> </div> <img border="0" width="555" height="2" id="x_Horizontal_x0020_Line_x0020_1" src="cid:image005.png@01D76F25.BB4DA520" style="width:5.7812in; height:.0208in"> <div id="x_divRplyFwdMsg"> From: <a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a> <<a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a>> on behalf of Rebecca Cran via groups.io <<a href="mailto:rebecca=nuviainc.com@groups.io">rebecca=nuviainc.com@groups.io</a>> Sent: Tuesday, June 29, 2021 9:42:41 AM To: <a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a> <<a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a>>; <a href="mailto:steven.shi@intel.com">steven.shi@intel.com</a> <<a href="mailto:steven.shi@intel.com">steven.shi@intel.com</a>> Subject: [EXTERNAL] Re: [edk2-devel] Do the edk2 CI unit tests work in Linux? <div> </div> </div> <div> Your Linux distribution should have a nuget package available (e.g. <a href="https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpackages.ubuntu.com%2Fhirsute%2Fnuget&data=04%7C01%7CBret.Barkelew%40microsoft.com%7C7fe13d52d6584572cfda08d93cf9d4e7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637607865993996088%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ll8vcIM5CwzfExgCUiRIKMdApfQWPe60stkbBfAViVQ%3D&reserved=0" originalsrc="https://packages.ubuntu.com/hirsute/nuget" shash="eVZh+By1opA3Owl1EWEIv2i0Eo1boN8cFINYQBh0P5aPJA012Hav1F1u1a+l2rKxIw0SIqvFqPavsB6B+BiBkEvNnhjMIX4BghTj26TsqZeQWXFL65VBtZfOl6J1Hs1BSxYerDss8w983P5qczMAyIxU4GQCSmu3LsN7nXw6Ru4="> https://packages.ubuntu.com/hirsute/nuget</a>) but the EDK2 CI is designed to use the copy of nuget installed with the edk2toolext package. -- Rebecca Cran <div> On 6/29/21 9:44 AM, Steven Shi wrote: </div> <blockquote style="margin-top:5.0pt; margin-bottom:5.0pt"> <div> Cran, Thanks. I’m curious whether the .pytool has native Linux executable binary to run? It looks the edk2 CI framework has more dependency in Linux than Windows. <div> Thanks Steven Shi Intel\IAGS\SFP\FIA (Firmware Infrastructure Automation) </div> <div> <div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in"> From: <a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a> <a href="mailto:devel@edk2.groups.io"><devel@edk2.groups.io></a> On Behalf Of Rebecca Cran Sent: Tuesday, June 29, 2021 8:13 PM To: <a href="mailto:devel@edk2.groups.io">devel@edk2.groups.io</a>; Shi, Steven <a href="mailto:steven.shi@intel.com"><steven.shi@intel.com></a> Subject: Re: [edk2-devel] Do the edk2 CI unit tests work in Linux? </div> </div> NuGet.exe is a .NET assembly/executable, so on Linux you'll need to install Mono (<a href="https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.mono-project.com%2F&data=04%7C01%7CBret.Barkelew%40microsoft.com%7C7fe13d52d6584572cfda08d93cf9d4e7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637607865993996088%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=DdwZwXAIpiiHYgREfxmB3Vnx7LHV0iQx6bsnBX%2F5s78%3D&reserved=0" originalsrc="https://www.mono-project.com/" shash="VTaqnA+GWdhx4XHiYx18XOMiKmn+A7DieKnhgEavgxa53zqMN0nOp/63JMA8FlzgxfeiQQszBkkQx6g+v0w5YAG5lDbv3G9VDgG3eH1ProqmP7NlLsA9DiHSfvAu5KyLCtDLPnKldF+Vl4wl8kbMlv+pv/bvASjXRH4BcAV96K8=">https://www.mono-project.com/</a>). -- Rebecca Cran <div> On 6/28/21 7:45 PM, Steven Shi wrote: </div> <blockquote style="margin-top:5.0pt; margin-bottom:5.0pt"> Hello, I’m interested in the edk2 CI unit tests(<a href="https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Ftianocore%2Fedk2%2Ftree%2Fmaster%2F.pytool&data=04%7C01%7CBret.Barkelew%40microsoft.com%7C7fe13d52d6584572cfda08d93cf9d4e7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637607865994006045%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=7JB9U3dR2OAMu4Ec%2FGs5oksRYAc5BemInssLZUyw3HY%3D&reserved=0" originalsrc="https://github.com/tianocore/edk2/tree/master/.pytool" shash="afJz13ijX00qNoJYV5QGkuz/QFn/797oH+7Mj+I79/UaebL7jiqtTVR5ciEuIyDes/e/jWrEoV9w5NE9TVEl4GZxQ1wOm+9CBl/SZ88shleb3eQ0AMrV2IdeGov589vnBZ9SHs31rYRC06G3nzA5I7o0r76lL7jS5/p7PhrQjj8=">https://github.com/tianocore/edk2/tree/master/.pytool</a>). I tested it in my local. It works well in Windows but does not work in Linux. It looks the NuGet in pytool only has windows version (C:\steven\unit_test_env\Lib\site-packages\edk2toolext\bin\NuGet.exe) but not support the Linux. Below is my detail test steps. Do the edk2 CI unit tests work in Linux? <ol start="1" type="1" style="margin-top:0in"> <li class="x_xmsolistparagraph" style="margin-left:0in">Windows :</li></ol> c:\steven>py -m venv unit_test_env c:\steven>cd c:\steven\edk2 c:\steven\edk2>c:\steven\unit_test_env\Scripts\activate.bat (unit_test_env) c:\steven\edk2>pip install --upgrade -r pip-requirements.txt (unit_test_env) c:\steven\edk2>stuart_setup -c .pytool/CISettings.py TOOL_CHAIN_TAG=VS2019 (unit_test_env) c:\steven\edk2>stuart_update -c .pytool/CISettings.py TOOL_CHAIN_TAG=VS2019 (unit_test_env) c:\steven\edk2>edksetup.bat (unit_test_env) c:\steven\edk2>edksetup.bat Rebuild (unit_test_env) c:\steven\edk2>stuart_ci_build -c .pytool/CISettings.py TOOL_CHAIN_TAG=VS2019 -a X64,IA32 -t DEBUG --verbose … PROGRESS - Overall Build Status: Success SECTION - Summary PROGRESS - Success <ol start="2" type="1" style="margin-top:0in"> <li class="x_xmsolistparagraph" style="margin-left:0in">Linux:</li></ol> jshi19@ub2-uefi-b01:~/wksp_efi$ python3 -m venv unit_test_env jshi19@ub2-uefi-b01:~/wksp_efi$ source unit_test_env/bin/activate (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ pip install --upgrade -r pip-requirements.txt (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ make -C BaseTools/ (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ stuart_setup -c .pytool/CISettings.py TOOL_CHAIN_TAG=GCC5 (unit_test_env) jshi19@ub2-uefi-b01:~/wksp_efi/edk2-2$ stuart_update -c .pytool/CISettings.py TOOL_CHAIN_TAG=GCC5 SECTION - Init SDE WARNING - Using Pip Tools based BaseTools SECTION - Loading Plugins SECTION - Start Invocable Tool SECTION - Initial update of environment UpdatingWARNING - [SDE] Failed to fetch NugetDependecy: <a href="mailto:edk2-acpica-iasl@20200717.0.0">edk2-acpica-iasl@20200717.0.0</a>: [Nuget] We failed to install this version 20200717.0.0 of edk2-acpica-iasl WARNING - [SDE] Failed to fetch NugetDependecy: <a href="mailto:mu_nasm@2.15.05">mu_nasm@2.15.05</a>: [Nuget] We failed to install this version 2.15.05 of mu_nasm . Done SECTION - Updated/Verified 3 dependencies SECTION - Second pass update of environment UpdatingWARNING - [SDE] Failed to fetch NugetDependecy: <a href="mailto:edk2-acpica-iasl@20200717.0.0"> edk2-acpica-iasl@20200717.0.0</a>: [Nuget] We failed to install this version 20200717.0.0 of edk2-acpica-iasl WARNING - [SDE] Failed to fetch NugetDependecy: <a href="mailto:mu_nasm@2.15.05"> mu_nasm@2.15.05</a>: [Nuget] We failed to install this version 2.15.05 of mu_nasm . Done SECTION - Updated/Verified 3 dependencies ERROR - We were unable to successfully update 2 dependencies in environment SECTION - Summary ERROR - Error Thanks Steven Shi </blockquote> </div> </blockquote> </div> <div> </div> </div> </div> </body> </html> <div width="1" style="color:white;clear:both">_._,_._,_</div> <hr> Groups.io Links: You receive all messages sent to this group. <a target="_blank" href="https://edk2.groups.io/g/devel/message/77432">View/Reply Online (#77432)</a> | | <a target="_blank" href="https://groups.io/mt/83873292/1813853">Mute This Topic</a> | <a href="https://edk2.groups.io/g/devel/post">New Topic</a> <a href="https://edk2.groups.io/g/devel/editsub/1813853">Your Subscription</a> | <a href="mailto:devel+owner@edk2.groups.io">Contact Group Owner</a> | <a href="https://edk2.groups.io/g/devel/unsub">Unsubscribe</a> [edk2-devel-archive@redhat.com] <div width="1" style="color:white;clear:both">_._,_._,_</div>