<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=gb2312"> <html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style></style></head><body lang=ZH-CN link=blue vlink=purple style='word-wrap:break-word'><div class=WordSection1>Daniel:<o:p></o:p> Can you provide the compressed image size? And, what image is used to be compressed? Is it the generated FV image?<o:p></o:p><o:p> </o:p>Thanks<o:p></o:p>Liming<o:p></o:p><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'>发件人: bounce+27952+68159+4905953+8761045@groups.io <bounce+27952+68159+4905953+8761045@groups.io> 代表 Andrew Fish via groups.io 发送时间: 2020年12月2日 11:37 收件人: devel@edk2.groups.io; daniel.schaefer@hpe.com 抄送: derek.lin2@hpe.com 主题: Re: [edk2-devel] Multithreaded compression with LZMA2<o:p></o:p></div></div><o:p> </o:p><o:p> </o:p><div> <o:p></o:p><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><div>On Dec 1, 2020, at 6:59 PM, Daniel Schaefer <<a href="mailto:daniel.schaefer@hpe.com">daniel.schaefer@hpe.com</a>> wrote:<o:p></o:p></div><o:p> </o:p><div>Hi everyone, I'm looking into how to speed up the build process and noticed that our build uses LZMA to encrypt the main firmware volume. Since it's quite big it takes a while but only uses one CPU thread. LZMA2 is a version of LZMA which can be multi-threaded and achieve much faster compression times. I did a quick benchmark using the `xz` command-line tool, which uses a modified version of the LZMA SDK that EDK2 uses. The results are: Uncompressed size: 64M | Algo | Comp Time | Decomp Time | Size | Threads | | ----- | --------- | ----------- | ---- | ------- | | LZMA | 19.67s | 0.9s | 9.1M | 1 | | LZMA2 | 20.11s | 1.2s | 9.2M | 1 | | LZMA2 | 8.31s | 1.0s | 9.4M | 4 | Using those commands: time xz --format=lzma testfile time unlzma testfile.lzma time xz --lzma2 testfile time unxz testfile.xz time xz -T4 --lzma2 testfile time unxz testfile.xz This is quite a significant improvement of build time, while decompression time and size only slightly increase. If that's a concern, then LZMA2 could be used for development only. I haven't investigated the details of how to support this in the code but it appears to be a simple change, since the LZMA SDK that we use already supports LZMA2. What do you think? <o:p></o:p></div></blockquote><div><o:p> </o:p></div><div>Interesting idea. What OS did you use? I tried this on macOS on some larger FVs and I did not see much difference? I tried a 17.5 MiB FV and it was around 3 seconds both ways. <o:p></o:p></div><div><o:p> </o:p></div><div>Maybe it would be worth while seeing how it works on various systems? I guess it might be data set related? <o:p></o:p></div><div><o:p> </o:p></div><div>Thanks,<o:p></o:p></div><div><o:p> </o:p></div><div>Andrew Fish<o:p></o:p></div> <o:p></o:p><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><div>Thanks, Daniel <o:p></o:p></div></blockquote></div><o:p> </o:p><div></o:p></div></div></body></html> <div width="1" style="color:white;clear:both">_._,_._,_</div> <hr> Groups.io Links: You receive all messages sent to this group. <a target="_blank" href="https://edk2.groups.io/g/devel/message/68160">View/Reply Online (#68160)</a> | | <a target="_blank" href="https://groups.io/mt/78653662/1813853">Mute This Topic</a> | <a href="https://edk2.groups.io/g/devel/post">New Topic</a> <a href="https://edk2.groups.io/g/devel/editsub/1813853">Your Subscription</a> | <a href="mailto:devel+owner@edk2.groups.io">Contact Group Owner</a> | <a href="https://edk2.groups.io/g/devel/unsub">Unsubscribe</a> [edk2-devel-archive@redhat.com] <div width="1" style="color:white;clear:both">_._,_._,_</div>