<div dir="auto">Hello,<div dir="auto"><br></div><div dir="auto">You are welcome.</div><div dir="auto"><br></div><div dir="auto">The migration threshold is in terms of chunks, I think.. So it should be at least one chunk so the looping forever won't happen. The bug we found was if chunksize goes beyond a certain value triggered by larger than one tb sized cached lv, it ends up with migration threshold hard coded to lower than the increased chunksize.</div><div dir="auto"><br></div><div dir="auto">Yes migration threshold right now needs better documentation and explanations. Also the ability to see it from lvm commands just like we can see chunksize. We are working on it through the bzs mentioned earlier. (See the bz about migration threshold needing better documentation in the man pages)</div><div dir="auto"><br></div><div dir="auto">I think right now you can get it only at the device mapper layer, will check..</div><div dir="auto"><br></div><div dir="auto">Regards,</div><div dir="auto">Nikhil.</div><div dir="auto"><br></div><br><br><div class="gmail_quote" dir="auto"><div dir="ltr" class="gmail_attr">On Fri, 2 Aug, 2019, 5:09 PM Lakshmi Narasimhan Sundararajan, <<a href="mailto:lns@portworx.com">lns@portworx.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-US" link="blue" vlink="#954F72"><div class="m_-2988646992211632673WordSection1"><p class="MsoNormal">Hi Nikhil,<br>Thank you for your email. Much appreciated.</p><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">In my environment, Chunksize is fixed at 1M irrespective of the pool size. This may take the number of entries over 1M and result in kernel warning. But the class of systems we are using are huge, and so the memory and cpu bottlenecks does not seem to be a factor in our testing.</p><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">I looked up at the bugs. The first one about chunksize > 1M, we should be safe on that given our chunksize is fixed at 1MB.</p><p class="MsoNormal">The other one about migration threshold is interesting, I will have to validate this again.</p><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">What would be the unit of migration threshold? Is it the number of 512 byte sectors? And what exactly is its definition?</p><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">And also curiously this does not seem to be exported through lvm cli, need to fetch this only through dmsetup?</p><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">Thanks</p><p class="MsoNormal">LN</p><p class="MsoNormal">Sent from <a href="https://go.microsoft.com/fwlink/?LinkId=550986" target="_blank" rel="noreferrer">Mail</a> for Windows 10</p><p class="MsoNormal"><u></u> <u></u></p><div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in"><p class="MsoNormal" style="border:none;padding:0in"><b>From: </b><a href="mailto:nkshirsa@redhat.com" target="_blank" rel="noreferrer">Nikhil Kshirsagar</a><br><b>Sent: </b>Wednesday, July 31, 2019 3:04 PM<br><b>To: </b><a href="mailto:lvm-devel@redhat.com" target="_blank" rel="noreferrer">LVM2 development</a><br><b>Subject: </b>Re: [lvm-devel] lvmcache in writeback mode gets stuck flushing dirtyblocks</p></div><p class="MsoNormal"><u></u> <u></u></p><div><div><p class="MsoNormal">This used to happen if the chunksize increased as a result of needing to use more than a million chunks to store the size of the cached lv. What is the size of the pool?</p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Regards,</p></div><div><p class="MsoNormal">Nikhil.</p></div><div><p class="MsoNormal"><u></u> <u></u></p><div><div><p class="MsoNormal">On Tue, 30 Jul, 2019, 1:25 PM Lakshmi Narasimhan Sundararajan, <<a href="mailto:lns@portworx.com" target="_blank" rel="noreferrer">lns@portworx.com</a>> wrote:</p></div><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt"><div><div><p class="MsoNormal" style="margin-left:4.8pt">Hi Team,</p><p class="MsoNormal" style="margin-left:4.8pt">A very good day to all.</p><p class="MsoNormal" style="margin-left:4.8pt"><br>I am using lvmcache in writeback mode. When there are dirty blocks still in the lv, and if needs to be destroyed or flushed, then</p><p class="MsoNormal" style="margin-left:4.8pt">It seems to me that there are some conditions under which the dirty data flush gets stuck forever.</p><p class="MsoNormal" style="margin-left:4.8pt"> </p><p class="MsoNormal" style="margin-left:4.8pt"> </p><p class="MsoNormal" style="margin-left:4.8pt">As an example:</p><p class="MsoNormal" style="margin-left:4.8pt">root@pdc4-sm35:~# lvremove -f pwx0/pool</p><p class="MsoNormal" style="margin-left:4.8pt"> 367 blocks must still be flushed.</p><p class="MsoNormal" style="margin-left:4.8pt"> 367 blocks must still be flushed.</p><p class="MsoNormal" style="margin-left:4.8pt"> 367 blocks must still be flushed.</p><p class="MsoNormal" style="margin-left:4.8pt"> 367 blocks must still be flushed.</p><p class="MsoNormal" style="margin-left:4.8pt"> 367 blocks must still be flushed.</p><p class="MsoNormal" style="margin-left:4.8pt"> 367 blocks must still be flushed.</p><p class="MsoNormal" style="margin-left:4.8pt">^C</p><p class="MsoNormal" style="margin-left:4.8pt">root@pdc4-sm35:~#</p><p class="MsoNormal" style="margin-left:4.8pt"> </p><p class="MsoNormal" style="margin-left:4.8pt">I am running these version:</p><p class="MsoNormal" style="margin-left:4.8pt">root@pdc4-sm35:~# lvm version</p><p class="MsoNormal" style="margin-left:4.8pt"> LVM version: 2.02.133(2) (2015-10-30)</p><p class="MsoNormal" style="margin-left:4.8pt"> Library version: 1.02.110 (2015-10-30)</p><p class="MsoNormal" style="margin-left:4.8pt"> Driver version: 4.34.0</p><p class="MsoNormal" style="margin-left:4.8pt">root@pdc4-sm35:~#</p><p class="MsoNormal" style="margin-left:4.8pt"> </p><p class="MsoNormal" style="margin-left:4.8pt"> </p><p class="MsoNormal" style="margin-left:4.8pt">This issue seems old and reported multiple places. There have been some acknowledgement that this issue is resolved in 2.02.133, but still I see it. Also, I have seen some posts report it in 2.02.170+ as well (here: <a href="https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=878441" target="_blank" rel="noreferrer">https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=878441</a>) (<span style="font-size:10.0pt;font-family:"Courier New";color:black;background:#fefefe">Package: lvm2 Version: 2.02.173-1 Severity: normal)</span></p><p class="MsoNormal" style="margin-left:4.8pt"> </p><p class="MsoNormal" style="margin-left:4.8pt">I filed one here myself, <a href="https://github.com/lvmteam/lvm2/issues/22" target="_blank" rel="noreferrer">https://github.com/lvmteam/lvm2/issues/22</a>, trying to understand from you experts where we are on this?</p><p class="MsoNormal" style="margin-left:4.8pt"> </p><p class="MsoNormal" style="margin-left:4.8pt">I would sincerely appreciate your help in understanding the state of this issue in more detail.</p><p class="MsoNormal" style="margin-left:4.8pt"> </p><p class="MsoNormal" style="margin-left:4.8pt">Best regards<br>LN</p><p class="MsoNormal" style="margin-left:4.8pt">Sent from <a href="https://go.microsoft.com/fwlink/?LinkId=550986" target="_blank" rel="noreferrer">Mail</a> for Windows 10</p><p class="MsoNormal" style="margin-left:4.8pt"> </p></div></div></blockquote></div></div></div><p class="MsoNormal" style="margin-left:4.8pt">--<br>lvm-devel mailing list<br><a href="mailto:lvm-devel@redhat.com" target="_blank" rel="noreferrer">lvm-devel@redhat.com</a><br><a href="https://www.redhat.com/mailman/listinfo/lvm-devel" target="_blank" rel="noreferrer">https://www.redhat.com/mailman/listinfo/lvm-devel</a></p><p class="MsoNormal"><u></u> <u></u></p></div></div>--<br> lvm-devel mailing list<br> <a href="mailto:lvm-devel@redhat.com" target="_blank" rel="noreferrer">lvm-devel@redhat.com</a><br> <a href="https://www.redhat.com/mailman/listinfo/lvm-devel" rel="noreferrer noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/lvm-devel</a></blockquote></div></div>