<html> <head> <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1"> <style type="text/css" style="display:none;"></style> </head> <body dir="ltr"> <div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr"> <p>Looking a bit more on this the copy issue, with the error</p> <p><br> </p> <p><span style="font-family: Consolas, Courier, monospace; font-size: 8pt;">pulp_rpm.app.exceptions.AdvisoryConflict: Incoming and existing advisories have the same id and timestamp but different and intersecting package lists. At least one of them is wrong. Advisory id: FEDORA-EPEL-2019-927a9446df</span><br> </p> <br> seems to be due to the advisory metadata in my frozen epel repos being broken, the package lists are incomplete. These repos are migrated from pulp2, but I don't know if the metadata was broken already in pulp2 or if it broke during the migration. My pulp2 environment is no longer with me so there's no way for me to find out. <div><br> </div> <div>So I need to fix those repos. Once thats done the issue with EPEL syncs re-adding all advisories are probably not that big, but it does make syncing take quite some time and also makes it difficult for me to filter newly added advisories (since they are added at every sync). So if anyone has any idea how to solve this I would be grateful. Comparing the advisories that are added with the ones that are removed shows that they are identical except for a newer 'updated_date' on the added one (the updated_date is todays date).</div> <div><br> </div> <div>Maybe an advisory shouldnt be considered for addition if the only change is the updated_date and no other metadata is changed? And why is EPEL setting a new 'update_date' on their advisories at every rebuild/re-index of their repos?</div> <div><br> </div> <div>//Adam</div> <div><br> <br> <div style="color: rgb(0, 0, 0);"> <hr tabindex="-1" style="display:inline-block; width:98%"> <div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> pulp-list-bounces@redhat.com <pulp-list-bounces@redhat.com> on behalf of Winberg Adam <Adam.Winberg@smhi.se><br> <b>Sent:</b> 08 February 2021 16:07<br> <b>To:</b> pulp-list@redhat.com<br> <b>Subject:</b> Re: [Pulp-list] epel syncs all advisories every time</font> <div> </div> </div> <div> <div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif"> <p>The patch was also for copying, not syncing, so I was totally confused. Sorry about that...</p> <br> <br> <div style="color:rgb(0,0,0)"> <hr tabindex="-1" style="display:inline-block; width:98%"> <div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> pulp-list-bounces@redhat.com <pulp-list-bounces@redhat.com> on behalf of Winberg Adam <Adam.Winberg@smhi.se><br> <b>Sent:</b> 08 February 2021 15:58<br> <b>To:</b> pulp-list@redhat.com<br> <b>Subject:</b> Re: [Pulp-list] epel syncs all advisories every time</font> <div> </div> </div> <div> <div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif"> <p>Did a quick test and the patch i mentioned is not involved. </p> <p><br> </p> <p>Note that I only see this problem with EPEL, not with RHEL repos which also publishes erratas/advisories. So the problem is probably on the EPEL side, or..?</p> <p><br> </p> <p>//Adam</p> <br> <br> <div style="color:rgb(0,0,0)"> <hr tabindex="-1" style="display:inline-block; width:98%"> <div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> pulp-list-bounces@redhat.com <pulp-list-bounces@redhat.com> on behalf of Winberg Adam <Adam.Winberg@smhi.se><br> <b>Sent:</b> 08 February 2021 10:55<br> <b>To:</b> pulp-list@redhat.com<br> <b>Subject:</b> Re: [Pulp-list] epel syncs all advisories every time</font> <div> </div> </div> <div> <div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif"> <p>I'm not sure, but I think this behaviour might have started after I applied the following patch:</p> <p><a href="https://github.com/pulp/pulp_rpm/commit/1652026913308e8348543af6f62c3b5c5f89985b#diff-0b195d23762f04b205940bafb5889ddf96181afde122ead35f8c65fe03527647" class="OWAAutoLink" id="LPlnk960876" previewremoved="true">https://github.com/pulp/pulp_rpm/commit/1652026913308e8348543af6f62c3b5c5f89985b#diff-0b195d23762f04b205940bafb5889ddf96181afde122ead35f8c65fe03527647</a><br> </p> <p><br> </p> <p>//Adam</p> <br> <br> <div style="color:rgb(0,0,0)"> <hr tabindex="-1" style="display:inline-block; width:98%"> <div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> pulp-list-bounces@redhat.com <pulp-list-bounces@redhat.com> on behalf of Winberg Adam <Adam.Winberg@smhi.se><br> <b>Sent:</b> 08 February 2021 10:39<br> <b>To:</b> pulp-list@redhat.com<br> <b>Subject:</b> [Pulp-list] epel syncs all advisories every time</font> <div> </div> </div> <div> <div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif"> <p>I sync the rhel8 and rhel7 epel repo every day, and for some reason all advisories are removed and added each time:</p> <p><br> </p> <p></p> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> "content_summary": {</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> "added": {</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> "rpm.advisory": {</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> "count": 2540,</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> "href": "/pulp/api/v3/content/rpm/advisories/?repository_version_added=/pulp/api/v3/repositories/rpm/rpm/10e51ae6-65c7-42aa-8ab1-ffebdf752500/versions/19/"</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> },</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> "rpm.package": {</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> "count": 6,</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> "href": "/pulp/api/v3/content/rpm/packages/?repository_version_added=/pulp/api/v3/repositories/rpm/rpm/10e51ae6-65c7-42aa-8ab1-ffebdf752500/versions/19/"</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> }</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> },</span></div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt"> <div> "removed": {</div> <div> "rpm.advisory": {</div> <div> "count": 2536,</div> <div> "href": "/pulp/api/v3/content/rpm/advisories/?repository_version_removed=/pulp/api/v3/repositories/rpm/rpm/10e51ae6-65c7-42aa-8ab1-ffebdf752500/versions/19/"</div> <div> }</div> <div> }</div> <div> },</div> <div><br> </div> </span></div> <div> <div><br> </div> <div><span style="font-size:12pt">This also leads to problem when I want to copy new advisories to my frozen epel repo:</span><br> </div> <div><span style="font-family:Consolas,Courier,monospace; font-size:8pt">pulp_rpm.app.exceptions.AdvisoryConflict: Incoming and existing advisories have the same id and timestamp but different and intersecting package lists. At least one of them is wrong. Advisory id: FEDORA-EPEL-2019-927a9446df</span><br> </div> <div><span><br> </span></div> <div><span>So it seems that the advisory has actually changed, which seems weird. And changed every day? </span>Is this some quirk in the EPEL sources or a bug in Pulp? </div> <div><br> </div> <div>//Adam</div> <div><span><br> </span></div> <div><br> </div> <br> </div> <br> <p></p> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </body> </html>