<html><head><title></title></head><body><!-- rte-version 0.2 9947551637294008b77bce25eb683dac --><div class="rte-style-maintainer rte-pre-wrap" data-color="global-default" bbg-color="default" data-bb-font-size="medium"bbg-font-size="medium" style="white-space: pre-wrap; font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"style="white-space: pre-wrap; font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; color: rgb(0, 0, 0);">Thanks Brian and Mike for looking into this.<div>I tried to set the version in the pulp_install_plugins below but got the errors </div><div>pulp_install_plugins:</div><div>  pulp-file:</div><div>    upgrade: true</div><div>    version: '0.3.0'</div><div>  pulp-rpm:</div><div>    upgrade: true</div><div>    version: '3.3.0'</div><div>-------------------<br>TASK [pulp : Install Pulp plugins via PyPI] *******************************************************************************************<div>failed: [pulp3] (item={'value': {u'upgrade': True, u'version': u'0.3.0'}, 'key': u'pulp-file'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "pulp-file", "value": {"upgrade": true, "version": "0.3.0"}}, "msg": "version is incompatible with state=latest"}</div><div>failed: [pulp3] (item={'value': {u'upgrade': True, u'version': u'3.3.0'}, 'key': u'pulp-rpm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "pulp-rpm", "value": {"upgrade": true, "version": "3.3.0"}}, "msg": "version is incompatible with state=latest"}</div><div><br></div><div><br><div class="rte-style-maintainer" data-color="global-default"bbg-color="default" data-bb-font-size="medium" bbg-font-size="medium" style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; color: rgb(0, 0, 0);"><div><div class="bbg-rte-fold-content" data-header="From: bmbouter@redhat.com At: 04/30/20 12:20:58" data-digest="From: bmbouter@redhat.com At: 04/30/20 12:20:58" style=""><div class="bbg-rte-fold-summary">From: bmbouter@redhat.com At: 04/30/20 12:20:58</div>To: <a spellcheck="false" bbg-destination="mailto:mikedep333@redhat.com" href="mailto:mikedep333@redhat.com"> mikedep333@redhat.com</a><br>Cc: <a spellcheck="false"bbg-destination="mailto:bli111@bloomberg.net" href="mailto:bli111@bloomberg.net"> Bin Li (BLOOMBERG/ 120 PARK ) </a>, <a spellcheck="false"bbg-destination="mailto:pulp-list@redhat.com" href="mailto:pulp-list@redhat.com"> pulp-list@redhat.com</a>, <a spellcheck="false"bbg-destination="mailto:fabricio.aguiar@redhat.com" href="mailto:fabricio.aguiar@redhat.com"> fabricio.aguiar@redhat.com</a><br>Subject: Re: [Pulp-list] upgrade to 3.3</div><br></div><div class="rte-internet-block-wrapper" style="background: white; color: black; font-family: Arial, "BB.Proportional"; font-size: small; white-space: normal;"><div class="rte-internet-block"><blockquote><div dir="ltr"><div>Hi Bin,</div><div><br></div><div>Another user reported a similar error to you, and I've filed this issue <a spellcheck="false"bbg-destination="rte:bind" class="" href="https://pulp.plan.io/issues/6623" data-destination="rte:bind">https://pulp.plan.io/issues/6623</a>  The "pre-flight" check is designed to verify that the pulpcore version being installed/upgraded to is compatible with all plugins that will be installed prior to any bits installing and stop the user from continuing if there is a conflict. In your case the conflict is occuring after all the installation has occurred, yet it can't finish due to the conflict. I believe the pre-flight test does not work correctly in all cases. I'm going to advocate for us to fix this bug soon.</div><div><br></div><div>Thanks,</div><div>Brian</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Apr 29, 2020 at 3:47 PM Mike DePaulo <<a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:mikedep333@redhat.com" data-destination="mailto:rte:bind">mikedep333@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi Bin,</div><div><br></div><div>Usually whenever you upgrade pulpcore (X.Y release), you need to upgrade the plugins.</div><div><br></div><div>If you run it right after pulpcore release, your updated plugins may not be available yet on PyPI.<br></div><div><br></div><div>You can upgrade plugins by specifying one of these 2 sub-variables under `pulp_install_plugins.plugin-name`[1]:</div><div>`upgrade: true`</div><div>`version: "3.3.0"`</div><div>Where "3.3.0" is an actual released version of the plugin.[2]</div><div><br></div><div>The latter is safer (but more work) since `upgrade` tries the latest version no matter what, pulpcore compatible or not.<br></div><div><br></div><div>We are also wondering why this task didn't fail. It should fail as a precaution; so as to stop the installer early on & not break your install:</div><div>`<span>pulp: Run pip-compile to check pulpcore/plugin compatibility`</span></div><div><br></div><div>Do you have any output from that task?<br></div><div><br></div><div>As for the external postgresql database, It shouldn't affect pip installs. But there are the django migrations to run within the role. Without the migrations, the pip install would work, but Pulp would not function. You should include the role, but set `pulp_install_db` to false.[3]<br></div><div><br></div><div>-Mike<br></div><div><br></div><div>[1] <a spellcheck="false" bbg-destination="rte:bind" class=""href="https://github.com/pulp/pulp_installer/tree/master/roles/pulp#role-variables"data-destination="rte:bind">https://github.com/pulp/pulp_installer/tree/master/roles/pulp#role-variables</a></div><div>[2] <a spellcheck="false" bbg-destination="rte:bind" class=""href="https://pypi.org/search/?q=pulp&o=" data-destination="rte:bind">https://pypi.org/search/?q=pulp&o=</a></div><div>[3] <a spellcheck="false" bbg-destination="rte:bind" class=""href="https://github.com/pulp/pulp_installer/tree/master/roles/pulp-database#pulp-database"data-destination="rte:bind">https://github.com/pulp/pulp_installer/tree/master/roles/pulp-database#pulp-database</a></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Apr 29, 2020 at 1:33 PM Bin Li (BLOOMBERG/ 120 PARK) <<a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:rte:bind">bli111@bloomberg.net</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; white-space: pre-wrap;"><div>We are using the latest version of installer. It upgraded the pulpcore but not plugins.</div># grep 3.3 README.md<div>This version of the installer, 3.3.0, installs Pulp 3.3.0 specifically.</div><div>If run against an older version of Pulp 3, it will upgrade it to 3.3.0.</div><div><br></div><div>We are using external postrgresql database so we exclude the pulp-database role from playbook. Could this cause the issue?<br><br><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"><div><div><div>From: <a spellcheck="false" bbg-destination="mailto:rte:bind"class="" href="mailto:dkliban@redhat.com" data-destination="mailto:rte:bind">dkliban@redhat.com</a> At: 04/29/20 11:00:14</div>To: <a spellcheck="false" bbg-destination="mailto:bli111@bloomberg.net" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:bli111@bloomberg.net"> Bin Li (BLOOMBERG/ 120 PARK ) </a><br>Cc: <a spellcheck="false"bbg-destination="mailto:fabricio.aguiar@redhat.com" class="" href="mailto:fabricio.aguiar@redhat.com" data-destination="mailto:fabricio.aguiar@redhat.com"> fabricio.aguiar@redhat.com</a>, <a spellcheck="false"bbg-destination="mailto:pulp-list@redhat.com" class="" href="mailto:pulp-list@redhat.com" data-destination="mailto:pulp-list@redhat.com"> pulp-list@redhat.com</a><br>Subject: Re: [Pulp-list] upgrade to 3.3</div><br></div><div style="background: none 0% 0% repeat scroll white; color: black; font-family: Arial, "BB.Proportional"; font-size: small; white-space: normal;"><div><blockquote><div dir="ltr"><div>It seems like you are using a very old version of pulp_installer (formerly known as ansible-pulp). What commit are you at?</div><div><br></div><div>You should be using pulp_installer 3.3.0 to do the install[0]. </div><div><br></div><div>[0] <a spellcheck="false" bbg-destination="rte:bind" class=""href="https://github.com/pulp/pulp_installer/releases/tag/3.3.0"data-destination="rte:bind">https://github.com/pulp/pulp_installer/releases/tag/3.3.0</a></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Apr 29, 2020 at 8:12 AM Bin Li (BLOOMBERG/ 120 PARK) <<a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:rte:bind">bli111@bloomberg.net</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; white-space: pre-wrap;">Hi Fabricio,<div><br></div><div>I got the errors below. It looks it only update pulpcore but not the plugins.</div><div><br></div><div>RUNNING HANDLER [pulp : Collect static content] ************************************************</div><div>fatal: [pulp3]: FAILED! => {"changed": true, "cmd": ["/opt/utils/venv/pulp/3.7.3/bin/django-admin", "collectstatic", "--noinput", "--link"], "delta": "0:00:00.250852", "end": "2020-04-29 08:08:45.007362", "msg": "non-zero return code", "rc": 1, "start": "2020-04-29 08:08:44.756510", "stderr": "Traceback (most recent call last):\n  File \"/opt/utils/venv/pulp/3.7.3/bin/django-admin\", line 8, in <module>\n    sys.exit(execute_from_command_line())\n  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/management/__init__.py\", line 381, in execute_from_command_line\n    utility.execute()\n  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/management/__init__.py\", line 325, in execute\n    settings.INSTALLED_APPS\n  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\", line 79, in __getattr__\n    self._setup(name)\n  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\", line 66, in _setup\n    self._wrapped = Settings(settings_module)\n  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\", line 157, in __init__\n    mod = importlib.import_module(self.SETTINGS_MODULE)\n  File \"/opt/python/3.7.3/lib64/python3.7/importlib/__init__.py\", line 127, in import_module\n    return _bootstrap._gcd_import(name[level:], package, level)\n  File \"<frozen importlib._bootstrap>\", line 1006, in _gcd_import\n  File \"<frozen importlib._bootstrap>\", line 983, in _find_and_load\n  File \"<frozen importlib._bootstrap>\", line 967, in _find_and_load_unlocked\n  File \"<frozen importlib._bootstrap>\", line 677, in _load_unlocked\n  File \"<frozen importlib._bootstrap_external>\", line 728, in exec_module\n  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed\n  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/app/settings.py\", line 73, in <module>\n    plugin_app_config = entry_point.load()\n  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\", line 2410, in load\n    self.require(*args, **kwargs)\n  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\", line 2433, in require\n    items = working_set.resolve(reqs, env, installer, extras=self.extras)\n  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\", line 791, in resolve\n    raise VersionConflict(dist, req).with_context(dependent_req)\npkg_resources.VersionConflict: (pulpcore 3.3.0 (/opt/utils/venv/pulp/3.7.3/lib/python3.7/site-packages), Requirement.parse('pulpcore<3.2,>=3.1'))", "stderr_lines": ["Traceback (most recent call last):", "  File \"/opt/utils/venv/pulp/3.7.3/bin/django-admin\", line 8, in <module>", "    sys.exit(execute_from_command_line())", "  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/management/__init__.py\", line 381, in execute_from_command_line", "    utility.execute()", "  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/management/__init__.py\", line 325, in execute", "    settings.INSTALLED_APPS", "  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\", line 79, in __getattr__", "    self._setup(name)", "  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\", line 66, in _setup", "    self._wrapped = Settings(settings_module)", "  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\", line 157, in __init__", "    mod = importlib.import_module(self.SETTINGS_MODULE)", "  File \"/opt/python/3.7.3/lib64/python3.7/importlib/__init__.py\", line 127, in import_module", "    return _bootstrap._gcd_import(name[level:], package, level)", "  File \"<frozen importlib._bootstrap>\", line 1006, in _gcd_import", "  File \"<frozen importlib._bootstrap>\", line 983, in _find_and_load", "  File \"<frozen importlib._bootstrap>\", line 967, in _find_and_load_unlocked", "  File \"<frozen importlib._bootstrap>\", line 677, in _load_unlocked", "  File \"<frozen importlib._bootstrap_external>\", line 728, in exec_module", "  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed", "  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/app/settings.py\", line 73, in <module>", "    plugin_app_config = entry_point.load()", "  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\", line 2410, in load", "    self.require(*args, **kwargs)", "  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\", line 2433, in require", "    items = working_set.resolve(reqs, env, installer, extras=self.extras)", "  File \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\", line 791, in resolve", "    raise VersionConflict(dist, req).with_context(dependent_req)", "pkg_resources.VersionConflict: (pulpcore 3.3.0 (/opt/utils/venv/pulp/3.7.3/lib/python3.7/site-packages), Requirement.parse('pulpcore<3.2,>=3.1'))"], "stdout": "", "stdout_lines": []}</div><div><br></div><div># pip list |grep pulp</div><div>pulp-file                       0.1.1</div><div>pulp-file-client                0.1.1</div><div>pulp-rpm                        3.1.0</div><div>pulp-rpm-client                 3.1.0</div><div>pulpcore                        3.3.0</div><div>pulpcore-client                 3.1.0</div><div><br><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"><div><div><div>From: <a spellcheck="false" bbg-destination="mailto:rte:bind"class="" href="mailto:fabricio.aguiar@redhat.com" data-destination="mailto:rte:bind">fabricio.aguiar@redhat.com</a> At: 04/27/20 10:45:29</div>To: <a spellcheck="false" bbg-destination="mailto:bli111@bloomberg.net" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:bli111@bloomberg.net"> Bin Li (BLOOMBERG/ 120 PARK ) </a><br>Cc: <a spellcheck="false"bbg-destination="mailto:pulp-list@redhat.com" class="" href="mailto:pulp-list@redhat.com" data-destination="mailto:pulp-list@redhat.com"> pulp-list@redhat.com</a><br>Subject: Re: [Pulp-list] upgrade to 3.3</div><br></div><div style="background: none 0% 0% repeat scroll white; color: black; font-family: Arial, "BB.Proportional"; font-size: small; white-space: normal;"><div><blockquote><div dir="ltr">Could you share what was the failure?<br><div><div dir="ltr"><br>Best regards,</div><div dir="ltr"><span style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;font-size:14px;font-weight:700;text-transform:capitalize">Fabricio</span><span style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;font-size:14px;font-weight:700;text-transform:capitalize"> </span><span style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;font-size:14px;font-weight:700;text-transform:capitalize">Aguiar</span><div>Software Engineer, Pulp Project</div><div><a style="font-family:RedHatText,sans-serif;font-size:12px;margin:0px"spellcheck="false" bbg-destination="https://www.redhat.com/" class="" href="https://www.redhat.com/" data-destination="https://www.redhat.com/">Red Hat Brazil - Latam</a><br></div><div>+55 11 999652368</div><div><img src="https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/f5445ae0c9ddafd5b2f1836854d7416a/Logo-RedHat-Email.png"style="width: 96px; height: 22px;" width="96" height="22"></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Apr 24, 2020 at 11:44 PM Bin Li (BLOOMBERG/ 120 PARK) <<a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:rte:bind">bli111@bloomberg.net</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; white-space: pre-wrap;">Simple run the pulp_installer failed. It worked after I removed the pulp installation directory. What is the best practice to upgrade pulp to 3.3 from 3.2?<div><br></div><div>Thanks</div></div>_______________________________________________<br>Pulp-list mailing list<br><a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:Pulp-list@redhat.com" data-destination="mailto:rte:bind">Pulp-list@redhat.com</a><br><a spellcheck="false"bbg-destination="rte:bind" class="" href="https://www.redhat.com/mailman/listinfo/pulp-list"data-destination="rte:bind">https://www.redhat.com/mailman/listinfo/pulp-list</a></blockquote></div></blockquote><br></div></div></div></div></div>_______________________________________________<br>Pulp-list mailing list<br><a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:Pulp-list@redhat.com" data-destination="mailto:rte:bind">Pulp-list@redhat.com</a><br><a spellcheck="false"bbg-destination="rte:bind" class="" href="https://www.redhat.com/mailman/listinfo/pulp-list"data-destination="rte:bind">https://www.redhat.com/mailman/listinfo/pulp-list</a></blockquote></div></blockquote><br></div></div></div></div></div>_______________________________________________<br>Pulp-list mailing list<br><a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:Pulp-list@redhat.com" data-destination="mailto:rte:bind">Pulp-list@redhat.com</a><br><a spellcheck="false"bbg-destination="rte:bind" class="" href="https://www.redhat.com/mailman/listinfo/pulp-list"data-destination="rte:bind">https://www.redhat.com/mailman/listinfo/pulp-list</a></blockquote></div><br><br>-- <br><div dir="ltr"><p style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:capitalize"><span>Mike</span> <span>DePaulo</span></p><p style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;font-size:12px;margin:0px 0px 4px;text-transform:capitalize">He / Him / His</p><p style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;font-size:12px;margin:0px;text-transform:capitalize"><span>Service Reliability Engineer, Pulp</span></p><p style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;margin:0px 0px 4px;font-size:12px"><a style="margin: 0px;"spellcheck="false" bbg-destination="https://www.redhat.com/" class="" href="https://www.redhat.com/" data-destination="https://www.redhat.com/">Red Hat</a></p><div style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;font-size:medium;margin-bottom:4px"></div><p style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;margin:0px;font-size:12px"><span>IM: <span>mikedep333</span></span></p><p style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;font-size:12px;margin:0px"><span>GPG: 51745404</span></p><div style="color:rgb(0,0,0);font-family:RedHatText,sans-serif;font-size:medium;margin-top:12px"><table border="0"><tbody><tr><td width="100px"><a spellcheck="false" bbg-destination="https://www.redhat.com/" class="" href="https://www.redhat.com/"data-destination="https://www.redhat.com/"><img src="https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/f5445ae0c9ddafd5b2f1836854d7416a/Logo-RedHat-Email.png"style="width: 90px;" width="90"></a></td></tr></tbody></table></div></div> _______________________________________________<br>Pulp-list mailing list<br><a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:Pulp-list@redhat.com" data-destination="mailto:rte:bind">Pulp-list@redhat.com</a><br><a spellcheck="false"bbg-destination="rte:bind" class="" href="https://www.redhat.com/mailman/listinfo/pulp-list"data-destination="rte:bind">https://www.redhat.com/mailman/listinfo/pulp-list</a></blockquote></div></blockquote><br></div></div></div></div></div></div></body></html>