[Pulp-list] upgrade to 3.3

Thu Apr 30 16:20:20 UTC 2020

Hi Bin,

Another user reported a similar error to you, and I've filed this issue
https://pulp.plan.io/issues/6623  The "pre-flight" check is designed to
verify that the pulpcore version being installed/upgraded to is compatible
with all plugins that will be installed prior to any bits installing and
stop the user from continuing if there is a conflict. In your case the
conflict is occuring after all the installation has occurred, yet it can't
finish due to the conflict. I believe the pre-flight test does not work
correctly in all cases. I'm going to advocate for us to fix this bug soon.

Thanks,
Brian

On Wed, Apr 29, 2020 at 3:47 PM Mike DePaulo <mikedep333 at redhat.com> wrote:

> Hi Bin,
>
> Usually whenever you upgrade pulpcore (X.Y release), you need to upgrade
> the plugins.
>
> If you run it right after pulpcore release, your updated plugins may not
> be available yet on PyPI.
>
> You can upgrade plugins by specifying one of these 2 sub-variables under
> `pulp_install_plugins.plugin-name`[1]:
> `upgrade: true`
> `version: "3.3.0"`
> Where "3.3.0" is an actual released version of the plugin.[2]
>
> The latter is safer (but more work) since `upgrade` tries the latest
> version no matter what, pulpcore compatible or not.
>
> We are also wondering why this task didn't fail. It should fail as a
> precaution; so as to stop the installer early on & not break your install:
> `pulp: Run pip-compile to check pulpcore/plugin compatibility`
>
> Do you have any output from that task?
>
> As for the external postgresql database, It shouldn't affect pip installs.
> But there are the django migrations to run within the role. Without the
> migrations, the pip install would work, but Pulp would not function. You
> should include the role, but set `pulp_install_db` to false.[3]
>
> -Mike
>
> [1]
> https://github.com/pulp/pulp_installer/tree/master/roles/pulp#role-variables
> [2] https://pypi.org/search/?q=pulp&o=
> [3]
> https://github.com/pulp/pulp_installer/tree/master/roles/pulp-database#pulp-database
>
> On Wed, Apr 29, 2020 at 1:33 PM Bin Li (BLOOMBERG/ 120 PARK) <
> bli111 at bloomberg.net> wrote:
>
>> We are using the latest version of installer. It upgraded the pulpcore
>> but not plugins.
>> # grep 3.3 README.md
>> This version of the installer, 3.3.0, installs Pulp 3.3.0 specifically.
>> If run against an older version of Pulp 3, it will upgrade it to 3.3.0.
>>
>> We are using external postrgresql database so we exclude the
>> pulp-database role from playbook. Could this cause the issue?
>>
>> From: dkliban at redhat.com At: 04/29/20 11:00:14
>> To: Bin Li (BLOOMBERG/ 120 PARK ) <bli111 at bloomberg.net>
>> Cc: fabricio.aguiar at redhat.com, pulp-list at redhat.com
>> Subject: Re: [Pulp-list] upgrade to 3.3
>>
>> It seems like you are using a very old version of pulp_installer
>> (formerly known as ansible-pulp). What commit are you at?
>>
>> You should be using pulp_installer 3.3.0 to do the install[0].
>>
>> [0] https://github.com/pulp/pulp_installer/releases/tag/3.3.0
>>
>> On Wed, Apr 29, 2020 at 8:12 AM Bin Li (BLOOMBERG/ 120 PARK) <
>> bli111 at bloomberg.net> wrote:
>>
>>> Hi Fabricio,
>>>
>>> I got the errors below. It looks it only update pulpcore but not the
>>> plugins.
>>>
>>> RUNNING HANDLER [pulp : Collect static content]
>>> ************************************************
>>> fatal: [pulp3]: FAILED! => {"changed": true, "cmd":
>>> ["/opt/utils/venv/pulp/3.7.3/bin/django-admin", "collectstatic",
>>> "--noinput", "--link"], "delta": "0:00:00.250852", "end": "2020-04-29
>>> 08:08:45.007362", "msg": "non-zero return code", "rc": 1, "start":
>>> "2020-04-29 08:08:44.756510", "stderr": "Traceback (most recent call
>>> last):\n File \"/opt/utils/venv/pulp/3.7.3/bin/django-admin\", line 8, in
>>> <module>\n sys.exit(execute_from_command_line())\n File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/management/__init__.py\",
>>> line 381, in execute_from_command_line\n utility.execute()\n File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/management/__init__.py\",
>>> line 325, in execute\n settings.INSTALLED_APPS\n File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\",
>>> line 79, in __getattr__\n self._setup(name)\n File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\",
>>> line 66, in _setup\n self._wrapped = Settings(settings_module)\n File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\",
>>> line 157, in __init__\n mod =
>>> importlib.import_module(self.SETTINGS_MODULE)\n File
>>> \"/opt/python/3.7.3/lib64/python3.7/importlib/__init__.py\", line 127, in
>>> import_module\n return _bootstrap._gcd_import(name[level:], package,
>>> level)\n File \"<frozen importlib._bootstrap>\", line 1006, in
>>> _gcd_import\n File \"<frozen importlib._bootstrap>\", line 983, in
>>> _find_and_load\n File \"<frozen importlib._bootstrap>\", line 967, in
>>> _find_and_load_unlocked\n File \"<frozen importlib._bootstrap>\", line 677,
>>> in _load_unlocked\n File \"<frozen importlib._bootstrap_external>\", line
>>> 728, in exec_module\n File \"<frozen importlib._bootstrap>\", line 219, in
>>> _call_with_frames_removed\n File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/app/settings.py\",
>>> line 73, in <module>\n plugin_app_config = entry_point.load()\n File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\",
>>> line 2410, in load\n self.require(*args, **kwargs)\n File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\",
>>> line 2433, in require\n items = working_set.resolve(reqs, env, installer,
>>> extras=self.extras)\n File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\",
>>> line 791, in resolve\n raise VersionConflict(dist,
>>> req).with_context(dependent_req)\npkg_resources.VersionConflict: (pulpcore
>>> 3.3.0 (/opt/utils/venv/pulp/3.7.3/lib/python3.7/site-packages),
>>> Requirement.parse('pulpcore<3.2,>=3.1'))", "stderr_lines": ["Traceback
>>> (most recent call last):", " File
>>> \"/opt/utils/venv/pulp/3.7.3/bin/django-admin\", line 8, in <module>", "
>>> sys.exit(execute_from_command_line())", " File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/management/__init__.py\",
>>> line 381, in execute_from_command_line", " utility.execute()", " File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/management/__init__.py\",
>>> line 325, in execute", " settings.INSTALLED_APPS", " File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\",
>>> line 79, in __getattr__", " self._setup(name)", " File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\",
>>> line 66, in _setup", " self._wrapped = Settings(settings_module)", " File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/conf/__init__.py\",
>>> line 157, in __init__", " mod =
>>> importlib.import_module(self.SETTINGS_MODULE)", " File
>>> \"/opt/python/3.7.3/lib64/python3.7/importlib/__init__.py\", line 127, in
>>> import_module", " return _bootstrap._gcd_import(name[level:], package,
>>> level)", " File \"<frozen importlib._bootstrap>\", line 1006, in
>>> _gcd_import", " File \"<frozen importlib._bootstrap>\", line 983, in
>>> _find_and_load", " File \"<frozen importlib._bootstrap>\", line 967, in
>>> _find_and_load_unlocked", " File \"<frozen importlib._bootstrap>\", line
>>> 677, in _load_unlocked", " File \"<frozen importlib._bootstrap_external>\",
>>> line 728, in exec_module", " File \"<frozen importlib._bootstrap>\", line
>>> 219, in _call_with_frames_removed", " File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/app/settings.py\",
>>> line 73, in <module>", " plugin_app_config = entry_point.load()", " File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\",
>>> line 2410, in load", " self.require(*args, **kwargs)", " File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\",
>>> line 2433, in require", " items = working_set.resolve(reqs, env, installer,
>>> extras=self.extras)", " File
>>> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pkg_resources/__init__.py\",
>>> line 791, in resolve", " raise VersionConflict(dist,
>>> req).with_context(dependent_req)", "pkg_resources.VersionConflict:
>>> (pulpcore 3.3.0 (/opt/utils/venv/pulp/3.7.3/lib/python3.7/site-packages),
>>> Requirement.parse('pulpcore<3.2,>=3.1'))"], "stdout": "", "stdout_lines":
>>> []}
>>>
>>> # pip list |grep pulp
>>> pulp-file 0.1.1
>>> pulp-file-client 0.1.1
>>> pulp-rpm 3.1.0
>>> pulp-rpm-client 3.1.0
>>> pulpcore 3.3.0
>>> pulpcore-client 3.1.0
>>>
>>> From: fabricio.aguiar at redhat.com At: 04/27/20 10:45:29
>>> To: Bin Li (BLOOMBERG/ 120 PARK ) <bli111 at bloomberg.net>
>>> Cc: pulp-list at redhat.com
>>> Subject: Re: [Pulp-list] upgrade to 3.3
>>>
>>> Could you share what was the failure?
>>>
>>> Best regards,
>>> Fabricio Aguiar
>>> Software Engineer, Pulp Project
>>> Red Hat Brazil - Latam <https://www.redhat.com/>
>>> +55 11 999652368
>>>
>>>
>>> On Fri, Apr 24, 2020 at 11:44 PM Bin Li (BLOOMBERG/ 120 PARK) <
>>> bli111 at bloomberg.net> wrote:
>>>
>>>> Simple run the pulp_installer failed. It worked after I removed the
>>>> pulp installation directory. What is the best practice to upgrade pulp to
>>>> 3.3 from 3.2?
>>>>
>>>> Thanks
>>>> _______________________________________________
>>>> Pulp-list mailing list
>>>> Pulp-list at redhat.com
>>>> https://www.redhat.com/mailman/listinfo/pulp-list
>>>
>>>
>>> _______________________________________________
>>> Pulp-list mailing list
>>> Pulp-list at redhat.com
>>> https://www.redhat.com/mailman/listinfo/pulp-list
>>
>>
>> _______________________________________________
>> Pulp-list mailing list
>> Pulp-list at redhat.com
>> https://www.redhat.com/mailman/listinfo/pulp-list
>
>
>
> --
>
> Mike DePaulo
>
> He / Him / His
>
> Service Reliability Engineer, Pulp
>
> Red Hat <https://www.redhat.com/>
>
> IM: mikedep333
>
> GPG: 51745404
> <https://www.redhat.com/>
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20200430/e85449cb/attachment.htm>