[Pulp-list] Sync task Failing for Centos8 in pulpcore version 3.2.1
Daniel Alley
dalley at redhat.com
Thu Jun 24 17:42:46 UTC 2021
Maanya, could you please describe which versions you have currently
installed right now? And how was it installed - did you use the ansible
installer, or install the packages manually?
Our recommendation would be to use the ansible installer (instructions here
<https://pulp-installer.readthedocs.io/en/latest/quickstart/#getting-started>)
to upgrade your pulp installation to the latest pulpcore 3.13.0 release
with compatible plugins. As the version of pulpcore you have installed is
from March 2020 (~15 months), you must upgrade all of the components of
pulp rather than just the RPM plugin, as the most recent versions require a
newer version of pulpcore. The ansible installer should handle that for
you.
Let us know if you have any questions about that process.
On Thu, Jun 24, 2021 at 12:26 PM Sundararajan, Maanya <
maanya.sundararajan at hpe.com> wrote:
> Hello,
>
>
>
> Thank you for the quick response.
>
> We tried it with pulp_rpm version as 3.12.0 as well as 3.13.0. However we
> are facing some incompatibility errors with versions of pulp_version,
> django_version, pulp-rpm and pulp-file.
>
> We have tried all possible versions of these but none of them seem to
> work. Could you please provide us with the versions for these as well?
>
>
>
> Regards,
>
> Maanya S
>
>
>
>
>
> *From:* Daniel Alley <dalley at redhat.com>
> *Sent:* Tuesday, June 22, 2021 5:55 PM
> *To:* J, Priyanka <priyankaj at hpe.com>
> *Cc:* pulp-list at redhat.com; Sathasivam, Pradeep <
> pradeep.sathasivam at hpe.com>; Sundararajan, Maanya <
> maanya.sundararajan at hpe.com>; Gomez, Eslyn <eslyn.gomez at hpe.com>; Kumar,
> Vinod <vinod.kumar5 at hpe.com>
> *Subject:* Re: [Pulp-list] Sync task Failing for Centos8 in pulpcore
> version 3.2.1
>
>
>
> Hello,
>
>
>
> This was fixed in pulp_rpm 3.12.0 released about a month ago [0]. Up
> until recently CentOS had been using Gzip compression for their
> modules.yaml metadata, but recently they switched to LZMA (.xz) compression
> which we were not supporting properly. It should work fine if your
> pulp_rpm plugin is version >=3.12.0
>
>
>
> [0] https://github.com/pulp/pulp_rpm/blob/master/CHANGES.rst#bugfixes-1
>
>
>
> On Tue, Jun 22, 2021 at 2:13 AM J, Priyanka <priyankaj at hpe.com> wrote:
>
> Hi All,
>
>
>
> We are trying to sync http://mirror.centos.org/centos/8/BaseOS/x86_64/os/
> remote to our local pulp repository, it was successful till past few weeks
> but it is failing now with below error,
>
>
>
> pulp_version: "3.2.1"
>
> django_version: "2.2.11"
>
> pulp-rpm:
>
> prereq_role: "pulp.pulp_rpm_prerequisites"
>
> version: "3.2.0"
>
> pulp-file:
>
> version: "0.2.0"
>
>
>
> *ERROR:*
>
> {
>
> "allow": "GET, PATCH, DELETE, HEAD, OPTIONS",
>
> "attempts": 2,
>
> "changed": false,
>
> "connection": "close",
>
> "content":
> "{\"pulp_href\":\"/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/\",\"pulp_created\":\"2021-06-18T05:38:05.355153Z\",\"state\":\"failed\",\"name\":\"pulp_rpm.app.tasks.synchronizing.synchronize\",\"started_at\":\"2021-06-18T05:38:05.461725Z\",\"finished_at\":\"2021-06-18T05:38:06.550936Z\",\"error\":{\"traceback\":\"
> File \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\\\",
> line 884, in perform_job\\n rv = job.perform()\\n File
> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\", line
> 664, in perform\\n self._result = self._execute()\\n File
> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\", line
> 670, in _execute\\n return self.func(*self.args, **self.kwargs)\\n
> File
> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\",
> line 146, in synchronize\\n dv.create()\\n File
> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\\\",
> line 149, in create\\n loop.run_until_complete(pipeline)\\n File
> \\\"/usr/lib64/python3.6/asyncio/base_events.py\\\", line 484, in
> run_until_complete\\n return future.result()\\n File
> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\",
> line 228, in create_pipeline\\n await asyncio.gather(*futures)\\n
> File
> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\",
> line 43, in __call__\\n await self.run()\\n File
> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\",
> line 401, in run\\n content = moduleyaml.read()\\n File
> \\\"/usr/lib64/python3.6/codecs.py\\\", line 321, in decode\\n
> (result, consumed) = self._buffer_decode(data, self.errors, final)
> \\n\",\"description\":\"'utf-8' codec can't decode byte 0xfd in position
> 0: invalid start
> byte\"},\"worker\":\"/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/\",\"progress_reports\":[{\"message\":\"Downloading
> Metadata
> Files\",\"code\":\"downloading.metadata\",\"state\":\"failed\",\"total\":null,\"done\":1,\"suffix\":null},{\"message\":\"Downloading
> Artifacts\",\"code\":\"downloading.artifacts\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null},{\"message\":\"Associating
> Content\",\"code\":\"associating.content\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null}],\"created_resources\":[],\"reserved_resources_record\":[\"/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/\",\"/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/\"]}",
>
> "content_length": "2442",
>
> "content_type": "application/json",
>
> "cookies": {},
>
> "cookies_string": "",
>
> "date": "Fri, 18 Jun 2021 05:38:36 GMT",
>
> "elapsed": 0,
>
> "failed_when_result": true,
>
> "json": {
>
> "created_resources": [],
>
> "error": {
>
> "description": "'utf-8' codec can't decode byte 0xfd in position 0:
> invalid start byte",
>
> "traceback": " File
> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\", line
> 884, in perform_job\n rv = job.perform()\n File
> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 664,
> in perform\n self._result = self._execute()\n File
> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 670,
> in _execute\n return self.func(*self.args, **self.kwargs)\n File
> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\",
> line 146, in synchronize\n dv.create()\n File
> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\",
> line 149, in create\n loop.run_until_complete(pipeline)\n File
> \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in
> run_until_complete\n return future.result()\n File
> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\",
> line 228, in create_pipeline\n await asyncio.gather(*futures)\n File
> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\",
> line 43, in __call__\n await self.run()\n File
> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\",
> line 401, in run\n content = moduleyaml.read()\n File
> \"/usr/lib64/python3.6/codecs.py\", line 321, in decode\n (result,
> consumed) = self._buffer_decode(data, self.errors, final)\n"
>
> },
>
> "finished_at": "2021-06-18T05:38:06.550936Z",
>
> "name": "pulp_rpm.app.tasks.synchronizing.synchronize",
>
> "progress_reports": [
>
> {
>
> "code": "downloading.metadata",
>
> "done": 1,
>
> "message": "Downloading Metadata Files",
>
> "state": "failed",
>
> "suffix": null,
>
> "total": null
>
> },
>
> {
>
> "code": "downloading.artifacts",
>
> "done": 0,
>
> "message": "Downloading Artifacts",
>
> "state": "canceled",
>
> "suffix": null,
>
> "total": null
>
> },
>
> {
>
> "code": "associating.content",
>
> "done": 0,
>
> "message": "Associating Content",
>
> "state": "canceled",
>
> "suffix": null,
>
> "total": null
>
> }
>
> ],
>
> "pulp_created": "2021-06-18T05:38:05.355153Z",
>
> "pulp_href":
> "/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/",
>
> "reserved_resources_record": [
>
>
> "/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/",
>
> "/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/"
>
> ],
>
> "started_at": "2021-06-18T05:38:05.461725Z",
>
> "state": "failed",
>
> "worker": "/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/"
>
> },
>
> "msg": "OK (2442 bytes)",
>
> "redirected": false,
>
> "server": "gunicorn/20.0.4",
>
> "status": 200,
>
> "url": "
> http://<<host>>:24817/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/
> ",
>
> "vary": "Accept, Cookie",
>
> "x_frame_options": "SAMEORIGIN"
>
> }
>
>
>
> Please let me know if any one of you came across the same issue and
> solution for this.
>
>
>
> Thanks,
>
> Priyanka
>
>
>
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://listman.redhat.com/mailman/listinfo/pulp-list
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20210624/be0c66b0/attachment.htm>
More information about the Pulp-list
mailing list