[Pulp-list] Sync task Failing for Centos8 in pulpcore version 3.2.1
Daniel Alley
dalley at redhat.com
Thu Jun 24 17:49:22 UTC 2021
Quick note, 3.13.2 is the latest version of the RPM plugin (released
yesterday), and it has some important bugfixes compared to 3.13.0. Make
sure that your RPM plugin is either on 3.12.0 or 3.13.2 to avoid those
issues.
On Thu, Jun 24, 2021 at 1:42 PM Daniel Alley <dalley at redhat.com> wrote:
> Maanya, could you please describe which versions you have currently
> installed right now? And how was it installed - did you use the ansible
> installer, or install the packages manually?
>
> Our recommendation would be to use the ansible installer (instructions
> here
> <https://pulp-installer.readthedocs.io/en/latest/quickstart/#getting-started>)
> to upgrade your pulp installation to the latest pulpcore 3.13.0 release
> with compatible plugins. As the version of pulpcore you have installed is
> from March 2020 (~15 months), you must upgrade all of the components of
> pulp rather than just the RPM plugin, as the most recent versions require a
> newer version of pulpcore. The ansible installer should handle that for
> you.
>
> Let us know if you have any questions about that process.
>
> On Thu, Jun 24, 2021 at 12:26 PM Sundararajan, Maanya <
> maanya.sundararajan at hpe.com> wrote:
>
>> Hello,
>>
>>
>>
>> Thank you for the quick response.
>>
>> We tried it with pulp_rpm version as 3.12.0 as well as 3.13.0. However we
>> are facing some incompatibility errors with versions of pulp_version,
>> django_version, pulp-rpm and pulp-file.
>>
>> We have tried all possible versions of these but none of them seem to
>> work. Could you please provide us with the versions for these as well?
>>
>>
>>
>> Regards,
>>
>> Maanya S
>>
>>
>>
>>
>>
>> *From:* Daniel Alley <dalley at redhat.com>
>> *Sent:* Tuesday, June 22, 2021 5:55 PM
>> *To:* J, Priyanka <priyankaj at hpe.com>
>> *Cc:* pulp-list at redhat.com; Sathasivam, Pradeep <
>> pradeep.sathasivam at hpe.com>; Sundararajan, Maanya <
>> maanya.sundararajan at hpe.com>; Gomez, Eslyn <eslyn.gomez at hpe.com>; Kumar,
>> Vinod <vinod.kumar5 at hpe.com>
>> *Subject:* Re: [Pulp-list] Sync task Failing for Centos8 in pulpcore
>> version 3.2.1
>>
>>
>>
>> Hello,
>>
>>
>>
>> This was fixed in pulp_rpm 3.12.0 released about a month ago [0]. Up
>> until recently CentOS had been using Gzip compression for their
>> modules.yaml metadata, but recently they switched to LZMA (.xz) compression
>> which we were not supporting properly. It should work fine if your
>> pulp_rpm plugin is version >=3.12.0
>>
>>
>>
>> [0] https://github.com/pulp/pulp_rpm/blob/master/CHANGES.rst#bugfixes-1
>>
>>
>>
>> On Tue, Jun 22, 2021 at 2:13 AM J, Priyanka <priyankaj at hpe.com> wrote:
>>
>> Hi All,
>>
>>
>>
>> We are trying to sync http://mirror.centos.org/centos/8/BaseOS/x86_64/os/
>> remote to our local pulp repository, it was successful till past few weeks
>> but it is failing now with below error,
>>
>>
>>
>> pulp_version: "3.2.1"
>>
>> django_version: "2.2.11"
>>
>> pulp-rpm:
>>
>> prereq_role: "pulp.pulp_rpm_prerequisites"
>>
>> version: "3.2.0"
>>
>> pulp-file:
>>
>> version: "0.2.0"
>>
>>
>>
>> *ERROR:*
>>
>> {
>>
>> "allow": "GET, PATCH, DELETE, HEAD, OPTIONS",
>>
>> "attempts": 2,
>>
>> "changed": false,
>>
>> "connection": "close",
>>
>> "content":
>> "{\"pulp_href\":\"/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/\",\"pulp_created\":\"2021-06-18T05:38:05.355153Z\",\"state\":\"failed\",\"name\":\"pulp_rpm.app.tasks.synchronizing.synchronize\",\"started_at\":\"2021-06-18T05:38:05.461725Z\",\"finished_at\":\"2021-06-18T05:38:06.550936Z\",\"error\":{\"traceback\":\"
>> File
>> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\\\",
>> line 884, in perform_job\\n rv = job.perform()\\n File
>> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\",
>> line 664, in perform\\n self._result = self._execute()\\n File
>> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\",
>> line 670, in _execute\\n return self.func(*self.args, **self.kwargs)
>> \\n File
>> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\",
>> line 146, in synchronize\\n dv.create()\\n File
>> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\\\",
>> line 149, in create\\n loop.run_until_complete(pipeline)\\n File
>> \\\"/usr/lib64/python3.6/asyncio/base_events.py\\\", line 484, in
>> run_until_complete\\n return future.result()\\n File
>> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\",
>> line 228, in create_pipeline\\n await asyncio.gather(*futures)\\n
>> File
>> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\",
>> line 43, in __call__\\n await self.run()\\n File
>> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\",
>> line 401, in run\\n content = moduleyaml.read()\\n File
>> \\\"/usr/lib64/python3.6/codecs.py\\\", line 321, in decode\\n
>> (result, consumed) = self._buffer_decode(data, self.errors, final)
>> \\n\",\"description\":\"'utf-8' codec can't decode byte 0xfd in position
>> 0: invalid start
>> byte\"},\"worker\":\"/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/\",\"progress_reports\":[{\"message\":\"Downloading
>> Metadata
>> Files\",\"code\":\"downloading.metadata\",\"state\":\"failed\",\"total\":null,\"done\":1,\"suffix\":null},{\"message\":\"Downloading
>> Artifacts\",\"code\":\"downloading.artifacts\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null},{\"message\":\"Associating
>> Content\",\"code\":\"associating.content\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null}],\"created_resources\":[],\"reserved_resources_record\":[\"/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/\",\"/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/\"]}",
>>
>> "content_length": "2442",
>>
>> "content_type": "application/json",
>>
>> "cookies": {},
>>
>> "cookies_string": "",
>>
>> "date": "Fri, 18 Jun 2021 05:38:36 GMT",
>>
>> "elapsed": 0,
>>
>> "failed_when_result": true,
>>
>> "json": {
>>
>> "created_resources": [],
>>
>> "error": {
>>
>> "description": "'utf-8' codec can't decode byte 0xfd in position 0:
>> invalid start byte",
>>
>> "traceback": " File
>> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\", line
>> 884, in perform_job\n rv = job.perform()\n File
>> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 664,
>> in perform\n self._result = self._execute()\n File
>> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 670,
>> in _execute\n return self.func(*self.args, **self.kwargs)\n File
>> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\",
>> line 146, in synchronize\n dv.create()\n File
>> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\",
>> line 149, in create\n loop.run_until_complete(pipeline)\n File
>> \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in
>> run_until_complete\n return future.result()\n File
>> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\",
>> line 228, in create_pipeline\n await asyncio.gather(*futures)\n File
>> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\",
>> line 43, in __call__\n await self.run()\n File
>> \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\",
>> line 401, in run\n content = moduleyaml.read()\n File
>> \"/usr/lib64/python3.6/codecs.py\", line 321, in decode\n (result,
>> consumed) = self._buffer_decode(data, self.errors, final)\n"
>>
>> },
>>
>> "finished_at": "2021-06-18T05:38:06.550936Z",
>>
>> "name": "pulp_rpm.app.tasks.synchronizing.synchronize",
>>
>> "progress_reports": [
>>
>> {
>>
>> "code": "downloading.metadata",
>>
>> "done": 1,
>>
>> "message": "Downloading Metadata Files",
>>
>> "state": "failed",
>>
>> "suffix": null,
>>
>> "total": null
>>
>> },
>>
>> {
>>
>> "code": "downloading.artifacts",
>>
>> "done": 0,
>>
>> "message": "Downloading Artifacts",
>>
>> "state": "canceled",
>>
>> "suffix": null,
>>
>> "total": null
>>
>> },
>>
>> {
>>
>> "code": "associating.content",
>>
>> "done": 0,
>>
>> "message": "Associating Content",
>>
>> "state": "canceled",
>>
>> "suffix": null,
>>
>> "total": null
>>
>> }
>>
>> ],
>>
>> "pulp_created": "2021-06-18T05:38:05.355153Z",
>>
>> "pulp_href":
>> "/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/",
>>
>> "reserved_resources_record": [
>>
>>
>> "/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/",
>>
>> "/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/"
>>
>> ],
>>
>> "started_at": "2021-06-18T05:38:05.461725Z",
>>
>> "state": "failed",
>>
>> "worker": "/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/"
>>
>> },
>>
>> "msg": "OK (2442 bytes)",
>>
>> "redirected": false,
>>
>> "server": "gunicorn/20.0.4",
>>
>> "status": 200,
>>
>> "url": "
>> http://<<host>>:24817/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/
>> ",
>>
>> "vary": "Accept, Cookie",
>>
>> "x_frame_options": "SAMEORIGIN"
>>
>> }
>>
>>
>>
>> Please let me know if any one of you came across the same issue and
>> solution for this.
>>
>>
>>
>> Thanks,
>>
>> Priyanka
>>
>>
>>
>> _______________________________________________
>> Pulp-list mailing list
>> Pulp-list at redhat.com
>> https://listman.redhat.com/mailman/listinfo/pulp-list
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20210624/08988d50/attachment.htm>
More information about the Pulp-list
mailing list