<div dir="ltr">Quick note, 3.13.2 is the latest version of the RPM plugin (released yesterday), and it has some important bugfixes compared to 3.13.0. Make sure that your RPM plugin is either on 3.12.0 or 3.13.2 to avoid those issues. </div> <div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 24, 2021 at 1:42 PM Daniel Alley <<a href="mailto:dalley@redhat.com" target="_blank">dalley@redhat.com</a>> wrote: </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Maanya, could you please describe which versions you have currently installed right now? And how was it installed - did you use the ansible installer, or install the packages manually?</div><div> </div><div>Our recommendation would be to use the ansible installer (instructions <a href="https://pulp-installer.readthedocs.io/en/latest/quickstart/#getting-started" target="_blank">here</a>) to upgrade your pulp installation to the latest pulpcore 3.13.0 release with compatible plugins. As the version of pulpcore you have installed is from March 2020 (~15 months), you must upgrade all of the components of pulp rather than just the RPM plugin, as the most recent versions require a newer version of pulpcore. The ansible installer should handle that for you. </div><div> </div><div>Let us know if you have any questions about that process. </div><div></div></div> <div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 24, 2021 at 12:26 PM Sundararajan, Maanya <<a href="mailto:maanya.sundararajan@hpe.com" target="_blank">maanya.sundararajan@hpe.com</a>> wrote: </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div lang="EN-GB"> <div> Hello, Thank you for the quick response. We tried it with pulp_rpm version as 3.12.0 as well as 3.13.0. However we are facing some incompatibility errors with versions of pulp_version, django_version, pulp-rpm and pulp-file. We have tried all possible versions of these but none of them seem to work. Could you please provide us with the versions for these as well? Regards, Maanya S <div style="border-color:rgb(225,225,225) currentcolor currentcolor;border-style:solid none none;border-width:1pt medium medium;padding:3pt 0in 0in"> From: Daniel Alley <<a href="mailto:dalley@redhat.com" target="_blank">dalley@redhat.com</a>> Sent: Tuesday, June 22, 2021 5:55 PM To: J, Priyanka <<a href="mailto:priyankaj@hpe.com" target="_blank">priyankaj@hpe.com</a>> Cc: <a href="mailto:pulp-list@redhat.com" target="_blank">pulp-list@redhat.com</a>; Sathasivam, Pradeep <<a href="mailto:pradeep.sathasivam@hpe.com" target="_blank">pradeep.sathasivam@hpe.com</a>>; Sundararajan, Maanya <<a href="mailto:maanya.sundararajan@hpe.com" target="_blank">maanya.sundararajan@hpe.com</a>>; Gomez, Eslyn <<a href="mailto:eslyn.gomez@hpe.com" target="_blank">eslyn.gomez@hpe.com</a>>; Kumar, Vinod <<a href="mailto:vinod.kumar5@hpe.com" target="_blank">vinod.kumar5@hpe.com</a>> Subject: Re: [Pulp-list] Sync task Failing for Centos8 in pulpcore version 3.2.1 </div> <div> <div> Hello, </div> <div> </div> <div> This was fixed in pulp_rpm 3.12.0 released about a month ago [0]. Up until recently CentOS had been using Gzip compression for their modules.yaml metadata, but recently they switched to LZMA (.xz) compression which we were not supporting properly. It should work fine if your pulp_rpm plugin is version >=3.12.0 </div> <div> </div> <div> [0] <a href="https://github.com/pulp/pulp_rpm/blob/master/CHANGES.rst#bugfixes-1" target="_blank"> https://github.com/pulp/pulp_rpm/blob/master/CHANGES.rst#bugfixes-1</a> </div> </div> <div> <div> On Tue, Jun 22, 2021 at 2:13 AM J, Priyanka <<a href="mailto:priyankaj@hpe.com" target="_blank">priyankaj@hpe.com</a>> wrote: </div> <blockquote style="border-color:currentcolor currentcolor currentcolor rgb(204,204,204);border-style:none none none solid;border-width:medium medium medium 1pt;padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in"> <div> <div> Hi All, We are trying to sync <a href="http://mirror.centos.org/centos/8/BaseOS/x86_64/os/" target="_blank">http://mirror.centos.org/centos/8/BaseOS/x86_64/os/</a> remote to our local pulp repository, it was successful till past few weeks but it is failing now with below error, pulp_version: "3.2.1" django_version: "2.2.11" pulp-rpm: prereq_role: "pulp.pulp_rpm_prerequisites" version: "3.2.0" pulp-file: version: "0.2.0" ERROR: { "allow": "GET, PATCH, DELETE, HEAD, OPTIONS", "attempts": 2, "changed": false, "connection": "close", "content": "{\"pulp_href\":\"/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/\",\"pulp_created\":\"2021-06-18T05:38:05.355153Z\",\"state\":\"failed\",\"name\":\"pulp_rpm.app.tasks.synchronizing.synchronize\",\"started_at\":\"2021-06-18T05:38:05.461725Z\",\"finished_at\":\"2021-06-18T05:38:06.550936Z\",\"error\":{\"traceback\":\" File <a> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\\\</a>", line 884, in perform_job\\n rv = job.perform()<a>\\n</a> File <a> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\</a>", line 664, in perform\\n self._result = self._execute()<a>\\n</a> File <a> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\</a>", line 670, in _execute\\n return self.func(*self.args, **self.kwargs)<a>\\n</a> File <a> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\</a>", line 146, in synchronize\\n dv.create()<a>\\n</a> File <a> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\\\</a>", line 149, in create\\n loop.run_until_complete(pipeline)<a>\\n</a> File <a>\\\"/usr/lib64/python3.6/asyncio/base_events.py\\\</a>", line 484, in run_until_complete\\n return future.result()<a>\\n</a> File <a> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\</a>", line 228, in create_pipeline\\n await asyncio.gather(*futures)<a>\\n</a> File <a> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\</a>", line 43, in __call__\\n await self.run()<a>\\n</a> File <a> \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\</a>", line 401, in run\\n content = moduleyaml.read()<a>\\n</a> File <a>\\\"/usr/lib64/python3.6/codecs.py\\\</a>", line 321, in decode\\n (result, consumed) = self._buffer_decode(data, self.errors, final)<a>\\n\",\"description\":\"'utf-8</a>' codec can't decode byte 0xfd in position 0: invalid start byte\"},\"worker\":\"/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/\",\"progress_reports\":[{\"message\":\"Downloading Metadata Files\",\"code\":\"downloading.metadata\",\"state\":\"failed\",\"total\":null,\"done\":1,\"suffix\":null},{\"message\":\"Downloading Artifacts\",\"code\":\"downloading.artifacts\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null},{\"message\":\"Associating Content\",\"code\":\"associating.content\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null}],\"created_resources\":[],\"reserved_resources_record\":[\"/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/\",\"/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/\"]}", "content_length": "2442", "content_type": "application/json", "cookies": {}, "cookies_string": "", "date": "Fri, 18 Jun 2021 05:38:36 GMT", "elapsed": 0, "failed_when_result": true, "json": { "created_resources": [], "error": { "description": "'utf-8' codec can't decode byte 0xfd in position 0: invalid start byte", "traceback": " File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\", line 884, in perform_job\n rv = job.perform()\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 664, in perform\n self._result = self._execute()\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 670, in _execute\n return self.func(*self.args, **self.kwargs)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 146, in synchronize\n dv.create()\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\", line 149, in create\n loop.run_until_complete(pipeline)\n File \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in run_until_complete\n return future.result()\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 228, in create_pipeline\n await asyncio.gather(*futures)\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 43, in __call__\n await self.run()\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 401, in run\n content = moduleyaml.read()\n File \"/usr/lib64/python3.6/codecs.py\", line 321, in decode\n (result, consumed) = self._buffer_decode(data, self.errors, final)\n" }, "finished_at": "2021-06-18T05:38:06.550936Z", "name": "pulp_rpm.app.tasks.synchronizing.synchronize", "progress_reports": [ { "code": "downloading.metadata", "done": 1, "message": "Downloading Metadata Files", "state": "failed", "suffix": null, "total": null }, { "code": "downloading.artifacts", "done": 0, "message": "Downloading Artifacts", "state": "canceled", "suffix": null, "total": null }, { "code": "associating.content", "done": 0, "message": "Associating Content", "state": "canceled", "suffix": null, "total": null } ], "pulp_created": "2021-06-18T05:38:05.355153Z", "pulp_href": "/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/", "reserved_resources_record": [ "/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/", "/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/" ], "started_at": "2021-06-18T05:38:05.461725Z", "state": "failed", "worker": "/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/" }, "msg": "OK (2442 bytes)", "redirected": false, "server": "gunicorn/20.0.4", "status": 200, "url": "<a href="http://%3c%3chost%3e%3e:24817/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/" target="_blank">http://<<host>>:24817/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/</a>", "vary": "Accept, Cookie", "x_frame_options": "SAMEORIGIN" } Please let me know if any one of you came across the same issue and solution for this. Thanks, Priyanka </div> </div> _______________________________________________ Pulp-list mailing list <a href="mailto:Pulp-list@redhat.com" target="_blank">Pulp-list@redhat.com</a> <a href="https://listman.redhat.com/mailman/listinfo/pulp-list" target="_blank">https://listman.redhat.com/mailman/listinfo/pulp-list</a> </blockquote> </div> </div> </div> </blockquote></div> </blockquote></div>