[Pulp-list] Sync task Failing for Centos8 in pulpcore version 3.2.1

[J, Priyanka]

Hi All,

We are trying to sync http://mirror.centos.org/centos/8/BaseOS/x86_64/os/ remote to our local pulp repository, it was successful till past few weeks but it is failing now with below error,

pulp_version: "3.2.1"
django_version: "2.2.11"
pulp-rpm:
        prereq_role: "pulp.pulp_rpm_prerequisites"
        version: "3.2.0"
pulp-file:
        version: "0.2.0"

ERROR:
{
  "allow": "GET, PATCH, DELETE, HEAD, OPTIONS",
  "attempts": 2,
  "changed": false,
  "connection": "close",
  "content": "{\"pulp_href\":\"/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/\",\"pulp_created\":\"2021-06-18T05:38:05.355153Z\",\"state\":\"failed\",\"name\":\"pulp_rpm.app.tasks.synchronizing.synchronize\",\"started_at\":\"2021-06-18T05:38:05.461725Z\",\"finished_at\":\"2021-06-18T05:38:06.550936Z\",\"error\":{\"traceback\":\"  File \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\\\", line 884, in perform_job\\n    rv = job.perform()\\n  File \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\", line 664, in perform\\n    self._result = self._execute()\\n  File \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\", line 670, in _execute\\n    return self.func(*self.args, **self.kwargs)\\n  File \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\", line 146, in synchronize\\n    dv.create()\\n  File \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\\\", line 149, in create\\n    loop.run_until_complete(pipeline)\\n  File \\\"/usr/lib64/python3.6/asyncio/base_events.py\\\", line 484, in run_until_complete\\n    return future.result()\\n  File \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\", line 228, in create_pipeline\\n    await asyncio.gather(*futures)\\n  File \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\", line 43, in __call__\\n    await self.run()\\n  File \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\", line 401, in run\\n    content = moduleyaml.read()\\n  File \\\"/usr/lib64/python3.6/codecs.py\\\", line 321, in decode\\n    (result, consumed) = self._buffer_decode(data, self.errors, final)\\n\",\"description\":\"'utf-8' codec can't decode byte 0xfd in position 0: invalid start byte\"},\"worker\":\"/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/\",\"progress_reports\":[{\"message\":\"Downloading Metadata Files\",\"code\":\"downloading.metadata\",\"state\":\"failed\",\"total\":null,\"done\":1,\"suffix\":null},{\"message\":\"Downloading Artifacts\",\"code\":\"downloading.artifacts\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null},{\"message\":\"Associating Content\",\"code\":\"associating.content\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null}],\"created_resources\":[],\"reserved_resources_record\":[\"/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/\",\"/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/\"]}",
  "content_length": "2442",
  "content_type": "application/json",
  "cookies": {},
  "cookies_string": "",
  "date": "Fri, 18 Jun 2021 05:38:36 GMT",
  "elapsed": 0,
  "failed_when_result": true,
  "json": {
    "created_resources": [],
    "error": {
      "description": "'utf-8' codec can't decode byte 0xfd in position 0: invalid start byte",
      "traceback": "  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\", line 884, in perform_job\n    rv = job.perform()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 664, in perform\n    self._result = self._execute()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 670, in _execute\n    return self.func(*self.args, **self.kwargs)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 146, in synchronize\n    dv.create()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\", line 149, in create\n    loop.run_until_complete(pipeline)\n  File \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in run_until_complete\n    return future.result()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 228, in create_pipeline\n    await asyncio.gather(*futures)\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\", line 43, in __call__\n    await self.run()\n  File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 401, in run\n    content = moduleyaml.read()\n  File \"/usr/lib64/python3.6/codecs.py\", line 321, in decode\n    (result, consumed) = self._buffer_decode(data, self.errors, final)\n"
    },
    "finished_at": "2021-06-18T05:38:06.550936Z",
    "name": "pulp_rpm.app.tasks.synchronizing.synchronize",
    "progress_reports": [
      {
        "code": "downloading.metadata",
        "done": 1,
        "message": "Downloading Metadata Files",
        "state": "failed",
        "suffix": null,
        "total": null
      },
      {
        "code": "downloading.artifacts",
        "done": 0,
        "message": "Downloading Artifacts",
        "state": "canceled",
        "suffix": null,
        "total": null
      },
      {
        "code": "associating.content",
        "done": 0,
        "message": "Associating Content",
        "state": "canceled",
        "suffix": null,
        "total": null
      }
    ],
    "pulp_created": "2021-06-18T05:38:05.355153Z",
    "pulp_href": "/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/",
    "reserved_resources_record": [
      "/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/",
      "/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/"
    ],
    "started_at": "2021-06-18T05:38:05.461725Z",
    "state": "failed",
    "worker": "/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/"
  },
  "msg": "OK (2442 bytes)",
  "redirected": false,
  "server": "gunicorn/20.0.4",
  "status": 200,
  "url": "http://<<host>>:24817/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/",
  "vary": "Accept, Cookie",
  "x_frame_options": "SAMEORIGIN"
}

Please let me know if any one of you came across the same issue and solution for this.

Thanks,
Priyanka

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20210622/93ff5e5a/attachment.htm>