[Pulp-list] How to troubleshoot: Cannot sync EPEL

Dumont, Joey Joey.Dumont at nrc-cnrc.gc.ca
Fri Nov 8 19:18:10 UTC 2019


Hi,


Versions:


    "versions": [
        {
            "component": "pulpcore",
            "version": "3.0.0rc7"
        },
        {
            "component": "pulpcore-plugin",
            "version": "0.1.0rc7"
        },
        {
            "component": "pulp_rpm",
            "version": "3.0.0b7"
        },
        {
            "component": "pulp_file",
            "version": "0.1.0b4"
        }
    ]
}

Relevant error messages I found in journalctl:

pulp: backoff:ERROR: Giving up _run(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://d2lzkl7pfhq30w.cloudfront.net/pub/epel/7/x86_64/treeinfo'))
Giving up _run(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://d2lzkl7pfhq30w.cloudfront.net/pub/epel/7/x86_64/treeinfo'))
pulp: backoff:ERROR: Giving up _run(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://d2lzkl7pfhq30w.cloudfront.net/pub/epel/7/x86_64/.treeinfo'))
Giving up _run(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://d2lzkl7pfhq30w.cloudfront.net/pub/epel/7/x86_64/.treeinfo'))
pulp: pulp_rpm.app.tasks.synchronizing:INFO: Synchronizing: repository=test-rpm remote=test-rpm-remote
pulp: rq.worker:INFO: Cleaning registries for queue: resource-manager
pulp: rq.worker:INFO: resource-manager: Job OK (6cc2e593-83b5-4ef9-9bcf-84175707670c)
pulp: rq.worker:INFO: reserved-resource-worker-1 at ip-100-96-160-204.opsaws.nrc.ca: e8c293fe-e5f2-402f-a3e3-a33f421ed8cb
127.0.0.1 - admin [06/Nov/2019:14:15:38 +0000] "POST /pulp/api/v3/remotes/rpm/rpm/fa1c9782-11cb-415f-b710-17df275a82de/sync/ HTTP/1.1" 202 67 "-" "HTTPie/0.9.4"
pulp: rq.worker:INFO: resource-manager: 6cc2e593-83b5-4ef9-9bcf-84175707670c​

It's looking for a .treeinfo file, without success, then failing. What is a .treeinfo file?


Joey Dumont

Technical Advisor, Knowledge, Information, and Technology Services
National Research Council Canada / Governement of Canada
joey.dumont at nrc-cnrc.gc.ca<mailto:joey.dumont at nrc-cnrc.gc.ca> / Tel: 613-990-8152 / Cell: 438-340-7436

Conseiller technique, Services du savoir, de l'information et de la technologie
Conseil national de recherches Canada / Gouvernement du Canada
joey.dumont at nrc-cnrc.gc.ca<mailto:joey.dumont at nrc-cnrc.gc.ca> / Tél.: 613-990-8152 / Tél. cell.: 438-340-7436
________________________________
From: Tatiana Tereshchenko <ttereshc at redhat.com>
Sent: 08 November 2019 14:02
To: Dumont, Joey
Cc: pulp-list at redhat.com
Subject: Re: [Pulp-list] How to troubleshoot: Cannot sync EPEL

Hi Joey,

Can you please share which version you are running?
http GET :24817/pulp/api/v3/status/

Logs should be available in the standard location depending on your system and configuration.
E.g. if you have journalctl, you can see pulp logs there.

Tanya


On Wed, Nov 6, 2019 at 3:18 PM Dumont, Joey <Joey.Dumont at nrc-cnrc.gc.ca<mailto:Joey.Dumont at nrc-cnrc.gc.ca>> wrote:

I am trying to sync the EPEL repo using the pulp-rpm plugin. Here's the repo info:


http GET :24817/pulp/api/v3/remotes/rpm/rpm/fa1c9782-11cb-415f-b710-17df275a82de/

{
    "download_concurrency": 20,
    "name": "test-rpm-remote",
    "policy": "immediate",
    "proxy_url": null,
    "pulp_created": "2019-10-31T15:51:43.651250Z",
    "pulp_href": "/pulp/api/v3/remotes/rpm/rpm/fa1c9782-11cb-415f-b710-17df275a82de/",
    "pulp_last_updated": "2019-11-05T19:56:38.242131Z",
    "ssl_ca_certificate": null,
    "ssl_client_certificate": null,
    "ssl_client_key": null,
    "ssl_validation": true,
    "url": "http://download.fedoraproject.org/pub/epel/7/x86_64/"
}

Here's the repo used to do the sync:

http GET :24817/pulp/api/v3/repositories/086a95b2-6aaa-4786-b317-f0e91fa2b800/
{
    "description": null,
    "latest_version_href": null,
    "name": "test-rpm",
    "plugin_managed": false,
    "pulp_created": "2019-10-31T15:41:08.128783Z",
    "pulp_href": "/pulp/api/v3/repositories/086a95b2-6aaa-4786-b317-f0e91fa2b800/",
    "versions_href": "/pulp/api/v3/repositories/086a95b2-6aaa-4786-b317-f0e91fa2b800/versions/"
}

When trying to sync using

​http POST :24817/pulp/api/v3/remotes/rpm/rpm/fa1c9782-11cb-415f-b710-17df275a82de/sync/ repository=/pulp/api/v3/repositories/086a95b2-6aaa-4786-b317-f0e91fa2b800/

The task reports a failed state after a couple seconds, with no traceback or description. I can see that 4404 errata were parsed, and some metadata files, but no error messages. Where can I see a more detailed log of what happened in that task to troubleshoot this?

$ http :24817/pulp/api/v3/tasks/ | jq '.results[0]'
{
  "pulp_href": "/pulp/api/v3/tasks/e8c293fe-e5f2-402f-a3e3-a33f421ed8cb/",
  "pulp_created": "2019-11-06T14:15:38.444316Z",
  "state": "failed",
  "name": "pulp_rpm.app.tasks.synchronizing.synchronize",
  "started_at": "2019-11-06T14:15:38.561114Z",
  "finished_at": "2019-11-06T14:16:08.555068Z",
  "error": {
    "traceback": "",
    "description": "None"
  },
  "worker": "/pulp/api/v3/workers/fa48d3b3-3341-4d6d-a3a4-31386d2f7580/",
  "parent": null,
  "spawned_tasks": [],
  "progress_reports": [
    {
      "message": "Downloading Metadata Files",
      "code": "downloading.metadata",
      "state": "running",
      "total": null,
      "done": 5,
      "suffix": null
    },
    {
      "message": "Downloading Artifacts",
      "code": "downloading.artifacts",
      "state": "running",
      "total": null,
      "done": 0,
      "suffix": null
    },
    {
      "message": "Parsed Packages",
      "code": "parsing.packages",
      "state": "waiting",
      "total": null,
      "done": 0,
      "suffix": null
    },
    {
      "message": "Associating Content",
      "code": "associating.content",
      "state": "running",
      "total": null,
      "done": 0,
      "suffix": null
    },
    {
      "message": "Parsed Erratum",
      "code": "parsing.errata",
      "state": "running",
      "total": 4404,
      "done": 4404,
      "suffix": null
    }
  ],
  "created_resources": [
    null
  ],
  "reserved_resources_record": [
    "/pulp/api/v3/remotes/rpm/rpm/fa1c9782-11cb-415f-b710-17df275a82de/",
    "/pulp/api/v3/repositories/086a95b2-6aaa-4786-b317-f0e91fa2b800/"
  ]
}




Thanks,



Joey Dumont

Technical Advisor, Knowledge, Information, and Technology Services
National Research Council Canada / Governement of Canada
joey.dumont at nrc-cnrc.gc.ca<mailto:joey.dumont at nrc-cnrc.gc.ca> / Tel: 613-990-8152 / Cell: 438-340-7436

Conseiller technique, Services du savoir, de l'information et de la technologie
Conseil national de recherches Canada / Gouvernement du Canada
joey.dumont at nrc-cnrc.gc.ca<mailto:joey.dumont at nrc-cnrc.gc.ca> / Tél.: 613-990-8152 / Tél. cell.: 438-340-7436
_______________________________________________
Pulp-list mailing list
Pulp-list at redhat.com<mailto:Pulp-list at redhat.com>
https://www.redhat.com/mailman/listinfo/pulp-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20191108/9bd3f880/attachment.htm>


More information about the Pulp-list mailing list