[Pulp-list] RHEL 8 rpm repo sync errors

Dennis Kliban dkliban at redhat.com
Wed Mar 18 13:55:04 UTC 2020


This looks like a problem with the client certificate. The very first
request for a  file that pulp tries to download is receiving a 403 response
from the CDN. Please make sure you have the correct client certificate and
client key configured.

On Tue, Mar 17, 2020 at 5:53 PM Venkataramana Bora <venkbora at in.ibm.com>
wrote:

>
>
> Hi Teamn ,
> Getting errors as shown here when we are trying to sync RHEL 8 repos (Base
> OS and Appstream) creatd on Pulp master. The same Pulp master we already
> using for RHEL 6 and 7 repos with out any issues. Strugling with RHEL 8
> repos creation,
> 1.Could you please let us know whethere RHEL 8 rpm repos sync works on
> Pulp master version  2.16 or not ?
> 2.feed_ca_cert "redhat-uep.pem" and feed_cert "rhel-identity.pem" are
> there  . We have no issues with RHEL 6 and 7 repo syncs, those created some
> years ago and working well.
>   Is there any thing specifically need to do for RHEL 8 repos in terms of
> ca cert/feed cert ? We see "failed with code 403 Forbiddenin" in var log
> messages.
> 3.pulp-admin tasks details Traceback shows "/usr/lib/python2.7/..."
>   For this added these 3 lines in
> /etc/pulp/server/plugins.conf.d/yum_importer.json as recommended here
> https://pulp.plan.io/issues/6327
>  {
>    "validate":true
> }
> After adding that json , I see that RHEL 8 repodata xml.gz  in
> rhel8/x86_64/baseos/os/repodata/  but not "packages" folder created yet ,
> checked that thru pulp web access .
> Please help  resolving this issue .
>
> Feed url:
> https://cdn.redhat.com/content/dist/rhel8/$releasever/x86_64/baseos/os
> Feed url:
> https://cdn.redhat.com/content/dist/rhel8/$releasever/x86_64/appstream/os
> Repoid for these urls are :
> rhel-8-server-baseos-x86_64
> rhel-8-server-appstream-x86_64
> Note: Tried with "8" in place "$releasever" in feed but same error . Our
> Pulp master ver.2.16 is on CentOS 7.7.
>
> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
> Tasks performed:
>
> [root at swy01opplppr01 ~]#  pulp-admin rpm repo sync run --force-full
> --repo-id rhel-8-server-baseos-x86_64
> +----------------------------------------------------------------------+
>          Synchronizing Repository [rhel-8-server-baseos-x86_64]
> +----------------------------------------------------------------------+
> The following sync configuration options will be used:
> Force Full:  True
>
> This command may be exited via ctrl+c without affecting the request.
>
> Downloading metadata...
> [\]
> ... completed
> Downloading repository content...
> [-]
> [==================================================] 100%
> RPMs:       0/0 items
> Delta RPMs: 0/0 items
> ... completed
> Downloading distribution files...
> [==================================================] 100%
> Distributions: 0/0 items
> Task Failed
> Error retrieving metadata: Forbidden
>
>
> -------------------------------------------------------------------------------------------------------------------------
> From /var/log/messages:
>
> Mar 17 17:11:23 swy01opplppr01 pulp: celery.worker.strategy:INFO: Received
> task:
> pulp.server.async.tasks._release_resource[c5b01662-a20a-4c44-b114-b1ba595f05fc]
> Mar 17 17:11:23 swy01opplppr01 pulp: celery.app.trace:INFO: [55ba0954]
> Task
> pulp.server.async.tasks._queue_reserved_task[55ba0954-1a18-410a-9507-f61d74c4776f]
> succeeded in 0.115055091001s: None
> Mar 17 17:11:23 swy01opplppr01 pulp:
> pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading metadata
> from https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.
> Mar 17 17:11:23 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting
> new HTTPS connection (1): cdn.redhat.com
> Mar 17 17:11:23 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO:
> Download failed: Download of
> https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/repodata/repomd.xml
> failed with code 403: Forbidden
> Mar 17 17:11:24 swy01opplppr01 pulp: urllib3.connectionpool:INFO:
> [fbbc36d3] Starting new HTTPS connection (1): cdn.redhat.com
> Mar 17 17:11:24 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO:
> [fbbc36d3] Download failed: Download of
> https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os failed with
> code 403: Forbidden
> Mar 17 17:11:24 swy01opplppr01 pulp:
> pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading metadata
> from https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.
> Mar 17 17:11:24 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting
> new HTTPS connection (1): cdn.redhat.com
> Mar 17 17:11:24 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO:
> Download failed: Download of
> https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/repodata/repomd.xml
> failed with code 403: Forbidden
> Mar 17 17:11:25 swy01opplppr01 pulp: urllib3.connectionpool:INFO:
> [fbbc36d3] Starting new HTTPS connection (1): cdn.redhat.com
> Mar 17 17:11:25 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO:
> [fbbc36d3] Download failed: Download of
> https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os failed with
> code 403: Forbidden
> Mar 17 17:11:25 swy01opplppr01 pulp:
> pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading metadata
> from https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.
> Mar 17 17:11:25 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting
> new HTTPS connection (1): cdn.redhat.com
> Mar 17 17:11:25 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO:
> Download failed: Download of
> https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/repodata/repomd.xml
> failed with code 403: Forbidden
> Mar 17 17:11:26 swy01opplppr01 pulp: urllib3.connectionpool:INFO:
> [fbbc36d3] Starting new HTTPS connection (1): cdn.redhat.com
> Mar 17 17:11:26 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO:
> [fbbc36d3] Download failed: Download of
> https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os failed with
> code 403: Forbidden
> Mar 17 17:11:26 swy01opplppr01 pulp:
> pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading metadata
> from https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.
> Mar 17 17:11:26 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting
> new HTTPS connection (1): cdn.redhat.com
> Mar 17 17:11:27 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO:
> Download failed: Download of
> https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/repodata/repomd.xml
> failed with code 403: Forbidden
> Mar 17 17:11:27 swy01opplppr01 pulp:
> pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading additional
> units.
> Mar 17 17:11:27 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting
> new HTTPS connection (1): cdn.redhat.com
> Mar 17 17:11:28 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO:
> Download failed: Download of
> https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.treeinfo
> failed with code 404: Not Found
> Mar 17 17:11:28 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting
> new HTTPS connection (1): cdn.redhat.com
> Mar 17 17:11:29 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO:
> Download failed: Download of
> https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/treeinfo
> failed with code 404: Not Found
> Mar 17 17:11:30 swy01opplppr01 pulp: pulp.server.async.tasks:INFO:
> [fbbc36d3] Task failed : [fbbc36d3-fddd-4f54-9be6-770acecf374f] : Error
> retrieving metadata: Forbidden
> Mar 17 17:11:30 swy01opplppr01 pulp: celery.app.trace:INFO: [fbbc36d3]
> Task
> pulp.server.managers.repo.sync.sync[fbbc36d3-fddd-4f54-9be6-770acecf374f]
> raised expected: PulpCodedException()
> Mar 17 17:11:30 swy01opplppr01 pulp: celery.app.trace:INFO: [c5b01662]
> Task
> pulp.server.async.tasks._release_resource[c5b01662-a20a-4c44-b114-b1ba595f05fc]
> succeeded in 0.00344043700079s: None
>
> -----------------------------------------------------------------------------------------------------
>
> [root at swy01opplppr01 ~]# pulp-admin tasks details --task-id
> fbbc36d3-fddd-4f54-9be6-770acecf374f
> +----------------------------------------------------------------------+
>                               Task Details
> +----------------------------------------------------------------------+
> Operations:       sync
> Resources:        rhel-8-server-baseos-x86_64 (repository)
> State:            Failed
> Start Time:       2020-03-17T21:11:23Z
> Finish Time:      2020-03-17T21:11:30Z
> Result:           N/A
> Task Id:          fbbc36d3-fddd-4f54-9be6-770acecf374f
> Worker Name:
> reserved_resource_worker-3 at swy01opplppr01.ops.hosting.knxa
> Progress Report:
>   Yum Importer:
>     Comps:
>       State: FINISHED
>     Content:
>       Details:
>         Drpm Done:  0
>         Drpm Total: 0
>         Rpm Done:   0
>         Rpm Total:  0
>       Error Details:
>       Items Left:    0
>       Items Total:   0
>       Size Left:     0
>       Size Total:    0
>       State:         FINISHED
>     Distribution:
>       Error Details:
>       Items Left:    0
>       Items Total:   0
>       State:         FINISHED
>     Errata:
>       State: FINISHED
>     Metadata:
>       State: FINISHED
>     Purge Duplicates:
>       State: FINISHED
> Traceback:        Traceback (most recent call last):   File
>                   "/usr/lib/python2.7/site-packages/celery/app/trace.py",
> line
>                   382, in trace_task     R = retval = fun(*args, **kwargs)
>                   File
>
> "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
>                   line 529, in __call__     return super(Task,
>                   self).__call__(*args, **kwargs)   File
>
> "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
>                   line 107, in __call__     return super(PulpTask,
>                   self).__call__(*args, **kwargs)   File
>                   "/usr/lib/python2.7/site-packages/celery/app/trace.py",
> line
>                   641, in __protected_call__     return self.run(*args,
>                   **kwargs)   File
>
> "/usr/lib/python2.7/site-packages/pulp/server/controllers/repo
>                   sitory.py", line 769, in sync     sync_report =
>                   sync_repo(transfer_repo, conduit, call_config)   File
>
> "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
>                   line 737, in wrap_f     return f(*args, **kwargs)   File
>
> "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/y
>                   um/importer.py", line 82, in sync_repo     report =
>                   self._current_sync.run()   File
>
> "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/y
>                   um/sync.py", line 335, in run
>                   reason=self.repomd_not_found_reason) PulpCodedException:
> Error
>                   retrieving metadata: Forbidden
>
>
> -------------------------------------------------------------------------------
>
> Sincerely,
> Ramana Bora
>
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20200318/61790601/attachment.htm>


More information about the Pulp-list mailing list