[Pulp-list] Pulp failed sync repository

Thiago do Carmo Campos thiago.campos at selic.anbima.com.br
Thu May 10 18:59:51 UTC 2018 

Hi,

I use pulp to maintain a local repository for RHEL  6 and 7 but now I am having an error with time out to download the packages. Someone can help or some glue?

Thanks for any help.

Bellow logs from pulp .
------
May 10 12:21:23 vx970 pulp: py.warnings:WARNING: (1245-21568) /usr/lib/python2.7/site-packages/pulp/server/db/model/__init__.py:552: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead.
May 10 12:21:23 vx970 pulp: py.warnings:WARNING: (1245-21568)   TaskStatus._get_collection().update({'task_id': task_id}, update, upsert=True)
May 10 12:21:23 vx970 pulp: py.warnings:WARNING: (1245-21568)
May 10 12:21:23 vx970 pulp: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
May 10 12:21:23 vx970 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[e5127b6a-d1e3-472c-b547-0b13a2908a74]
May 10 12:21:23 vx970 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.sync.sync[09dada05-795b-4882-b5c5-76e19d269bff]
May 10 12:21:23 vx970 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[0099037d-4f12-4dbd-9ae5-6580ab0556f5]
May 10 12:21:23 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata from https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/.
May 10 12:21:23 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
May 10 12:21:23 vx970 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[e5127b6a-d1e3-472c-b547-0b13a2908a74] succeeded in 0.0366941479997s: None
May 10 12:21:23 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml.
May 10 12:21:24 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Parsing metadata.
May 10 12:21:24 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata from https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/.
May 10 12:21:24 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
May 10 12:21:24 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml.
May 10 12:21:25 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Parsing metadata.
May 10 12:21:25 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata from https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/.
May 10 12:21:25 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
May 10 12:21:26 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml.
May 10 12:21:27 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Parsing metadata.
May 10 12:21:27 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata from https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/.
May 10 12:21:27 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
May 10 12:21:27 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml.
May 10 12:21:28 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Parsing metadata.
May 10 12:21:28 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata files.
May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (2): cdn.redhat.com
May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (3): cdn.redhat.com
May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (4): cdn.redhat.com
May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (5): cdn.redhat.com
May 10 12:21:28 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/d46c1308bf90b73c5123ea340514e7cfddeb3e06-comps.xml.
May 10 12:21:29 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/productid.
May 10 12:21:31 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/7879810250e308b7fb4cce9645f74b836050f071-primary.xml.gz.
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816) HTTPSConnectionPool(host='cdn.redhat.com', port=443): Read timed out.
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816) Traceback (most recent call last):
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)   File "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line 292, in _fetch
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)     for chunk in chunks:
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)   File "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line 226, in chunk_generator
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)     chunk = raw.read(chunk_size)
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)   File "/usr/lib/python2.7/site-packages/urllib3/response.py", line 227, in read
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)     raise ReadTimeoutError(self._pool, None, 'Read timed out.')
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816) ReadTimeoutError: HTTPSConnectionPool(host='cdn.redhat.com', port=443): Read timed out.
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760) HTTPSConnectionPool(host='cdn.redhat.com', port=443): Read timed out.
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760) Traceback (most recent call last):
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)   File "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line 292, in _fetch
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)     for chunk in chunks:
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)   File "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line 226, in chunk_generator
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)     chunk = raw.read(chunk_size)
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)   File "/usr/lib/python2.7/site-packages/urllib3/response.py", line 227, in read
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)     raise ReadTimeoutError(self._pool, None, 'Read timed out.')
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760) ReadTimeoutError: HTTPSConnectionPool(host='cdn.redhat.com', port=443): Read timed out.
May 10 12:23:54 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/55ce83e2be7f88021ddd30e159afa13d33a9eb811833f24ae23fe891133dc297-updateinfo.xml.gz.
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320) HTTPSConnectionPool(host='cdn.redhat.com', port=443): Read timed out.
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320) Traceback (most recent call last):
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 262, in run
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)     metadata_files = self.get_metadata(metadata_files)
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 449, in get_metadata
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)     metadata_files.download_metadata_files()
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/repomd/metadata.py", line 217, in download_metadata_files
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)     raise IOError(error_report.error_msg)
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320) IOError: HTTPSConnectionPool(host='cdn.redhat.com', port=443): Read timed out.
May 10 12:23:54 vx970 pulp: pulp.server.async.tasks:INFO: [09dada05] Task failed : [09dada05-795b-4882-b5c5-76e19d269bff]
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320) Task pulp.server.managers.repo.sync.sync[09dada05-795b-4882-b5c5-76e19d269bff] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320) Traceback (most recent call last):
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     R = retval = fun(*args, **kwargs)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     return super(Task, self).__call__(*args, **kwargs)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     return super(PulpTask, self).__call__(*args, **kwargs)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 438, in __protected_call__
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     return self.run(*args, **kwargs)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 827, in sync
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     raise pulp_exceptions.PulpExecutionException(_('Importer indicated a failed response'))
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320) PulpExecutionException: Importer indicated a failed response
May 10 12:23:54 vx970 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[0099037d-4f12-4dbd-9ae5-6580ab0556f5] succeeded in 0.0047866509999s: None

Regards,

Thiago Campos
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20180510/e1d95ab5/attachment.htm>

More information about the Pulp-list mailing list