[Pulp-list] RES: Pulp failed sync repository

Thu May 10 19:27:15 UTC 2018

Kodiak, i did it on three different days.
Thiago Campos
Selic
Fone: +55 (21) 3506-8973
[ANBIMA - Associação Brasileira das Entidades dos Mercados Financeiro e de Capitais]<http://www.anbima.com.br/>

[Curta nossa página no Facebook]<https://www.facebook.com/AnbimaBR/>

[Conheça nossa página no Linkedin]<https://www.linkedin.com/company/anbima---brazilian-financial-and-capital-markets-association?trk=top_nav_home>

[Visite nosso canal no Youtube]<https://www.youtube.com/user/AnbimaBR>

[http://www.anbima.com.br/assinaturaEmail/space.png]

www.anbima.com.br<http://www.anbima.com.br/>
Cadastre–se e receba nossas publicações<http://www.anbima.com.br/publicacoes/>

INFORMAÇÃO CONFIDENCIAL:  Este email e seus anexos contém informações confidenciais e qualquer uso, divulgação, distribuição e/ou cópia não autorizado é estritamente proibido e sujeito às penalidades legais cabíveis. Se você recebeu esta mensagem indevidamente ou por engano, por favor, informe ao remetente deste fato e apague-a de seu computador.
CONFIDENTIAL INFORMATION: This e-mail message and attached files contain confidential information. Any unauthorized use, disclosure, distribution and/or copy is prohibited and subject to the applicable legal penalties. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message.

De: Kodiak Firesmith [mailto:kfiresmith at gmail.com]
Enviada em: quinta-feira, 10 de maio de 2018 16:04
Para: Thiago do Carmo Campos
Cc: pulp-list
Assunto: Re: [Pulp-list] Pulp failed sync repository

Have you retried the same sync multiple times with the same result?  Have you tried waiting a couple hours and retrying?  I ask because that kind of just looks like an intermittent CDN issue upstream from your Pulp installation.

On Thu, May 10, 2018, 12:00 Thiago do Carmo Campos <thiago.campos at selic.anbima.com.br<mailto:thiago.campos at selic.anbima.com.br>> wrote:
Hi,

I use pulp to maintain a local repository for RHEL  6 and 7 but now I am having an error with time out to download the packages. Someone can help or some glue?

Thanks for any help.

Bellow logs from pulp .
------
May 10 12:21:23 vx970 pulp: py.warnings:WARNING: (1245-21568) /usr/lib/python2.7/site-packages/pulp/server/db/model/__init__.py:552: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead.
May 10 12:21:23 vx970 pulp: py.warnings:WARNING: (1245-21568)   TaskStatus._get_collection().update({'task_id': task_id}, update, upsert=True)
May 10 12:21:23 vx970 pulp: py.warnings:WARNING: (1245-21568)
May 10 12:21:23 vx970 pulp: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
May 10 12:21:23 vx970 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[e5127b6a-d1e3-472c-b547-0b13a2908a74]
May 10 12:21:23 vx970 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.sync.sync[09dada05-795b-4882-b5c5-76e19d269bff]
May 10 12:21:23 vx970 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[0099037d-4f12-4dbd-9ae5-6580ab0556f5]
May 10 12:21:23 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata from https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/.
May 10 12:21:23 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com<http://cdn.redhat.com>
May 10 12:21:23 vx970 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[e5127b6a-d1e3-472c-b547-0b13a2908a74] succeeded in 0.0366941479997s: None
May 10 12:21:23 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml.
May 10 12:21:24 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Parsing metadata.
May 10 12:21:24 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata from https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/.
May 10 12:21:24 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com<http://cdn.redhat.com>
May 10 12:21:24 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml.
May 10 12:21:25 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Parsing metadata.
May 10 12:21:25 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata from https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/.
May 10 12:21:25 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com<http://cdn.redhat.com>
May 10 12:21:26 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml.
May 10 12:21:27 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Parsing metadata.
May 10 12:21:27 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata from https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/.
May 10 12:21:27 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com<http://cdn.redhat.com>
May 10 12:21:27 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml.
May 10 12:21:28 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Parsing metadata.
May 10 12:21:28 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [09dada05] Downloading metadata files.
May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (2): cdn.redhat.com<http://cdn.redhat.com>
May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (3): cdn.redhat.com<http://cdn.redhat.com>
May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (4): cdn.redhat.com<http://cdn.redhat.com>
May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (5): cdn.redhat.com<http://cdn.redhat.com>
May 10 12:21:28 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/d46c1308bf90b73c5123ea340514e7cfddeb3e06-comps.xml.
May 10 12:21:29 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/productid.
May 10 12:21:31 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/7879810250e308b7fb4cce9645f74b836050f071-primary.xml.gz.
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816) HTTPSConnectionPool(host='cdn.redhat.com<http://cdn.redhat.com>', port=443): Read timed out.
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816) Traceback (most recent call last):
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)   File "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line 292, in _fetch
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)     for chunk in chunks:
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)   File "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line 226, in chunk_generator
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)     chunk = raw.read(chunk_size)
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)   File "/usr/lib/python2.7/site-packages/urllib3/response.py", line 227, in read
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816)     raise ReadTimeoutError(self._pool, None, 'Read timed out.')
May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-86816) ReadTimeoutError: HTTPSConnectionPool(host='cdn.redhat.com<http://cdn.redhat.com>', port=443): Read timed out.
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760) HTTPSConnectionPool(host='cdn.redhat.com<http://cdn.redhat.com>', port=443): Read timed out.
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760) Traceback (most recent call last):
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)   File "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line 292, in _fetch
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)     for chunk in chunks:
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)   File "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line 226, in chunk_generator
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)     chunk = raw.read(chunk_size)
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)   File "/usr/lib/python2.7/site-packages/urllib3/response.py", line 227, in read
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760)     raise ReadTimeoutError(self._pool, None, 'Read timed out.')
May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR: (1647-73760) ReadTimeoutError: HTTPSConnectionPool(host='cdn.redhat.com<http://cdn.redhat.com>', port=443): Read timed out.
May 10 12:23:54 vx970 pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/55ce83e2be7f88021ddd30e159afa13d33a9eb811833f24ae23fe891133dc297-updateinfo.xml.gz.
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320) HTTPSConnectionPool(host='cdn.redhat.com<http://cdn.redhat.com>', port=443): Read timed out.
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320) Traceback (most recent call last):
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 262, in run
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)     metadata_files = self.get_metadata(metadata_files)
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 449, in get_metadata
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)     metadata_files.download_metadata_files()
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/repomd/metadata.py", line 217, in download_metadata_files
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320)     raise IOError(error_report.error_msg)
May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [09dada05] (1647-64320) IOError: HTTPSConnectionPool(host='cdn.redhat.com<http://cdn.redhat.com>', port=443): Read timed out.
May 10 12:23:54 vx970 pulp: pulp.server.async.tasks:INFO: [09dada05] Task failed : [09dada05-795b-4882-b5c5-76e19d269bff]
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320) Task pulp.server.managers.repo.sync.sync[09dada05-795b-4882-b5c5-76e19d269bff] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320) Traceback (most recent call last):
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     R = retval = fun(*args, **kwargs)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     return super(Task, self).__call__(*args, **kwargs)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     return super(PulpTask, self).__call__(*args, **kwargs)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 438, in __protected_call__
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     return self.run(*args, **kwargs)
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 827, in sync
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     raise pulp_exceptions.PulpExecutionException(_('Importer indicated a failed response'))
May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320) PulpExecutionException: Importer indicated a failed response
May 10 12:23:54 vx970 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[0099037d-4f12-4dbd-9ae5-6580ab0556f5] succeeded in 0.0047866509999s: None

Regards,

Thiago Campos
_______________________________________________
Pulp-list mailing list
Pulp-list at redhat.com<mailto:Pulp-list at redhat.com>
https://www.redhat.com/mailman/listinfo/pulp-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20180510/6d650c16/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 3739 bytes
Desc: image001.png
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20180510/6d650c16/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 1487 bytes
Desc: image002.png
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20180510/6d650c16/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 1642 bytes
Desc: image003.png
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20180510/6d650c16/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 1648 bytes
Desc: image004.png
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20180510/6d650c16/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 980 bytes
Desc: image005.png
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20180510/6d650c16/attachment-0004.png>