[Pulp-list] Errors syncing EPEL 6 with Pulp 2.4.3

Wed Oct 29 18:08:02 UTC 2014

Hi,

I have different stages of local development branches of repositories, 
including EPEL 6. Base system is CentOS 6.5.

First stage gets repository contents from remote mirror and following 
stages get their contents from each other, those stages are chained 
together and working fine since Pulp 2.2.

Strange thing is that I get error when trying to sync from first stage 
to second stage locally.

+----------------------------------------------------------------------+
                  Synchronizing Repository [epel-6-int]
+----------------------------------------------------------------------+

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[|]
... completed

Downloading repository content...
[==================================================] 100%
RPMs:       0/0 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[-]
... failed

Task Failed

Importer indicated a failed response

NOTE that /var/lib/pulp/published/yum/https/repos/epel/6/x86_64/ is 
existing and contains EPEL 6 RPM-s and repodata directory with proper 
contents.

 From /var/log/messages

Oct 29 17:45:48 tstplp01 pulp: celery.worker.strategy:INFO: Received 
task: 
pulp.server.tasks.repository.sync_with_auto_publish[5d207c6a-8df5-40b4-8e2f-216bebac0646]
Oct 29 17:45:48 tstplp01 pulp: celery.worker.strategy:INFO: Received 
task: 
pulp.server.async.tasks._queue_release_resource[66da6f4e-7534-4b85-a865-b13c1e7038b2]
Oct 29 17:45:48 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: 
Downloading metadata from 
file:///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/.
Oct 29 17:45:48 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: 
Generating metadata databases.
Oct 29 17:46:29 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: 
Determining which units need to be downloaded.
Oct 29 17:47:44 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: 
Downloading 0 RPMs.
Oct 29 17:48:03 tstplp01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: 
Downloading additional units.
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: [Errno 2] 
No such file or directory: 
u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/.treeinfo'
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: Traceback 
(most recent call last):
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR:   File 
"/usr/lib/python2.6/site-packages/nectar/downloaders/local.py", line 
144, in _copy
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: 
src_handle = open(src_path, 'rb')
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: IOError: 
[Errno 2] No such file or directory: 
u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/.treeinfo'
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: [Errno 2] 
No such file or directory: 
u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/treeinfo'
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: Traceback 
(most recent call last):
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR:   File 
"/usr/lib/python2.6/site-packages/nectar/downloaders/local.py", line 
144, in _copy
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: 
src_handle = open(src_path, 'rb')
Oct 29 17:48:03 tstplp01 pulp: nectar.downloaders.local:ERROR: IOError: 
[Errno 2] No such file or directory: 
u'///var/lib/pulp/published/yum/https/repos/epel/6/x86_64/treeinfo'
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR: sync failed
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR: Traceback (most recent call 
last):
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", 
line 133, in run
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR: 
self.get_errata(metadata_files)
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", 
line 462, in get_errata
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR: 
self.save_fileless_units(errata_file_handle, updateinfo.PACKAGE_TAG, 
updateinfo.process_package_element)
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", 
line 522, in save_fileless_units
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:     to_save = 
existing.check_repo(wanted, self.sync_conduit.get_units)
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", 
line 37, in check_repo
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:     sorted_units = 
_sort_by_type(wanted)
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/existing.py", 
line 162, in _sort_by_type
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:     for unit in wanted:
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py", 
line 520, in <genexpr>
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:     wanted = 
(model.as_named_tuple for model in package_info_generator)
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/packages.py", 
line 63, in package_list_generator
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:     package_info = 
process_func(element)
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/updateinfo.py", 
line 27, in process_package_element
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR:     'description': 
element.find('description').text,
Oct 29 17:48:03 tstplp01 pulp: 
pulp_rpm.plugins.importers.yum.sync:ERROR: AttributeError: 'NoneType' 
object has no attribute 'text'
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: Task 
pulp.server.tasks.repository.sync_with_auto_publish[5d207c6a-8df5-40b4-8e2f-216bebac0646] 
raised unexpected: PulpExecutionException('Importer indicated a failed 
response',)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: Traceback (most 
recent call last):
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in 
trace_task
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:     R = retval = 
fun(*args, **kwargs)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 306, 
in __call__
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:     return 
super(Task, self).__call__(*args, **kwargs)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in 
__protected_call__
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:     return 
self.run(*args, **kwargs)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/server/tasks/repository.py", line 
210, in sync_with_auto_publish
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:     sync_result 
= managers.repo_sync_manager().sync(repo_id, sync_config_override=overrides)
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", 
line 113, in sync
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR:     raise 
PulpExecutionException(_('Importer indicated a failed response'))
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:ERROR: 
PulpExecutionException: Importer indicated a failed response
Oct 29 17:48:03 tstplp01 pulp: celery.worker.strategy:INFO: Received 
task: 
pulp.server.async.tasks._release_resource[1b11a963-e339-43de-b26a-1093c465eba3]
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:INFO: Task 
pulp.server.async.tasks._queue_release_resource[66da6f4e-7534-4b85-a865-b13c1e7038b2] 
succeeded in 0.0187427470228s: None
Oct 29 17:48:03 tstplp01 pulp: celery.worker.job:INFO: Task 
pulp.server.async.tasks._release_resource[1b11a963-e339-43de-b26a-1093c465eba3] 
succeeded in 0.039365892997s: None

 From ~/.pulp/server_calls.log
2014-10-29 17:48:04,038 - INFO - GET request to 
/pulp/api/v2/tasks/5d207c6a-8df5-40b4-8e2f-216bebac0646/ with parameters 
None
2014-10-29 17:48:04,038 - INFO - Response status : 200

2014-10-29 17:48:04,039 - INFO - Response body :
  {
   "exception": null,
   "task_type": "pulp.server.tasks.repository.sync_with_auto_publish",
   "_href": "/pulp/api/v2/tasks/5d207c6a-8df5-40b4-8e2f-216bebac0646/",
   "task_id": "5d207c6a-8df5-40b4-8e2f-216bebac0646",
   "tags": [
     "pulp:repository:epel-6-int",
     "pulp:action:sync"
   ],
   "finish_time": "2014-10-29T17:48:03Z",
   "_ns": "task_status",
   "start_time": "2014-10-29T17:45:48Z",
   "traceback": "Traceback (most recent call last):\n  File 
\"/usr/lib/python2.6/site-packages/celery/app/trace.py\", line 240, in 
trace_task\n    R = retval = fun(*args, **kwargs)\n  File 
\"/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py\", line 
306, in __call__\n    return super(Task, self).__call__(*args, 
**kwargs)\n  File 
\"/usr/lib/python2.6/site-packages/celery/app/trace.py\", line 437, in 
__protected_call__\n    return self.run(*args, **kwargs)\n  File 
\"/usr/lib/python2.6/site-packages/pulp/server/tasks/repository.py\", 
line 210, in sync_with_auto_publish\n    sync_result = 
managers.repo_sync_manager().sync(repo_id, 
sync_config_override=overrides)\n  File 
\"/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py\", 
line 113, in sync\n    raise PulpExecutionException(_('Importer 
indicated a failed response'))\nPulpExecutionException: Importer 
indicated a failed response\n",
   "spawned_tasks": [],
   "progress_report": {
     "yum_importer": {
       "content": {
         "size_total": 0,
         "items_left": 0,
         "items_total": 0,
         "state": "FINISHED",
         "size_left": 0,
         "details": {
           "rpm_total": 0,
           "rpm_done": 0,
           "drpm_total": 0,
           "drpm_done": 0
         },
         "error_details": []
       },
       "comps": {
         "state": "NOT_STARTED"
       },
       "distribution": {
         "items_total": 0,
         "state": "FINISHED",
         "error_details": [],
         "items_left": 0
       },
       "errata": {
         "state": "FAILED",
         "error": "'NoneType' object has no attribute 'text'"
       },
       "metadata": {
         "state": "FINISHED"
       }
     }
   },
   "queue": "reserved_resource_worker-0 at tstplp01.foobar.com.dq",
   "state": "error",
   "result": null,
   "error": {
     "code": "PLP0000",
     "data": {},
     "description": "Importer indicated a failed response",
     "sub_errors": []
   },
   "_id": {
     "$oid": "545127ccd604ff01e4d822c2"
   },
   "id": "545127cc727e241efa7814cf"
}

Any ideas, why this is failing?