[Pulp-list] publish of uploaded rpms failing

Tue Dec 16 20:48:15 UTC 2014

I’ve created new repos to hold the packages we’re compiling locally for RHEL5, 6, & 7. I’ve gotten the packages uploaded to all 3 repos but both the RHEL5 an RHEL6 ones are failing to publish cleanly. Unfortunately, even with debug logging enabled it’s not clear which package the failure is occurring on. The error is being raised by the python2.6 gzip library.

Has anyone seen this before?

Additionally, how I do I remove the packages that have been uploaded to a repo but not published? The documentation around the use of the upload functionality is virtually nonexistent.

# pulp-admin rpm repo publish run --repo-id=capella6
+----------------------------------------------------------------------+
                    Publishing Repository [capella6]
+----------------------------------------------------------------------+

This command may be exited via ctrl+c without affecting the request.

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[=====                                             ] 11%
16 of 144 items
... failed
Incorrect length of data produced

Task Failed

Incorrect length of data produced

Trace from syslog:
Dec 16 14:41:05 dvpuap02 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._reserve_resource[94c42210-7e9b-4d32-af27-33860c776901]
Dec 16 14:41:05 dvpuap02 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._reserve_resource[94c42210-7e9b-4d32-af27-33860c776901] succeeded in 0.0375475
189999s: u'reserved_resource_worker-0 at dvpuap02.capella.edu.dq'
Dec 16 14:41:05 dvpuap02 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[44e1eec9-6479-4a13-bb22-a67fa441b7be]
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: Exception caught from plugin during publish for repo [capella6]
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: Traceback (most recent call last):
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", line 126,
in _do_publish
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     publish_report = publish_repo(transfer_repo, conduit, call_config)
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 470, in wrap_f
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     return f(*args, **kwargs)
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py"
, line 143, in publish_repo
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     return self._publisher.publish()
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 507, in
publish
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     return self.process_lifecycle()
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 456, in
process_lifecycle
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     super(PluginStep, self).process_lifecycle()
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 121, in
process_lifecycle
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     step.process()
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 185, in
process
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     self.finalize()
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 414, in finalize
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     self.other_context.checksum)
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/metadata/repomd.py", line 113, in add_metadata_file_metadata
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     content = file_handle.read()
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib64/python2.6/gzip.py", line 212, in read
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     self._read(readsize)
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib64/python2.6/gzip.py", line 284, in _read
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     self._read_eof()
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:   File "/usr/lib64/python2.6/gzip.py", line 306, in _read_eof
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR:     raise IOError, "Incorrect length of data produced"
Dec 16 14:41:06 dvpuap02 pulp: pulp.server.managers.repo.publish:ERROR: IOError: Incorrect length of data produced
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR: Task pulp.server.managers.repo.publish.publish[44e1eec9-6479-4a13-bb22-a67fa441b7be] raised unexpected: IOError('Incorrect length of data produced',)
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR: Traceback (most recent call last):
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     R = retval = fun(*args, **kwargs)
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 315, in __call__
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     return super(Task, self).__call__(*args, **kwargs)
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in __protected_call__
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     return self.run(*args, **kwargs)
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", line 98, in publish
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     transfer_repo, conduit, call_config)
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", line 126, in _do_publish
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     publish_report = publish_repo(transfer_repo, conduit, call_config)
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 470, in wrap_f
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     return f(*args, **kwargs)
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 143, in publish_repo
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     return self._publisher.publish()
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 507, in publish
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     return self.process_lifecycle()
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 456, in process_lifecycle
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     super(PluginStep, self).process_lifecycle()
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 121, in process_lifecycle
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     step.process()
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 185, in process
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     self.finalize()
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 414, in finalize
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     self.other_context.checksum)
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/metadata/repomd.py", line 113, in add_metadata_file_metadata
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     content = file_handle.read()
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib64/python2.6/gzip.py", line 212, in read
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     self._read(readsize)
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib64/python2.6/gzip.py", line 284, in _read
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     self._read_eof()
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:   File "/usr/lib64/python2.6/gzip.py", line 306, in _read_eof
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR:     raise IOError, "Incorrect length of data produced"
Dec 16 14:41:06 dvpuap02 pulp: celery.worker.job:ERROR: IOError: Incorrect length of data produced