[Pulp-list] re-publishing repos?

Andreas Piesk a.piesk at gmx.net
Wed Oct 29 15:58:02 UTC 2014


Hello list,

i tried to republish rpm repos with a different relative-url using 
commands like this

$ pulp-admin rpm repo update --repo-id centos7-x86_64-fasttrack 
--relative-url /centos7-x86_64-fasttrack

Some things didn*t work like expected:

1. for some repositories the publishing failed without a meaningfil 
error message:

Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
Exception caught from plugin during publish for repo [centos6-x86_64-os]
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
Traceback (most recent call last):
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
  File 
"/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", 
line 126, in _do_publish
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
    publish_report = publish_repo(transfer_repo, conduit, call_config)
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
  File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", 
line 458, in wrap_f
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
    return f(*args, **kwargs)
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
  File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", 
line 143, in publish_repo
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
    return self._publisher.publish()
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
  File 
"/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", 
line 323, in publish
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
    self.process_lifecycle()
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
  File 
"/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", 
line 92, in process_lifecycle
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
    step.process()
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
  File 
"/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", 
line 150, in process
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
    self._process_block()
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
  File 
"/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", 
line 185, in _process_block
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
    self.process_main()
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
  File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", 
line 834, in process_main
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
    raise PulpCodedException(message=result_string)
Oct 29 16:27:41 pulp-64 pulp: pulp.server.managers.repo.publish:ERROR: 
PulpCodedException: A general pulp exception occurred
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR: Task 
pulp.server.managers.repo.publish.publish[75604e95-5874-49fc-94ce-ff6babb89a23] 
raised unexpected: PulpCodedException()
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR: Traceback (most 
recent call last):
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in 
trace_task
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:     R = retval = 
fun(*args, **kwargs)
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 306, 
in __call__
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:     return 
super(Task, self).__call__(*args, **kwargs)
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in 
__protected_call__
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:     return 
self.run(*args, **kwargs)
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", 
line 98, in publish
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR: 
transfer_repo, conduit, call_config)
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/server/managers/repo/publish.py", 
line 126, in _do_publish
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR: 
publish_report = publish_repo(transfer_repo, conduit, call_config)
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 458, 
in wrap_f
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:     return 
f(*args, **kwargs)
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", 
line 143, in publish_repo
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:     return 
self._publisher.publish()
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", 
line 323, in publish
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR: 
self.process_lifecycle()
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", 
line 92, in process_lifecycle
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:     step.process()
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", 
line 150, in process
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR: 
self._process_block()
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", 
line 185, in _process_block
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR: 
self.process_main()
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:   File 
"/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", 
line 834, in process_main
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR:     raise 
PulpCodedException(message=result_string)
Oct 29 16:27:41 pulp-64 pulp: celery.worker.job:ERROR: 
PulpCodedException: A general pulp exception occurred

All other log files in /var/log/pulp/* and /var/log/httpd/* weren't 
helpful in finding the cause.


2. dangling symlinks

Although the publishing created a correct symlink

# ls -l /var/lib/pulp/published/yum/http/repos/centos7-x86_64-fasttrack
lrwxrwxrwx 1 apache apache 89 Oct 29 16:38 
/var/lib/pulp/published/yum/http/repos/centos7-x86_64-fasttrack -> 
/var/lib/pulp/published/yum/master/yum_distributor/centos7-x86_64-fasttrack/1414597116.98

it left the old one

lrwxrwxrwx 1 apache apache 89 Oct 29 13:20 
/var/lib/pulp/published/yum/http/repos/centos/7/fasttrack/x86_64 -> 
/var/lib/pulp/published/yum/master/yum_distributor/centos7-x86_64-fasttrack/1414585217.71

which is dangling

# ls 
/var/lib/pulp/published/yum/master/yum_distributor/centos7-x86_64-fasttrack/1414585217.71
ls: cannot access 
/var/lib/pulp/published/yum/master/yum_distributor/centos7-x86_64-fasttrack/1414585217.71: 
No such file or directory


Are these known issues or did i something stupid? I will file bug 
reports for the 2 issues.

Regards,
-ap




More information about the Pulp-list mailing list