[Pulp-list] Problem with relative URLs

Tuma, Petr (GE Capital) petr.tuma at ge.com
Tue Jun 9 08:35:57 UTC 2015


Hello,

we are using Pulp (2.6.1) to mirror sub set of RedHat repositories and my setup is to have URL paths as close to CDN as possible. Everything worked so far, I've been able to mirror base, supplementary and oracle-java without any problem with relative-urls. Now I have to add few more repos we'd like to mirror, but I'm getting realtive_url error. This problem seems to show up on any repository I created right after I installed and configured Pulp, I can add new repositories under same forlder as long as I don't use any already existing folder. For example: I can use realtive url /extra/6Server/x86_64/rhevh/os and /extra/6Server/x86_64/rhn-tools/os with no problem at all, but if I use /rhel/6Server/x86_64/rhevh/os it fails.

Commands I use:
pulp-admin rpm repo create --repo-id rhel6_64-rhn-tools --feed https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/rhn-tools/os --remove-missing true --relative-url /rhel/6Server/x86_64/rhn-tools/os --serve-http false --serve-https true --verify-feed-ssl false --feed-cert /rhndata/entitlements/rhel6_64.pem --feed-key /rhndata/entitlements/rhel6_64-key.pem

An internal error occurred on the Pulp server:
RequestException: POST request
on /pulp/api/v2/repositories/ failed with 500 - 'relative_url'

Folder listing of given path shows no conflict at all:
ls -l pulp/published/yum/https/repos/rhel/6Server/x86_64/
total 28
drwxr-x--- 3 apache apache 4096 Jun  8 08:01 jbeap
-rw-r--r-- 1 apache apache   49 Jun  8 13:44 listing
drwxr-x--- 2 apache apache 4096 Jun  8 13:44 optional
drwxr-x--- 2 apache apache 4096 Jun  8 13:20 oracle-java
lrwxrwxrwx 1 apache apache   78 Jun  8 13:12 os -> /var/lib/pulp/published/yum/master/yum_distributor/rhel6_64-base/1433761935.73
drwxr-x--- 5 apache apache 4096 Jun  8 08:30 rhevm
drwxr-x--- 2 apache apache 4096 Jun  8 13:31 supplementary

>From /var/log/messages (Pulp is running with DEBUG logging):
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648) Exception adding distributor to repo [rhel6_64-rhn-tools]; the repo will be deleted
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648) Traceback (most recent call last):
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/cud.py", line 187, in create_and_configure_repo
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)     distributor_id)
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/distributor.py", line 170, in add_distributor
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)     result = distributor_instance.validate_config(transfer_repo, call_config, config_conduit)
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 84, in validate_config
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)     return configuration.validate_config(repo, config, config_conduit)
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/configuration.py", line 118, in validate_config
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)     _check_for_relative_path_conflicts(repo, config, config_conduit, error_messages)
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/configuration.py", line 469, in _check_for_relative_path_conflicts
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648)     conflicting_relative_url = distributor['config']['relative_url'] or conflicting_repo_id
pulp: pulp.server.managers.repo.cud:ERROR: (15478-47648) KeyError: 'relative_url'
pulp: pulp.server.webservices.middleware.exception:ERROR: Unhandled Exception
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648) 'relative_url'
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648) Traceback (most recent call last):
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/middleware/exception.py", line 44, in __call__
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return self.app(environ, start_response)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/middleware/postponed.py", line 42, in __call__
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return self.app(environ, start_response)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 279, in wsgi
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     result = self.handle_with_processors()
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 29, in _handle_with_processors
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return process(self.processors)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 26, in process
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return p(lambda: process(processors))
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 566, in processor
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return handler()
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 26, in <lambda>
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return p(lambda: process(processors))
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 26, in process
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return p(lambda: process(processors))
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 581, in processor
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     result = handler()
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 26, in <lambda>
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return p(lambda: process(processors))
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 28, in process
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return self.handle()
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 230, in handle
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return self._delegate(fn, self.fvars, args)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 422, in _delegate
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return f()
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 430, in <lambda>
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     f = lambda: self._delegate_sub_application(pat, what)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 455, in _delegate_sub_application
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return app.handle_with_processors()
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 29, in _handle_with_processors
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return process(self.processors)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 26, in process
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return p(lambda: process(processors))
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 566, in processor
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return handler()
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 26, in <lambda>
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return p(lambda: process(processors))
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 26, in process
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return p(lambda: process(processors))
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 581, in processor
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     result = handler()
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 26, in <lambda>
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return p(lambda: process(processors))
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/application.py", line 28, in process
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return self.handle()
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 230, in handle
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return self._delegate(fn, self.fvars, args)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 420, in _delegate
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return handle_class(cls)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/web/application.py", line 396, in handle_class
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return tocall(*args)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/controllers/decorators.py", line 203, in _auth_decorator
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     value = method(self, *args, **kwargs)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/webservices/controllers/repositories.py", line 180, in POST
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     repo = repo_manager.create_and_configure_repo(*args, **kwargs)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/cud.py", line 187, in create_and_configure_repo
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     distributor_id)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/distributor.py", line 170, in add_distributor
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     result = distributor_instance.validate_config(transfer_repo, call_config, config_conduit)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 84, in validate_config
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     return configuration.validate_config(repo, config, config_conduit)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/configuration.py", line 118, in validate_config
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     _check_for_relative_path_conflicts(repo, config, config_conduit, error_messages)
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/configuration.py", line 469, in _check_for_relative_path_conflicts
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648)     conflicting_relative_url = distributor['config']['relative_url'] or conflicting_repo_id
pulp: pulp.server.webservices.middleware.exception:ERROR: (15478-47648) KeyError: 'relative_url'

Is there any way how to fix this? I would like to have all RHEL repositories in one folder.

Best regards,
Petr Tuma

Notice: This electronic mail transmission, including any attachments, is confidential. It is intended only for the person(s) named, and it may contain information, which is proprietary, personal data or trade secrets, which are protected under the existing law. If you received this transmission in error, please notify the sender immediately at the above mentioned e-mail address or telephone number and delete this e-mail from your computer. Thank you.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20150609/895724d1/attachment.htm>


More information about the Pulp-list mailing list