[Pulp-list] pulp child - master sync not working

Brian Bouterse bbouters at redhat.com
Fri Oct 7 14:23:38 UTC 2016


Thank you so much for posting the info for others.

Regarding the future of nodes, the current plan is to deprecate nodes 
with Pulp 2.11 and remove it entirely from Pulp 3. The recommendation to 
users is to replace their nodes usage with a "natural sync" where one 
pulp server sync's content from a feed URL published by another pulp server.

This should improve the setup and usage experience for pulp users who 
need to move content between pulp servers. It should also reduce issues 
from bugs because the natural sync codepaths receive large amounts of 
testing. Any feedback on using natural sync as a nodes replacement would 
be great.

-Brian


On 10/06/2016 06:03 PM, Christina Plummer wrote:
> I finally discovered the issue - the documentation
> https://docs.pulpproject.org/user-guide/nodes.html
> <https://docs.pulpproject.org/user-guide/nodes.html?highlight=nodes#child> was
> missing a critical step.  It is necessary to configure the [oauth]
> section of server.conf on BOTH the parent and the child nodes, not just
> on the parent as indicated.
>
> There was a previous bugs opened related to this (where I ultimately
> found my answer), but apparently the devs decided that they don't want
> people using this functionality anymore so they are leaving the
> documentation broken:
> https://pulp.plan.io/issues/1392
>
> Posting here in case others run into the same problem.
>
> On Thu, Sep 15, 2016 at 7:36 PM, Christina Plummer <cplummer at gmail.com
> <mailto:cplummer at gmail.com>> wrote:
>
>     I am having the same problem with pulp-2.9.2, syncing from a RHEL7
>     parent to a RHEL6 child.
>
>     I see that several folks have reached out to the list over the years
>     (and I saw several instances on pastebin), but I didn't see any good
>     answers.
>
>     This is what I have in /var/log/messages on the child:
>
>     Sep 15 23:32:08 my-child goferd: [INFO][pulp.agent.child-01]
>     gofer.messaging.adapter.connect:28 - connecting:
>     qpid+amqp://my-parent:5672
>     Sep 15 23:32:08 my-child goferd: [INFO][pulp.agent.child-01]
>     gofer.messaging.adapter.connect:30 - connected:
>     qpid+amqp://my-parent:5672
>     Sep 15 23:32:08 my-child goferd: [INFO][worker-0]
>     gofer.messaging.adapter.connect:28 - connecting:
>     qpid+amqp://my-parent:5672
>     Sep 15 23:32:08 my-child goferd: [INFO][worker-0]
>     gofer.messaging.adapter.qpid.connection:106 - open: URL:
>     amqp://my-parent|SSL: ca: None|key: None|certificate:
>     /etc/pki/pulp/consumer/consumer-cert.pem|host-validation: None
>     Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
>     gofer.messaging.adapter.qpid.connection:118 - opened:
>     qpid+amqp://my-parent:5672
>     Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
>     gofer.messaging.adapter.connect:30 - connected:
>     qpid+amqp://my-parent:5672
>     Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
>     gofer.rmi.dispatcher:603 - call: Content.update()
>     sn=8c5dae0f-988e-41bc-bcbd-c63fbcef1331 data={'task_id':
>     'c23271f5-c6c1-45e7-af99-cd61fc208192', 'consumer_id': 'child-01'}
>     Sep 15 23:32:09 my-child pulp:
>     pulp.server.webservices.middleware.exception:INFO: Authentication
>     with username None failed: invalid SSL certificate.
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 - synchronization failed
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 - Traceback (most recent call last):
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -   File
>     "/usr/lib/python2.6/site-packages/pulp_node/handlers/strategies.py",
>     line 99, in synchronize
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -
>     validator.validate(request.bindings)
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -   File
>     "/usr/lib/python2.6/site-packages/pulp_node/handlers/validation.py",
>     line 38, in validate
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -
>     self.report.errors.extend(self._validate_plugins(bindings))
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -   File
>     "/usr/lib/python2.6/site-packages/pulp_node/handlers/validation.py",
>     line 54, in _validate_plugins
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -     child = ChildServer()
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -   File
>     "/usr/lib/python2.6/site-packages/pulp_node/handlers/validation.py",
>     line 72, in __init__
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -     self.importers =
>     self._importers()
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -   File
>     "/usr/lib/python2.6/site-packages/pulp_node/handlers/validation.py",
>     line 83, in _importers
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -     http =
>     bindings.server_info.get_importers()
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -   File
>     "/usr/lib/python2.6/site-packages/pulp/bindings/server_info.py",
>     line 31, in get_importers
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -     return self.server.GET(path)
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -   File
>     "/usr/lib/python2.6/site-packages/pulp/bindings/server.py", line 92,
>     in GET
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -     return self._request('GET',
>     path, queries, ignore_prefix=ignore_prefix)
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -   File
>     "/usr/lib/python2.6/site-packages/pulp/bindings/server.py", line
>     166, in _request
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -
>     self._handle_exceptions(response_code, response_body)
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -   File
>     "/usr/lib/python2.6/site-packages/pulp/bindings/server.py", line
>     207, in _handle_exceptions
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 -     raise
>     code_class_mappings[response_code](response_body)
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.strategies:112 - PermissionsException:
>     RequestException: GET request on /pulp/api/v2/plugins/importers/
>     failed with 401 - Authentication with username None failed: invalid
>     SSL certificate.
>     Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
>     pulp_node.handlers.handler:92 - An unexpected error occurred.
>     repo_id=None
>     Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
>     gofer.agent.rmi:193 - Request: 8c5dae0f-988e-41bc-bcbd-c63fbcef1331,
>     committed
>     Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
>     gofer.agent.rmi:147 - Request: 8c5dae0f-988e-41bc-bcbd-c63fbcef1331
>     processed in: 1.019 (seconds)
>     Sep 15 23:32:10 my-child goferd: [INFO][worker-0]
>     gofer.messaging.adapter.qpid.connection:136 - closed:
>     qpid+amqp://my-parent:5672
>
>
>     On Tue, Jun 21, 2016 at 3:47 PM, Jo De Troy <jo.de.troy at gmail.com
>     <mailto:jo.de.troy at gmail.com>> wrote:
>
>         Hello,
>
>         I've setup 2 pulp servers on CentOS 7.2 each of them is running
>         Pulp 2.8.3.
>         On the master I've synced some  rpm repositories. When I try to
>         sync  these to the child pulp server I keep getting the same error.
>
>         Error occurred during synchronization, check the child node logs
>         for details
>
>         +----------------------------------------------------------------------+
>                                Child Node Synchronization
>         +----------------------------------------------------------------------+
>
>         Repository:
>           Action:          Pending
>           Content Sources:
>             Downloads:
>           Id:              updates-repo
>           Units:
>             Added:   0
>             Removed: 0
>             Updated: 0
>
>
>         +----------------------------------------------------------------------+
>                          The following [1] errors were reported
>         +----------------------------------------------------------------------+
>
>         - 01: An unexpected error occurred.  repo_id=None
>
>         I've found the same error via Google multiple times, but I
>         didn't find a working solution. I've set verify_ssl = False in
>         several config files
>
>         In the /var/log/messages I get
>         pulp: pulp.server.agent.direct.services:INFO: (9547-83232)
>         {'reboot': {'scheduled': False, 'details': {}}, 'details':
>         {'node': {'details': {'errors': [{'error_id': 'exception',
>         'details': {'message': 'RequestException: GET request on
>         /pulp/api/v2/plugins/importers/ failed with 401 - Authentication
>         with username None failed: invalid SSL certificate.', 'repo_id':
>         None}}], ...
>
>         Any idea what could be wrong? I've put the logging level to
>         debug, hoping to find the reason
>
>         Best Regards,
>         Jo
>
>         _______________________________________________
>         Pulp-list mailing list
>         Pulp-list at redhat.com <mailto:Pulp-list at redhat.com>
>         https://www.redhat.com/mailman/listinfo/pulp-list
>         <https://www.redhat.com/mailman/listinfo/pulp-list>
>
>
>
>
>
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
>




More information about the Pulp-list mailing list