[Pulp-list] pulp child - master sync not working

Thu Oct 13 16:11:36 UTC 2016

Today I merged a fix for the incorrect nodes quickstart docs. You'll see this in the GA docs for 2.10.1+.

In the meantime, you can see the updated quickstart in the nightly docs for 2.10 here [0].

Thanks for identifying the importance of that bug. We want the docs to be right so we don't waste the time of users.

[0]: http://docs.pulpproject.org/en/2.10/nightly/user-guide/nodes.html#quick-start

-Brian

----- Original Message -----
> From: "Michael Hrivnak" <mhrivnak at redhat.com>
> To: "Christina Plummer" <cplummer at gmail.com>
> Cc: "pulp-list" <pulp-list at redhat.com>
> Sent: Friday, October 7, 2016 5:17:42 PM
> Subject: Re: [Pulp-list] pulp child - master sync not working
> 
> Christina, thanks for reporting back with the solution. Brian opened a PR
> today to update those docs. If you have a moment to look over those changes
> and make sure they match the experience you had, that would be greatly
> appreciated.
> 
> https://github.com/pulp/pulp/pull/2780
> 
> Thanks!
> Michael
> 
> On Fri, Oct 7, 2016 at 10:23 AM, Brian Bouterse < bbouters at redhat.com >
> wrote:
> 
> 
> Thank you so much for posting the info for others.
> 
> Regarding the future of nodes, the current plan is to deprecate nodes with
> Pulp 2.11 and remove it entirely from Pulp 3. The recommendation to users is
> to replace their nodes usage with a "natural sync" where one pulp server
> sync's content from a feed URL published by another pulp server.
> 
> This should improve the setup and usage experience for pulp users who need to
> move content between pulp servers. It should also reduce issues from bugs
> because the natural sync codepaths receive large amounts of testing. Any
> feedback on using natural sync as a nodes replacement would be great.
> 
> -Brian
> 
> 
> On 10/06/2016 06:03 PM, Christina Plummer wrote:
> 
> 
> I finally discovered the issue - the documentation
> https://docs.pulpproject.org/user-guide/nodes.html
> < https://docs.pulpproject.org/user-guide/nodes.html?highlight=nodes#child >
> was
> missing a critical step. It is necessary to configure the [oauth]
> section of server.conf on BOTH the parent and the child nodes, not just
> on the parent as indicated.
> 
> There was a previous bugs opened related to this (where I ultimately
> found my answer), but apparently the devs decided that they don't want
> people using this functionality anymore so they are leaving the
> documentation broken:
> https://pulp.plan.io/issues/1392
> 
> Posting here in case others run into the same problem.
> 
> On Thu, Sep 15, 2016 at 7:36 PM, Christina Plummer < cplummer at gmail.com
> <mailto: cplummer at gmail.com >> wrote:
> 
> I am having the same problem with pulp-2.9.2, syncing from a RHEL7
> parent to a RHEL6 child.
> 
> I see that several folks have reached out to the list over the years
> (and I saw several instances on pastebin), but I didn't see any good
> answers.
> 
> This is what I have in /var/log/messages on the child:
> 
> Sep 15 23:32:08 my-child goferd: [INFO][pulp.agent.child-01]
> gofer.messaging.adapter.connect:28 - connecting:
> qpid+amqp://my-parent:5672
> Sep 15 23:32:08 my-child goferd: [INFO][pulp.agent.child-01]
> gofer.messaging.adapter.connect:30 - connected:
> qpid+amqp://my-parent:5672
> Sep 15 23:32:08 my-child goferd: [INFO][worker-0]
> gofer.messaging.adapter.connect:28 - connecting:
> qpid+amqp://my-parent:5672
> Sep 15 23:32:08 my-child goferd: [INFO][worker-0]
> gofer.messaging.adapter.qpid.connection:106 - open: URL:
> amqp://my-parent|SSL: ca: None|key: None|certificate:
> /etc/pki/pulp/consumer/consumer-cert.pem|host-validation: None
> Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
> gofer.messaging.adapter.qpid.connection:118 - opened:
> qpid+amqp://my-parent:5672
> Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
> gofer.messaging.adapter.connect:30 - connected:
> qpid+amqp://my-parent:5672
> Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
> gofer.rmi.dispatcher:603 - call: Content.update()
> sn=8c5dae0f-988e-41bc-bcbd-c63fbcef1331 data={'task_id':
> 'c23271f5-c6c1-45e7-af99-cd61fc208192', 'consumer_id': 'child-01'}
> Sep 15 23:32:09 my-child pulp:
> pulp.server.webservices.middleware.exception:INFO: Authentication
> with username None failed: invalid SSL certificate.
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - synchronization failed
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - Traceback (most recent call last):
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - File
> "/usr/lib/python2.6/site-packages/pulp_node/handlers/strategies.py",
> line 99, in synchronize
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 -
> validator.validate(request.bindings)
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - File
> "/usr/lib/python2.6/site-packages/pulp_node/handlers/validation.py",
> line 38, in validate
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 -
> self.report.errors.extend(self._validate_plugins(bindings))
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - File
> "/usr/lib/python2.6/site-packages/pulp_node/handlers/validation.py",
> line 54, in _validate_plugins
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - child = ChildServer()
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - File
> "/usr/lib/python2.6/site-packages/pulp_node/handlers/validation.py",
> line 72, in __init__
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - self.importers =
> self._importers()
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - File
> "/usr/lib/python2.6/site-packages/pulp_node/handlers/validation.py",
> line 83, in _importers
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - http =
> bindings.server_info.get_importers()
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - File
> "/usr/lib/python2.6/site-packages/pulp/bindings/server_info.py",
> line 31, in get_importers
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - return self.server.GET(path)
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - File
> "/usr/lib/python2.6/site-packages/pulp/bindings/server.py", line 92,
> in GET
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - return self._request('GET',
> path, queries, ignore_prefix=ignore_prefix)
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - File
> "/usr/lib/python2.6/site-packages/pulp/bindings/server.py", line
> 166, in _request
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 -
> self._handle_exceptions(response_code, response_body)
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - File
> "/usr/lib/python2.6/site-packages/pulp/bindings/server.py", line
> 207, in _handle_exceptions
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - raise
> code_class_mappings[response_code](response_body)
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.strategies:112 - PermissionsException:
> RequestException: GET request on /pulp/api/v2/plugins/importers/
> failed with 401 - Authentication with username None failed: invalid
> SSL certificate.
> Sep 15 23:32:09 my-child goferd: [ERROR][worker-0]
> pulp_node.handlers.handler:92 - An unexpected error occurred.
> repo_id=None
> Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
> gofer.agent.rmi:193 - Request: 8c5dae0f-988e-41bc-bcbd-c63fbcef1331,
> committed
> Sep 15 23:32:09 my-child goferd: [INFO][worker-0]
> gofer.agent.rmi:147 - Request: 8c5dae0f-988e-41bc-bcbd-c63fbcef1331
> processed in: 1.019 (seconds)
> Sep 15 23:32:10 my-child goferd: [INFO][worker-0]
> gofer.messaging.adapter.qpid.connection:136 - closed:
> qpid+amqp://my-parent:5672
> 
> 
> On Tue, Jun 21, 2016 at 3:47 PM, Jo De Troy < jo.de.troy at gmail.com
> <mailto: jo.de.troy at gmail.com >> wrote:
> 
> Hello,
> 
> I've setup 2 pulp servers on CentOS 7.2 each of them is running
> Pulp 2.8.3.
> On the master I've synced some rpm repositories. When I try to
> sync these to the child pulp server I keep getting the same error.
> 
> Error occurred during synchronization, check the child node logs
> for details
> 
> +----------------------------------------------------------------------+
> Child Node Synchronization
> +----------------------------------------------------------------------+
> 
> Repository:
> Action: Pending
> Content Sources:
> Downloads:
> Id: updates-repo
> Units:
> Added: 0
> Removed: 0
> Updated: 0
> 
> 
> +----------------------------------------------------------------------+
> The following [1] errors were reported
> +----------------------------------------------------------------------+
> 
> - 01: An unexpected error occurred. repo_id=None
> 
> I've found the same error via Google multiple times, but I
> didn't find a working solution. I've set verify_ssl = False in
> several config files
> 
> In the /var/log/messages I get
> pulp: pulp.server.agent.direct.services:INFO: (9547-83232)
> {'reboot': {'scheduled': False, 'details': {}}, 'details':
> {'node': {'details': {'errors': [{'error_id': 'exception',
> 'details': {'message': 'RequestException: GET request on
> /pulp/api/v2/plugins/importers/ failed with 401 - Authentication
> with username None failed: invalid SSL certificate.', 'repo_id':
> None}}], ...
> 
> Any idea what could be wrong? I've put the logging level to
> debug, hoping to find the reason
> 
> Best Regards,
> Jo
> 
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com <mailto: Pulp-list at redhat.com >
> https://www.redhat.com/mailman/listinfo/pulp-list
> < https://www.redhat.com/mailman/listinfo/pulp-list >
> 
> 
> 
> 
> 
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
> 
> 
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
> 
> 
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list