[Pulp-list] error: operation failed: PulpException: Timeout occurred attempting to initialize CDS

[Andreas Piesk]

Hello,

registering a CDS fails with (hostnames redacted):

[Mon Feb 18 14:22:10 2013] [error] 2013-02-18 14:22:10,983
pulp.server.webservices.controllers.decorators:ERROR: Traceback (most recent call last):
[Mon Feb 18 14:22:10 2013] [error]   File
"/usr/lib/python2.6/site-packages/pulp/server/webservices/controllers/decorators.py", line 48, in
report_error
[Mon Feb 18 14:22:10 2013] [error]     return method(self, *args, **kwargs)
[Mon Feb 18 14:22:10 2013] [error]   File
"/usr/lib/python2.6/site-packages/pulp/server/webservices/controllers/decorators.py", line 127, in
_auth_decorator
[Mon Feb 18 14:22:10 2013] [error]     value = method(self, *args, **kwargs)
[Mon Feb 18 14:22:10 2013] [error]   File
"/usr/lib/python2.6/site-packages/pulp/server/webservices/controllers/cds.py", line 76, in POST
[Mon Feb 18 14:22:10 2013] [error]     cds = cds_api.register(hostname, name, description,
sync_schedule=sync_schedule, cluster_id=cluster_id)
[Mon Feb 18 14:22:10 2013] [error]   File
"/usr/lib/python2.6/site-packages/pulp/server/auditing.py", line 200, in _audit
[Mon Feb 18 14:22:10 2013] [error]     result = method(*args, **kwargs)
[Mon Feb 18 14:22:10 2013] [error]   File "/usr/lib/python2.6/site-packages/pulp/server/api/cds.py",
line 120, in register
[Mon Feb 18 14:22:10 2013] [error]     secret = self.dispatcher.init_cds(cds)
[Mon Feb 18 14:22:10 2013] [error]   File
"/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 92, in init_cds
[Mon Feb 18 14:22:10 2013] [error]     secret = self._send(self._cds_stub(cds).initialize)
[Mon Feb 18 14:22:10 2013] [error]   File
"/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 169, in _send
[Mon Feb 18 14:22:10 2013] [error]     result = func(*args)
[Mon Feb 18 14:22:10 2013] [error]   File "/usr/lib/python2.6/site-packages/gofer/rmi/stub.py", line
72, in __call__
[Mon Feb 18 14:22:10 2013] [error]     return self.stub._send(request, opts)
[Mon Feb 18 14:22:10 2013] [error]   File "/usr/lib/python2.6/site-packages/gofer/rmi/stub.py", line
133, in _send
[Mon Feb 18 14:22:10 2013] [error]     return self.__send(request, options)
[Mon Feb 18 14:22:10 2013] [error]   File "/usr/lib/python2.6/site-packages/gofer/rmi/stub.py", line
164, in __send
[Mon Feb 18 14:22:10 2013] [error]     any=opts.any)
[Mon Feb 18 14:22:10 2013] [error]   File "/usr/lib/python2.6/site-packages/gofer/rmi/policy.py",
line 155, in send
[Mon Feb 18 14:22:10 2013] [error]     self.__getstarted(sn, reader)
[Mon Feb 18 14:22:10 2013] [error]   File "/usr/lib/python2.6/site-packages/gofer/rmi/policy.py",
line 178, in __getstarted
[Mon Feb 18 14:22:10 2013] [error]     raise RequestTimeout(sn, 0)
[Mon Feb 18 14:22:10 2013] [error] PulpException: Timeout occurred attempting to initialize CDS
[hostname.domain.tld]

Version is 1.1.15, i get the same with 1.1.14. some tim eago i set up a similar system using the
same version with no problems. i compared the setups and found no difference. The logging is not
very helpful, even on DEBUG, so i'm stuck.

The agent on CDS works, i get a heartbeat and everything, so the consumer part works.

on pulp server i see the requests (IP redacted):

1.2.3.4 - - [18/Feb/2013:14:22:00 +0100] "POST /pulp/api//cds/ HTTP/1.1" 500 1812

returning HTTP 500. but i don't see any traffic to CDS port 443. How is the registration supposed to
work, what are the different steps in the communication between PULP server and cds during registration?
i appreciate any hints.

regards,
-ap