[Spacewalk-list] random rhnreg_ks failures with 500 errors

[Tom Brown]

Hi

We are on 1.0 and are seeing the following happen sometimes, i say
sometimes as we seem to have a spate of it then nothing for a few
hours. When a client tries to register it may get a failure with a 500
error -

The up2date log on the client states this

[Tue Jun  8 10:34:11 2010] up2date A protocol error occurred: Internal
Server Error , attempt #1,
[Tue Jun  8 10:34:11 2010] up2date Error communicating with server.
The message was:
Internal Server Error
[Tue Jun  8 10:34:11 2010] up2date
Traceback (most recent call last):
  File "/usr/sbin/rhnreg_ks", line 205, in ?
    cli.run()
  File "/usr/share/rhn/up2date_client/rhncli.py", line 74, in run
    sys.exit(self.main() or 0)
  File "/usr/sbin/rhnreg_ks", line 88, in main
    rhnreg.getCaps()
  File "/usr/share/rhn/up2date_client/rhnreg.py", line 234, in getCaps
    s.capabilities.validate()
  File "/usr/share/rhn/up2date_client/rhnserver.py", line 156, in
__get_capabilities
    self.registration.welcome_message()
  File "/usr/share/rhn/up2date_client/rhnserver.py", line 50, in __call__
    return rpcServer.doCall(method, *args, **kwargs)
  File "/usr/share/rhn/up2date_client/rpcServer.py", line 277, in doCall
    raise up2dateErrors.CommunicationError(e.errmsg)
up2date_client.up2dateErrors.CommunicationError: Error communicating
with server. The message was:
Internal Server Error


And the ssl_error log on the server says this

[Tue Jun 08 09:42:45 2010] [error] [client 10.10.11.83]
PythonCleanupHandler server.apacheServer::CleanupHandler: Traceback
(most recent call last):
[Tue Jun 08 09:42:45 2010] [error] [client 10.10.11.83]
PythonCleanupHandler server.apacheServer::CleanupHandler:   File
"/usr/lib64/python2.4/site-packages/mod_python/apache.py", line 287,
in HandlerDispatch\n    log=debug)
[Tue Jun 08 09:42:45 2010] [error] [client 10.10.11.83]
PythonCleanupHandler server.apacheServer::CleanupHandler:   File
"/usr/lib64/python2.4/site-packages/mod_python/apache.py", line 461,
in import_module\n    f, p, d = imp.find_module(parts[i], path)
[Tue Jun 08 09:42:45 2010] [error] [client 10.10.11.83]
PythonCleanupHandler server.apacheServer::CleanupHandler: ImportError:
No module named apacheServer

This registration is attempted during kickstart and if it did not
register successfully during kickstart then we attempt it once the box
is built it may work fine, or it may give another 500 error. However
sometimes when we get a 500 error the registration still works OK.

It seems this may be related to
https://bugzilla.redhat.com/show_bug.cgi?id=503584 however as we are
on latest 1.0 i dont see how this can be. Has anyone seen this or know
of a fix as we cant reliably trust registrations to work at the
moment. We are using cobbler on the spacewalk server for provisioning.

thanks for any pointers