[Spacewalk-list] Spacewalk Upgrade Issue

Bedorf, Paul Paul.Bedorf at mosaic.com
Thu Oct 24 19:06:06 UTC 2013


Hi Michael, 

So I have decided to take a clone of my server, and work the upgrade on the clone server. The results were as follows:
All channels prior the upgrade are working perfectly fine, there is absolutely no issues with spacewalk 1.8 until I do the upgrade.
As of now I have tried subscribing 2 different clients, and none of them can subscribe.

This time I have NOT used the nightly repos. Performed the upgrade exactly the same as per the previous steps. Everything was successful and my spacewalk was successfully upgraded from version:
1.8 Nightly to Spacewalk release 2.0

Unfortunately the same issue persists. I have attached the logs in this email: and also pasted other logs below:

Spacewalk TRACEBACK from spacewalk.corp.mosaic.com - I get this email notification when something goes wrong with spacewalk etc...

### up2date logs ###

[Thu Oct 24 07:58:11 2013] up2date logging into up2date server
[Thu Oct 24 07:58:12 2013] up2date successfully retrieved authentication token from up2date server
[Thu Oct 24 07:58:31 2013] up2date Updating package profile
[Thu Oct 24 07:59:02 2013] up2date A socket error occurred: timed out, attempt #1
[Thu Oct 24 08:01:09 2013] up2date logging into up2date server
[Thu Oct 24 08:01:09 2013] up2date successfully retrieved authentication token from up2date server
[Thu Oct 24 08:02:46 2013] up2date logging into up2date server
[Thu Oct 24 08:02:46 2013] up2date successfully retrieved authentication token from up2date server
[Thu Oct 24 08:06:38 2013] up2date Updating package profile
[Thu Oct 24 08:12:51 2013] up2date Updating package profile

### httpd error_log ###

[Thu Oct 24 07:53:18 2013] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Thu Oct 24 07:53:18 2013] [notice] SSL FIPS mode disabled
[Thu Oct 24 07:53:18 2013] [notice] Digest: generating secret for digest authentication ...
[Thu Oct 24 07:53:18 2013] [notice] Digest: done
[Thu Oct 24 07:53:18 2013] [notice] mod_python: Creating 4 session mutexes based on 256 max processes and 0 max threads.
[Thu Oct 24 07:53:19 2013] [notice] SSL FIPS mode disabled
[Thu Oct 24 07:53:19 2013] [notice] Apache configured -- resuming normal operations
[Thu Oct 24 07:53:41 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:53:41 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:53:45 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:53:45 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:53:49 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:53:49 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:53:53 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:53:53 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:53:57 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:53:57 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:01 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:01 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:05 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:05 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:09 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:09 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:15 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:15 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:19 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:19 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:23 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:23 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:27 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:27 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:31 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:31 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:35 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:35 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:39 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:39 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:43 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:43 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:49 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:49 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 07:54:53 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (*) failed
[Thu Oct 24 07:54:53 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 08:14:08 2013] [notice] caught SIGTERM, shutting down
[Thu Oct 24 08:18:02 2013] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Thu Oct 24 08:18:02 2013] [notice] SSL FIPS mode disabled
[Thu Oct 24 08:18:03 2013] [notice] Digest: generating secret for digest authentication ...
[Thu Oct 24 08:18:03 2013] [notice] Digest: done
[Thu Oct 24 08:18:03 2013] [warn] mod_rewrite: Running external rewrite maps without defining a RewriteLock is DANGEROUS!
[Thu Oct 24 08:18:03 2013] [notice] mod_python: Creating 4 session mutexes based on 256 max processes and 0 max threads.
[Thu Oct 24 08:18:03 2013] [notice] SSL FIPS mode disabled
[Thu Oct 24 08:18:03 2013] [notice] Apache configured -- resuming normal operations
[Thu Oct 24 08:18:21 2013] [error] (111)Connection refused: proxy: AJP: attempt to connect to 127.0.0.1:8009 (localhost) failed
[Thu Oct 24 08:18:21 2013] [error] ap_proxy_connect_backend disabling worker for (localhost)
[Thu Oct 24 08:18:21 2013] [error] proxy: AJP: failed to make connection to backend: localhost
[Thu Oct 24 08:18:25 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:29 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:33 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:37 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:41 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:45 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:41 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:45 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:49 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:54 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:18:58 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:19:02 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:19:06 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:19:10 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:19:14 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:19:18 2013] [error] proxy: AJP: disabled connection for (localhost)
[Thu Oct 24 08:20:32 2013] [error] Exception reported from spacewalk.corp.mosaic.com
[Thu Oct 24 08:20:32 2013] [error] Time: Thu Oct 24 08:20:32 2013
[Thu Oct 24 08:20:32 2013] [error] Exception type psycopg2.ProgrammingError
[Thu Oct 24 08:20:32 2013] [error] Exception while handling function registration.new_system
[Thu Oct 24 08:20:32 2013] [error] Request object information:
[Thu Oct 24 08:20:32 2013] [error] URI: /XMLRPC
[Thu Oct 24 08:20:32 2013] [error] Remote Host: phx-vld-sandbox01.corp.mosaic.com
[Thu Oct 24 08:20:32 2013] [error] Server Name: 10.99.30.144:80
[Thu Oct 24 08:20:32 2013] [error] Headers passed in:
[Thu Oct 24 08:20:32 2013] [error] \tAccept-Encoding: identity
[Thu Oct 24 08:20:32 2013] [error] \tCONTENT_LENGTH: 1603
[Thu Oct 24 08:20:32 2013] [error] \tCONTENT_TYPE: text/xml
[Thu Oct 24 08:20:32 2013] [error] \tDOCUMENT_ROOT: /var/www/html
[Thu Oct 24 08:20:32 2013] [error] \tGATEWAY_INTERFACE: CGI/1.1
[Thu Oct 24 08:20:32 2013] [error] \tHTTP_ACCEPT_ENCODING: identity
[Thu Oct 24 08:20:32 2013] [error] \tHTTP_HOST: 10.99.30.144
[Thu Oct 24 08:20:32 2013] [error] \tHTTP_USER_AGENT: rhn.rpclib.py/2.5.69-1.el5
[Thu Oct 24 08:20:32 2013] [error] \tHTTP_X_CLIENT_VERSION: 1
[Thu Oct 24 08:20:32 2013] [error] \tHTTP_X_INFO: RPC Processor (C) Red Hat, Inc (version 2.5.69-1.el5)
[Thu Oct 24 08:20:32 2013] [error] \tHTTP_X_RHN_CLIENT_CAPABILITY: caneatCheese(1)=1,packages.extended_profile(2)=1,reboot.reboot(1)=1,packages.verify(1)=1,packages.runTransaction(1)=1,packages.update(2)=2,packages.rollBack(1)=1
[Thu Oct 24 08:20:32 2013] [error] \tHTTP_X_RHN_TRANSPORT_CAPABILITY: follow-redirects=3
[Thu Oct 24 08:20:32 2013] [error] \tHTTP_X_TRANSPORT_INFO: Extended Capabilities Transport (C) Red Hat, Inc (version 2.5.69-1.el5)
[Thu Oct 24 08:20:32 2013] [error] \tHTTP_X_UP2DATE_VERSION: 2.1.10-1.el5
[Thu Oct 24 08:20:32 2013] [error] \tHost: 10.99.30.144
[Thu Oct 24 08:20:32 2013] [error] \tPATH_INFO:
[Thu Oct 24 08:20:32 2013] [error] \tQUERY_STRING:
[Thu Oct 24 08:20:32 2013] [error] \tREMOTE_ADDR: 10.99.30.143
[Thu Oct 24 08:20:32 2013] [error] \tREMOTE_PORT: 45727
[Thu Oct 24 08:20:32 2013] [error] \tREQUEST_METHOD: POST
[Thu Oct 24 08:20:32 2013] [error] \tREQUEST_URI: /XMLRPC
[Thu Oct 24 08:20:32 2013] [error] \tSCRIPT_FILENAME: /usr/share/rhn/wsgi/xmlrpc.py
[Thu Oct 24 08:20:32 2013] [error] \tSCRIPT_NAME: /XMLRPC
[Thu Oct 24 08:20:32 2013] [error] \tSCRIPT_URI: http://10.99.30.144/XMLRPC
[Thu Oct 24 08:20:32 2013] [error] \tSCRIPT_URL: /XMLRPC
[Thu Oct 24 08:20:32 2013] [error] \tSERVER_ADDR: 10.99.30.144
[Thu Oct 24 08:20:32 2013] [error] \tSERVER_ADMIN: root at localhost
[Thu Oct 24 08:20:32 2013] [error] \tSERVER_NAME: 10.99.30.144
[Thu Oct 24 08:20:32 2013] [error] \tSERVER_PORT: 80
[Thu Oct 24 08:20:32 2013] [error] \tSERVER_PROTOCOL: HTTP/1.1
[Thu Oct 24 08:20:32 2013] [error] \tSERVER_SIGNATURE: <address>Apache Server at 10.99.30.144 Port 80</address>
[Thu Oct 24 08:20:32 2013] [error]
[Thu Oct 24 08:20:32 2013] [error] \tSERVER_SOFTWARE: Apache
[Thu Oct 24 08:20:32 2013] [error] \tUser-Agent: rhn.rpclib.py/2.5.69-1.el5
[Thu Oct 24 08:20:32 2013] [error] \tX-Client-Version: 1
[Thu Oct 24 08:20:32 2013] [error] \tX-Info: RPC Processor (C) Red Hat, Inc (version 2.5.69-1.el5)
[Thu Oct 24 08:20:32 2013] [error] \tX-RHN-Client-Capability: caneatCheese(1)=1,packages.extended_profile(2)=1,reboot.reboot(1)=1,packages.verify(1)=1,packages.runTransaction(1)=1,packages.update(2)=2,packages.rollBack(1)=1
[Thu Oct 24 08:20:32 2013] [error] \tX-RHN-Transport-Capability: follow-redirects=3
[Thu Oct 24 08:20:32 2013] [error] \tX-Transport-Info: Extended Capabilities Transport (C) Red Hat, Inc (version 2.5.69-1.el5)
[Thu Oct 24 08:20:32 2013] [error] \tX-Up2Date-Version: 2.1.10-1.el5
[Thu Oct 24 08:20:32 2013] [error] \tX-Transport-Info: Extended Capabilities Transport (C) Red Hat, Inc (version 2.5.69-1.el5)
[Thu Oct 24 08:20:32 2013] [error] \tX-Up2Date-Version: 2.1.10-1.el5
[Thu Oct 24 08:20:32 2013] [error] \tmod_ssl.is_https: <built-in method ssl_is_https of mod_wsgi.Adapter object at 0x2ac9a5391300>
[Thu Oct 24 08:20:32 2013] [error] \tmod_ssl.var_lookup: <built-in method ssl_var_lookup of mod_wsgi.Adapter object at 0x2ac9a5391300>
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.application_group: spacewalk.corp.mosaic.com|/xmlrpc
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.callable_object: application
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.handler_script:
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.input_chunked: 0
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.listener_host:
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.listener_port: 80
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.process_group:
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.request_handler: wsgi-script
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.script_reloading: 1
[Thu Oct 24 08:20:32 2013] [error] \tmod_wsgi.version: (3, 2)
[Thu Oct 24 08:20:32 2013] [error] \twsgi.errors: <mod_wsgi.Log object at 0x2ac9a4f29470>
[Thu Oct 24 08:20:32 2013] [error] \twsgi.file_wrapper: <built-in method file_wrapper of mod_wsgi.Adapter object at 0x2ac9a5391300>
[Thu Oct 24 08:20:32 2013] [error] \twsgi.input: <mod_wsgi.Input object at 0x2ac9a4f29430>
[Thu Oct 24 08:20:32 2013] [error] \twsgi.multiprocess: True
[Thu Oct 24 08:20:32 2013] [error] \twsgi.multithread: False
[Thu Oct 24 08:20:32 2013] [error] \twsgi.run_once: False
[Thu Oct 24 08:20:32 2013] [error] \twsgi.url_scheme: http
[Thu Oct 24 08:20:32 2013] [error] \twsgi.version: (1, 1)
[Thu Oct 24 08:20:32 2013] [error]
[Thu Oct 24 08:20:32 2013] [error] Exception Handler Information
[Thu Oct 24 08:20:32 2013] [error] Traceback (most recent call last):
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/apacheRequest.py", line 123, in call_function
[Thu Oct 24 08:20:32 2013] [error]     response = apply(func, params)
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/share/rhn/server/handlers/xmlrpc/registration.py", line 504, in new_system
[Thu Oct 24 08:20:32 2013] [error]     architecture, data)
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/share/rhn/server/handlers/xmlrpc/registration.py", line 408, in create_system
[Thu Oct 24 08:20:32 2013] [error]     newserv.use_token()
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnServer/server_class.py", line 346, in use_token
[Thu Oct 24 08:20:32 2013] [error]     tokens_obj, self.virt_type)
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnServer/server_token.py", line 1024, in process_token
[Thu Oct 24 08:20:32 2013] [error]     history["channels"] = token_channels(server, server_arch, tokens_obj)
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnServer/server_token.py", line 145, in token_channels
[Thu Oct 24 08:20:32 2013] [error]     child.load_by_id(c["id"])
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnChannel.py", line 220, in load_by_id
[Thu Oct 24 08:20:32 2013] [error]     self._load_dists()
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnChannel.py", line 251, in _load_dists
[Thu Oct 24 08:20:32 2013] [error]     dists = self._get_db_dists(channel_id)
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnChannel.py", line 264, in _get_db_dists
[Thu Oct 24 08:20:32 2013] [error]     h.execute(channel_id=channel_id)
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnSQL/sql_base.py", line 163, in execute
[Thu Oct 24 08:20:32 2013] [error]     return apply(self._execute_wrapper, (self._execute, ) + p, kw)
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnSQL/driver_postgresql.py", line 273, in _execute_wrapper
[Thu Oct 24 08:20:32 2013] [error]     retval = apply(function, p, kw)
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnSQL/sql_base.py", line 217, in _execute
[Thu Oct 24 08:20:32 2013] [error]     return self._execute_(args, kwargs)
[Thu Oct 24 08:20:32 2013] [error]   File "/usr/lib/python2.4/site-packages/spacewalk/server/rhnSQL/driver_postgresql.py", line 287, in _execute_
[Thu Oct 24 08:20:32 2013] [error]     self._real_cursor.execute(self.sql, params)
[Thu Oct 24 08:20:32 2013] [error] ProgrammingError: column "org_id" does not exist
[Thu Oct 24 08:20:32 2013] [error] LINE 5:          and org_id is null
[Thu Oct 24 08:20:32 2013] [error]                      ^

### rhn_server_xmlrpc.log ###

2013/10/24 07:58:12 -04:00 4619 10.99.30.144: xmlrpc/up2date.login(1000010045,)
2013/10/24 07:58:12 -04:00 4615 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 07:58:32 -04:00 4615 10.99.30.144: xmlrpc/registration.welcome_message('lang: None',)
2013/10/24 07:58:32 -04:00 4614 10.99.30.144: xmlrpc/registration.update_packages(1000010045, 'packages: 971')
2013/10/24 07:59:19 -04:00 4613 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 08:00:43 -04:00 4615 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 08:01:09 -04:00 4618 10.99.30.144: xmlrpc/up2date.login(1000010045,)
2013/10/24 08:01:09 -04:00 4613 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 08:01:48 -04:00 4620 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 08:01:55 -04:00 4616 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 08:02:46 -04:00 4617 10.99.30.144: xmlrpc/up2date.login(1000010045,)
2013/10/24 08:02:47 -04:00 4615 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 08:03:12 -04:00 4613 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 08:04:09 -04:00 4615 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 08:06:39 -04:00 4619 10.99.30.144: xmlrpc/registration.welcome_message('lang: None',)
2013/10/24 08:06:39 -04:00 4615 10.99.30.144: xmlrpc/registration.update_packages(1000010045, 'packages: 977')
2013/10/24 08:12:40 -04:00 4619 10.99.30.144: xmlrpc/up2date.listChannels(1000010045,)
2013/10/24 08:12:51 -04:00 4617 10.99.30.144: xmlrpc/registration.welcome_message('lang: None',)
2013/10/24 08:12:52 -04:00 4613 10.99.30.144: xmlrpc/registration.update_packages(1000010045, 'packages: 978')
2013/10/24 08:20:30 -04:00 4574 10.99.30.143: xmlrpc/registration.welcome_message('lang: None',)
2013/10/24 08:20:31 -04:00 4575 10.99.30.143: xmlrpc/registration.welcome_message('lang: None',)
2013/10/24 08:20:31 -04:00 5182 10.99.30.143: xmlrpc/registration.create_system("token = '1-3768ca29596c8b11e3d7a8cad4136446'", '5Server', 'x86_64-redhat-linux')
2013/10/24 08:20:32 -04:00 5182 10.99.30.143: rhnServer/server_token.process_token(1000010396, 'enterprise_entitled,monitoring_entitled,provisioning_entitled')
2013/10/24 08:34:40 -04:00 5182 10.99.30.143: rhnServer/server_certificate.valid('Server id ID-1000010396 not found in database',)

### catalina.out ###

Oct 24, 2013 7:53:17 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: The Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd64:/usr/lib/oracle/11.2/client64/lib:/usr/lib/oracle/11.2/client/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
Oct 24, 2013 7:53:17 AM org.apache.coyote.http11.Http11BaseProtocol init
INFO: Initializing Coyote HTTP/1.1 on http-127.0.0.1-8080
Oct 24, 2013 7:53:17 AM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 1294 ms
Oct 24, 2013 7:53:17 AM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Oct 24, 2013 7:53:17 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/5.5.23
Oct 24, 2013 7:53:17 AM org.apache.catalina.core.StandardHost start
INFO: XML validation disabled
Oct 24, 2013 7:54:49 AM com.mchange.v2.log.MLog <clinit>
INFO: MLog clients using java 1.4+ standard logging.
Oct 24, 2013 7:54:49 AM com.mchange.v2.c3p0.C3P0Registry banner
INFO: Initializing c3p0-0.9.0 [built 13-July-2007 10:11:26 -0400; debug? false; trace: 5]
Oct 24, 2013 7:54:49 AM com.mchange.v2.c3p0.PoolBackedDataSource getPoolManager
INFO: Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource at 62d844a9 [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource at 3d3c33b7 [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 3d3c33b7, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxIdleTime -> 300, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource at 7e63f09e [ description -> null, driverClass -> null, factoryClassLocation -> null, identityToken -> 7e63f09e, jdbcUrl -> jdbc:postgresql:spaceschema, properties -> {user=******, password=******, driver_proto=jdbc:postgresql} ], preferredTestQuery -> null, propertyCycle -> 300, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, usesTraditionalReflectiveProxies -> false ], factoryClassLocation -> null, identityToken -> 62d844a9, numHelperThreads -> 3 ]
Oct 24, 2013 7:54:55 AM org.apache.coyote.http11.Http11BaseProtocol start
INFO: Starting Coyote HTTP/1.1 on http-127.0.0.1-8080
Oct 24, 2013 7:54:55 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Hosts
Oct 24, 2013 7:54:55 AM org.apache.catalina.connector.MapperListener init
INFO: Registering WebModule Contexts
Oct 24, 2013 7:54:55 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Servlets
Oct 24, 2013 7:54:55 AM org.apache.jk.common.ChannelSocket init
INFO: JK: ajp13 listening on /127.0.0.1:8009
Oct 24, 2013 7:54:55 AM org.apache.jk.server.JkMain start
INFO: Jk running ID=0 time=0/44  config=null
Oct 24, 2013 7:54:55 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Hosts
Oct 24, 2013 7:54:55 AM org.apache.catalina.connector.MapperListener init
INFO: Registering WebModule Contexts
Oct 24, 2013 7:54:55 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Servlets
Oct 24, 2013 7:54:55 AM org.apache.jk.common.ChannelSocket init
INFO: JK: ajp13 listening on /0:0:0:0:0:0:0:1:8009
Oct 24, 2013 7:54:55 AM org.apache.jk.server.JkMain start
INFO: Jk running ID=0 time=0/3  config=null
Oct 24, 2013 7:54:55 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Hosts
Oct 24, 2013 7:54:55 AM org.apache.catalina.connector.MapperListener init
INFO: Registering WebModule Contexts
Oct 24, 2013 7:54:55 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Servlets
Oct 24, 2013 7:54:55 AM org.apache.catalina.storeconfig.StoreLoader load
INFO: Find registry server-registry.xml at classpath resource
Oct 24, 2013 7:54:56 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 98563 ms
Oct 24, 2013 8:06:16 AM org.apache.catalina.startup.HostConfig checkResources
INFO: Undeploying context [/rhn]
2013-10-24 08:06:24,310 [ContainerBackgroundProcessor[StandardEngine[Catalina]]] ERROR com.redhat.rhn.common.hibernate.ConnectionManager - FATAL ERROR creating HibernateFactory
INFO: Undeploying context [/rhn]
2013-10-24 08:06:24,310 [ContainerBackgroundProcessor[StandardEngine[Catalina]]] ERROR com.redhat.rhn.common.hibernate.ConnectionManager - FATAL ERROR creating HibernateFactory
org.hibernate.MappingNotFoundException: resource: com/redhat/rhn/domain/server/Crashes.hbm.xml not found
        at org.hibernate.cfg.Configuration.addResource(Configuration.java:563)
        at com.redhat.rhn.common.hibernate.ConnectionManager.createSessionFactory(ConnectionManager.java:210)
        at com.redhat.rhn.common.hibernate.ConnectionManager.initialize(ConnectionManager.java:134)
        at com.redhat.rhn.common.hibernate.HibernateFactory.createSessionFactory(HibernateFactory.java:96)
        at com.redhat.rhn.webapp.RhnServletListener.startHibernate(RhnServletListener.java:94)
        at com.redhat.rhn.webapp.RhnServletListener.contextInitialized(RhnServletListener.java:116)
        at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3764)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:4212)
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:760)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:740)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:544)
        at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:634)
        at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:561)
        at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:496)
        at org.apache.catalina.startup.HostConfig.check(HostConfig.java:1261)
        at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:301)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:120)
        at org.apache.catalina.core.ContainerBase.backgroundProcess(ContainerBase.java:1306)
        at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.processChildren(ContainerBase.java:1570)
        at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.processChildren(ContainerBase.java:1579)
        at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1559)
        at java.lang.Thread.run(Thread.java:679)
2013-10-24 08:06:25,416 [ContainerBackgroundProcessor[StandardEngine[Catalina]]] ERROR com.redhat.rhn.common.hibernate.ConnectionManager - FATAL ERROR creating HibernateFactory
org.hibernate.MappingNotFoundException: resource: com/redhat/rhn/domain/server/Crashes.hbm.xml not found
        at org.hibernate.cfg.Configuration.addResource(Configuration.java:563)
        at com.redhat.rhn.common.hibernate.ConnectionManager.createSessionFactory(ConnectionManager.java:210)
        at com.redhat.rhn.common.hibernate.ConnectionManager.initialize(ConnectionManager.java:134)
        at com.redhat.rhn.common.hibernate.ConnectionManager.getSession(ConnectionManager.java:288)
        at com.redhat.rhn.common.hibernate.HibernateFactory.getSession(HibernateFactory.java:320)
        at com.redhat.rhn.manager.satellite.UpgradeCommand.store(UpgradeCommand.java:60)
        at com.redhat.rhn.webapp.RhnServletListener.executeUpgradeStep(RhnServletListener.java:126)
        at com.redhat.rhn.webapp.RhnServletListener.contextInitialized(RhnServletListener.java:120)
        at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3764)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:4212)
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:760)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:740)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:544)
        at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:634)
        at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:561)
        at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:496)
        at org.apache.catalina.startup.HostConfig.check(HostConfig.java:1261)
        at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:301)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:120)
        at org.apache.catalina.core.ContainerBase.backgroundProcess(ContainerBase.java:1306)
        at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.processChildren(ContainerBase.java:1570)
        at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.processChildren(ContainerBase.java:1579)
        at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1559)
        at java.lang.Thread.run(Thread.java:679)
2013-10-24 08:06:25,427 [ContainerBackgroundProcessor[StandardEngine[Catalina]]] ERROR com.redhat.rhn.manager.satellite.UpgradeCommand - Problem upgrading!
java.lang.NullPointerException
        at com.redhat.rhn.common.hibernate.ConnectionManager.getInternalSession(ConnectionManager.java:300)
        at com.redhat.rhn.common.hibernate.ConnectionManager.getSession(ConnectionManager.java:290)
        at com.redhat.rhn.common.hibernate.HibernateFactory.getSession(HibernateFactory.java:320)
        at com.redhat.rhn.manager.satellite.UpgradeCommand.store(UpgradeCommand.java:60)
        at com.redhat.rhn.webapp.RhnServletListener.executeUpgradeStep(RhnServletListener.java:126)
        at com.redhat.rhn.webapp.RhnServletListener.contextInitialized(RhnServletListener.java:120)
        at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3764)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:4212)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3764)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:4212)
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:760)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:740)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:544)
        at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:634)
        at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:561)
        at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:496)
        at org.apache.catalina.startup.HostConfig.check(HostConfig.java:1261)
        at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:301)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:120)
        at org.apache.catalina.core.ContainerBase.backgroundProcess(ContainerBase.java:1306)
        at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.processChildren(ContainerBase.java:1570)
        at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.processChildren(ContainerBase.java:1579)
        at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1559)
        at java.lang.Thread.run(Thread.java:679)
Oct 24, 2013 8:14:10 AM org.apache.coyote.http11.Http11BaseProtocol pause
INFO: Pausing Coyote HTTP/1.1 on http-127.0.0.1-8080
Oct 24, 2013 8:14:11 AM org.apache.catalina.core.StandardService stop
INFO: Stopping service Catalina
2013-10-24 08:14:11,598 [main] ERROR org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/rhn] - Exception sending context destroyed event to listener instance of class com.redhat.rhn.webapp.RhnServletListener
java.lang.NullPointerException
        at com.redhat.rhn.common.hibernate.ConnectionManager.close(ConnectionManager.java:112)
        at com.redhat.rhn.common.hibernate.HibernateFactory.closeSessionFactory(HibernateFactory.java:80)
        at com.redhat.rhn.webapp.RhnServletListener.stopHibernate(RhnServletListener.java:99)
        at com.redhat.rhn.webapp.RhnServletListener.contextDestroyed(RhnServletListener.java:136)
        at org.apache.catalina.core.StandardContext.listenerStop(StandardContext.java:3805)
        at org.apache.catalina.core.StandardContext.stop(StandardContext.java:4319)
        at org.apache.catalina.core.ContainerBase.removeChild(ContainerBase.java:893)
        at org.apache.catalina.startup.HostConfig.undeployApps(HostConfig.java:1235)
        at org.apache.catalina.startup.HostConfig.stop(HostConfig.java:1206)
        at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:120)
        at org.apache.catalina.core.ContainerBase.stop(ContainerBase.java:1055)
        at org.apache.catalina.core.ContainerBase.stop(ContainerBase.java:1067)
        at org.apache.catalina.core.StandardEngine.stop(StandardEngine.java:448)
        at org.apache.catalina.core.StandardService.stop(StandardService.java:510)
        at org.apache.catalina.core.StandardServer.stop(StandardServer.java:734)
        at org.apache.catalina.startup.Catalina.stop(Catalina.java:602)
        at org.apache.catalina.startup.Catalina.start(Catalina.java:577)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:295)
        at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:433)
Oct 24, 2013 8:14:11 AM org.apache.coyote.http11.Http11BaseProtocol destroy
INFO: Stopping Coyote HTTP/1.1 on http-127.0.0.1-8080
Oct 24, 2013 8:14:11 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: Failed shutdown of Apache Portable Runtime
Oct 24, 2013 8:18:01 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: The Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
Oct 24, 2013 8:18:02 AM org.apache.coyote.http11.Http11BaseProtocol init
INFO: Initializing Coyote HTTP/1.1 on http-127.0.0.1-8080
Oct 24, 2013 8:18:02 AM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 1344 ms
Oct 24, 2013 8:18:02 AM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Oct 24, 2013 8:18:02 AM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Oct 24, 2013 8:18:02 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/5.5.23
Oct 24, 2013 8:18:02 AM org.apache.catalina.core.StandardHost start
INFO: XML validation disabled
Oct 24, 2013 8:18:12 AM com.mchange.v2.log.MLog <clinit>
INFO: MLog clients using java 1.4+ standard logging.
Oct 24, 2013 8:18:12 AM com.mchange.v2.c3p0.C3P0Registry banner
INFO: Initializing c3p0-0.9.1.2 [built 06-August-2008 15:35:00; debug? false; trace: 5]
Oct 24, 2013 8:18:12 AM com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource getPoolManager
INFO: Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource at fcd1faf [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource at acae7f8 [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> com.redhat.rhn.common.db.RhnConnectionCustomizer, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> z8kflt8x1t1d23peox5d0|4b0613aa, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 300, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource at 403195e [ description -> null, driverClass -> null, factoryClassLocation -> null, identityToken -> z8kflt8x1t1d23peox5d0|4b455d1c, jdbcUrl -> jdbc:postgresql:spaceschema, properties -> {user=******, password=******, driver_proto=jdbc:postgresql} ], preferredTestQuery -> select 'c3p0 ping' from dual, propertyCycle -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, factoryClassLocation -> null, identityToken -> z8kflt8x1t1d23peox5d0|6789b939, numHelperThreads -> 3 ]
Oct 24, 2013 8:18:24 AM org.apache.coyote.http11.Http11BaseProtocol start
INFO: Starting Coyote HTTP/1.1 on http-127.0.0.1-8080
Oct 24, 2013 8:18:24 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Hosts
Oct 24, 2013 8:18:24 AM org.apache.catalina.connector.MapperListener init
INFO: Registering WebModule Contexts
Oct 24, 2013 8:18:24 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Servlets
Oct 24, 2013 8:18:24 AM org.apache.jk.common.ChannelSocket init
INFO: JK: ajp13 listening on /127.0.0.1:8009
Oct 24, 2013 8:18:24 AM org.apache.jk.server.JkMain start
INFO: Jk running ID=0 time=0/93  config=null
Oct 24, 2013 8:18:24 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Hosts
Oct 24, 2013 8:18:24 AM org.apache.catalina.connector.MapperListener init
INFO: Registering WebModule Contexts
Oct 24, 2013 8:18:24 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Servlets
Oct 24, 2013 8:18:24 AM org.apache.jk.common.ChannelSocket init
INFO: JK: ajp13 listening on /0:0:0:0:0:0:0:1:8009
Oct 24, 2013 8:18:24 AM org.apache.jk.server.JkMain start
INFO: Jk running ID=0 time=0/3  config=null
Oct 24, 2013 8:18:24 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Hosts
Oct 24, 2013 8:18:24 AM org.apache.catalina.connector.MapperListener init
INFO: Registering WebModule Contexts
Oct 24, 2013 8:18:24 AM org.apache.catalina.connector.MapperListener init
INFO: Registering Servlets
Oct 24, 2013 8:18:24 AM org.apache.catalina.storeconfig.StoreLoader load
INFO: Find registry server-registry.xml at classpath resource
Oct 24, 2013 8:18:24 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 22849 ms


__________________________________________________
Paul Bedorf | Linux Administrator | Mosaic
O: 905.238.8058 x 6414 | M: 416.799.4028 
mosaic.com

-----Original Message-----
From: spacewalk-list-bounces at redhat.com [mailto:spacewalk-list-bounces at redhat.com] On Behalf Of Michael Mraka
Sent: Thursday, October 24, 2013 4:53 AM
To: spacewalk-list at redhat.com
Subject: Re: [Spacewalk-list] Spacewalk Upgrade Issue

Bedorf, Paul wrote:
% Description:
%
% Hi, in our environment we are running the following:
%
% spacewalk 1.8 nightly
% centos 5.9 64bit
% postgresql 8.4 (installed locally on the spacewalk server) % % Spacewalk works absolutely perfect, no issues what's so ever. I have decided to upgrade spacewalk to the latest version 2.0, below you will find the steps that I took:
%
% Upgrade:
% a.       I have followed the instructions on the following page:
% https://fedorahosted.org/spacewalk/wiki/HowToUpgrade19
% b.      Install spacewalk-repo
% rpm -Uvh http://yum.spacewalkproject.org/2.0/RHEL/5/x86_64/spacewalk-repo-2.0-3.el5.noarch.rpm
% c.       Enable nightly builds
% sed -i 's/enabled=0/enabled=1/' /etc/yum.repos.d/spacewalk-nightly.repo
% d.      sed -i 's/enabled=1/enabled=0/' /etc/yum.repos.d/spacewalk.repo

So you explicitly enabled nightly repo and disabled standard Spacewalk 2.0...

% e.      yum install cobbler-epel
% yum upgrade
% yum install rpmconf
% su - postgres -c 'PGPASSWORD=spacepw; createlang pltclu spaceschema ;'
% /usr/sbin/spacewalk-service stop
% /usr/bin/spacewalk-schema-upgrade
% f.        All is 100% successful at this point, I keep on going:
% spacewalk-setup --disconnected -upgrade % /usr/share/spacewalk/setup/upgrade/rhn-enable-monitoring.pl
% /usr/sbin/spacewalk-service start
% g.       All is again 100% successful at this point, I restart the spacewalk server and can log in via admin URL and I see spacewalk has been upgraded to version 2.1 nightly

That's expected according to enabled repos above. On the other hand it might be dangerous especially on production server because nightly repo can contain buggy development code and can even cause data corruption / loss. 

% h.      All my configurations are there, and all of my systems are there.
%
% Issue:
% 
% a.       I log in to one of the client machine's and attempt to re-register the client to spacewalk, just to ensure it is working correctly, I issue this command:
%
% rhnreg_ks --force  -vvv --serverUrl=http://10.99.30.144/XMLRPC --activationkey=1-3768ca29596c8b11e3d7a8cad4136446
% D: rpcServer: Calling XMLRPC registration.welcome_message % D: opening  db environment /var/lib/rpm/Packages joinenv
% D: opening  db index       /var/lib/rpm/Packages rdonly mode=0x0
% D: locked   db index       /var/lib/rpm/Packages
% D: rpcServer: Calling XMLRPC registration.welcome_message
% D: opening  db index       /var/lib/rpm/Providename rdonly mode=0x0
% D: rpcServer: Calling XMLRPC registration.new_system % A protocol error occurred: Status 500 , attempt #1, % Error communicating with server. The message was:
% Status 500
% D: closed   db index       /var/lib/rpm/Providename
% D: closed   db index       /var/lib/rpm/Packages
% D: closed   db environment /var/lib/rpm/Packages
% D: May free Score board((nil))

There should be more verbose error in /var/log/up2date on client and /var/log/httpd/*error_log, /var/log/rhn/*.log and /var/log/tomcat*/catalina.out on server.

% b.      I also receive an email with more info about this error message:
%
% Exception reported from spacewalk2.corp.mosaic.com % Time: Wed Oct 23 02:31:18 2013 % Exception type spacewalk.server.rhnSQL.sql_base.SQLSchemaError
% Exception while handling function registration.new_system Request object information:
%
% URI: /XMLRPC
% Remote Host: phx-vld-sandbox01.corp.mosaic.com Server Name: 10.99.30.144:80 Headers passed in:
% Extra information about this error:
% SQL Error generated: (99999, 'ERROR:  current transaction is aborted, commands ignored until end of transaction block', '', <psycopg2.InternalError instance at 0x2ab9264c0fc8>) ...
%                              history = <type 'dict'> {'channels': ["Subscribed to base channel 'cent5_64bit_CD' (cent564bitcd)", "FAILED to subscribe to channel 'cent5_64bit_NAGIOS'", "FAILED to subscribe to channel 'cent5_64bit_UPDATES'", "FAILED to subscribe to channel 'Cent5_64bit_SPACECLIENTREPO18'", "FAILED to subscribe to channel 'cent5_64bit_389'", "FAILED to subscribe to channel 'cent5_64bit_EXTRAS'"], 'entitlement': 'Entitled as a Spacewalk Provisioning Entitled Servers member'}

Client can't subscribe to child channels (cent5_64bit_NAGIOS, cent5_64bit_UPDATES, Cent5_64bit_SPACECLIENTREPO18, cent5_64bit_389, cent5_64bit_EXTRAS). Is anything wrong with them?  Can other clients subscribe to them?


Regards,

--
Michael Mráka
Satellite Engineering, Red Hat

_______________________________________________
Spacewalk-list mailing list
Spacewalk-list at redhat.com
https://www.redhat.com/mailman/listinfo/spacewalk-list
-------------- next part --------------
An embedded message was scrubbed...
From: "Bedorf, Paul" <Paul.Bedorf at mosaic.com>
Subject: Spacewalk TRACEBACK from spacewalk.corp.mosaic.com
Date: Thu, 24 Oct 2013 12:20:33 +0000
Size: 39611
URL: <http://listman.redhat.com/archives/spacewalk-list/attachments/20131024/d24b13e3/attachment.eml>


More information about the Spacewalk-list mailing list