[Spacewalk-list] Issue with starting spacewalk 0.4

Tue Apr 7 16:47:13 UTC 2009

Guys,

This past weekend my spacewalk server started sending me emails every hour on the hour with errors that were occurring. I logged into the server and restarted the server and noticed that s2s, c2s, and sm were starting but dying after about 20 seconds. The startup process completes without error but the shutdown fails on the three processes I mentioned previously. I have not touched the server in several weeks and there is no one else who accesses it. I am attaching the output of one of the traceback messages that I have received. Any ideas as to why this might be occurring? I have tried rebooting the server...

Traceback email:

Exception reported from spacewalk-test.garmin.com

Time: Mon Apr  6 05:15:07 2009

Exception type server.rhnSQL.sql_base.SQLConnectError

Request object information:

URI: /XMLRPC

Remote Host: 10.33.13.108

Server Name: spacewalk-test.garmin.com:0 Headers passed in:

      Accept-Encoding: identity

      Content-Length: 2151

      Host: spacewalk-host-test.garmin.com

      content-type: text/xml

      user-agent: rhn.rpclib.py/$Revision$

      x-client-version: 1

      x-info: RPC Processor (C) Red Hat, Inc (version $Revision$)

      x-rhn-client-capability: packages.verifyAll(1)=1,caneatCheese(1)=1,packages.extended_profile(1)=1,reboot.reboot(1)=1,packages.verify(1)=1,packages.runTransaction(1)=1,packages.rollBack(1)=1,packages.verifyAll(1)=1,caneatCheese(1)=1,packages.extended_profile(1)=1,reboot.reboot(1)=1,packages.verify(1)=1,packages.runTransaction(1)=1,packages.rollBack(1)=1

      x-rhn-transport-capability: follow-redirects=2

      x-transport-info: Extended Capabilities Transport (C) Red Hat, Inc (version $Revision$)

      x-up2date-version: 0.4.17-10.fc9

Exception Handler Information

Traceback (most recent call last):

  File "/usr/share/rhn/server/apacheHandler.py", line 72, in headerParserHandler

    rhnSQL.initDB()

  File "/usr/share/rhn/server/rhnSQL/__init__.py", line 99, in initDB

    __init__DB(backend, host, port, username, password, database)

  File "/usr/share/rhn/server/rhnSQL/__init__.py", line 59, in __init__DB

    __DB.check_connection()

  File "/usr/share/rhn/server/rhnSQL/driver_cx_Oracle.py", line 441, in check_connection

    self.connect() # only allow one try

  File "/usr/share/rhn/server/rhnSQL/driver_cx_Oracle.py", line 332, in connect

    raise apply(sql_base.SQLConnectError, err_args)

SQLConnectError: (257, 'ORA-00257: archiver error. Connect internal only, until freed.\n', 'SPPOC', 'Connection_Connect(): begin session')

Local variables by frame

Frame connect in /usr/share/rhn/server/rhnSQL/driver_cx_Oracle.py at line 332

                         e = <type 'instance'> ORA-00257: archiver error. Connect internal only, until freed.

                     errno = <type 'int'> 257

                      self = <type 'instance'> <server.rhnSQL.driver_cx_Oracle.Database instance at 0xb77e540c>

                       ret = <type 'tuple'> (257, 'ORA-00257: archiver error. Connect internal only, until freed.\n', 'Connection_Connect(): begin session')

                 reconnect = <type 'int'> 1

                  err_args = <type 'list'> ['SPPOC', 257, 'ORA-00257: archiver error. Connect internal only, until freed.\n', 'Connection_Connect(): begin session']

                    errmsg = <type 'str'> ORA-00257: archiver error. Connect internal only, until freed.

Frame check_connection in /usr/share/rhn/server/rhnSQL/driver_cx_Oracle.py at line 441

                      self = <type 'instance'> <server.rhnSQL.driver_cx_Oracle.Database instance at 0xb77e540c>

Frame __init__DB in /usr/share/rhn/server/rhnSQL/__init__.py at line 59

                  username = <type 'str'> spacewalk

                  database = <type 'str'> SPPOC

                      host = <type 'str'> localhost

                  password = <type 'str'> spacewalk

                      port = <type 'NoneType'> None

                   backend = <type 'str'> oracle

Frame initDB in /usr/share/rhn/server/rhnSQL/__init__.py at line 105

                  username = <type 'str'> spacewalk

                      temp = <type 'str'> spacewalk at SPPOC

                  database = <type 'str'> SPPOC

                       dsn = <type 'str'> <CENSORED!>

                      host = <type 'str'> localhost

                  password = <type 'str'> spacewalk

                      port = <type 'NoneType'> None

                   backend = <type 'str'> oracle

Frame headerParserHandler in /usr/share/rhn/server/apacheHandler.py at line 74

                      self = <type 'instance'> <server.apacheHandler.apacheHandler instance at 0xb784746c>

                       req = <type 'mp_request'> <mp_request object at 0xb7adad2c>

                       ret = <type 'int'> 0

Frame __call__ in /usr/share/rhn/server/apacheServer.py at line 58

                      self = <type 'instance'> <server.apacheServer.HandlerWrap instance at 0xb78e3bcc>

                       req = <type 'mp_request'> <mp_request object at 0xb7adad2c>

                   options = <type 'mp_table'> {'RHNComponentType': 'server.xmlrpc', 'SERVER': 'xmlrpc', 'RootDir': '/usr/share/rhn'}

                         f = <type 'instancemethod'> <bound method apacheHandler.headerParserHandler of <server.apacheHandler.apacheHandler instance at 0xb784746c>>

Frame HandlerDispatch in /usr/lib/python2.4/site-packages/mod_python/apache.py at line 299

                       req = <type 'mp_request'> <mp_request object at 0xb7adad2c>

                    config = <type 'mp_table'> {'PythonInterpreter': 'rhn.server', 'PythonPath': 'sys.path+['/usr/share/rhn']'}

                      self = <type 'instance'> <mod_python.apache.CallBack instance at 0xb7ae876c>

                    object = <type 'instance'> <server.apacheServer.HandlerWrap instance at 0xb78e3bcc>

                         l = <type 'list'> ['server.apacheServer', 'HeaderParserHandler']

                    module = <type 'module'> <module 'server.apacheServer' from '/usr/share/rhn/server/apacheServer.pyc'>

                     hlist = <type 'mp_hlist'> {'handler:'server.apacheServer::HeaderParserHandler','directory':'/XMLRPC/','silent':0}

                object_str = <type 'str'> HeaderParserHandler

                     debug = <type 'int'> 0

               module_name = <type 'str'> server.apacheServer

                pathstring = <type 'str'> sys.path+['/usr/share/rhn']

                    result = <type 'int'> 500

Environment for PID=18230 on exception:

LANG = C

NLS_LANG = english.AL32UTF8

ORACLE_HOME = /opt/oracle

PATH = /sbin:/usr/sbin:/bin:/usr/bin

PERL_BADFREE = 0

PWD = /

SHLVL = 2

TERM = linux

_ = /usr/sbin/httpd

Jonathan Hooker
Desktop Support - Engineering
Garmin International
Jonathan.Hooker at Garmin.com

________________________________
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient. If you are not the intended recipient, please be aware that any disclosure, copying, distribution or use of this e-mail or any attachment is prohibited. If you have received this e-mail in error, please contact the sender and delete all copies.

Thank you for your cooperation
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/spacewalk-list/attachments/20090407/86db2360/attachment.htm>