[Spacewalk-list] FW: Spacewalk TRACEBACK from dc1-lsw01

Paul-Andre Panon paul-andre.panon at avigilon.com
Tue Jan 16 19:58:31 UTC 2018


I've got a bunch of tracebacks regularly happening from one group of similarly configured Ubuntu 16.04 servers, but not for any other 16.04 servers.

The URIs that are usually triggering the errors are dep11/icons-64x64.tar and dep11/Components-amd64.yml, and some compressed versions of those files on the primary channel and all of the child channels. 
URI: ///XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar
URI: ///XMLRPC/GET-REQ/xenial-backports/dep11/Components-amd64.yml
URI: ///XMLRPC/GET-REQ/xenial-updates/dep11/icons-64x64.tar
URI: ///XMLRPC/GET-REQ/xenial-updates-universe/dep11/icons-64x64.tar
etc.

Dep11 appears to refer to additional metadata information available for newer versions of Debian packaging https://wiki.debian.org/DEP-11. Since only some servers are affected,  does anyone have any idea what packages could be triggering this and why? Is there any way to suppress these errors? The patching appears to success despite the errors.

Exception reported from dc1-lsw01
Time: Mon Jan 15 12:02:20 2018
Exception type <class 'spacewalk.server.apacheRequest.UnknownXML'>
Exception while handling function dep11
Request object information:
URI: ///XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar
Remote Host: avo-sg1-air01.york.lan
Server Name: dc1-lsw01.york.lan:443
Headers passed in:
	Accept-Encoding: identity
	CONTEXT_DOCUMENT_ROOT: /var/www/html
	CONTEXT_PREFIX: 
	DOCUMENT_ROOT: /var/www/html
	GATEWAY_INTERFACE: CGI/1.1
	HTTP_ACCEPT_ENCODING: identity
	HTTP_HOST: dc1-lsw01.york.lan
	HTTP_X_RHN_AUTH: iuJRMAuvPnN8WmpEPqtELBZBj+XIDTYWwtzj1fTrFpU=
	HTTP_X_RHN_AUTH_EXPIRE_OFFSET: 3600.0
	HTTP_X_RHN_AUTH_SERVER_TIME: 1516046343.75
	HTTP_X_RHN_AUTH_USER_ID: 
	HTTP_X_RHN_SERVER_ID: 1000010084
	HTTP_X_RHN_TRANSPORT_CAPABILITY: follow-redirects=3
	Host: dc1-lsw01.york.lan
	PATH_INFO: /GET-REQ/xenial-backports/dep11/icons-64x64.tar
	PATH_TRANSLATED: /var/www/html/GET-REQ/xenial-backports/dep11/icons-64x64.tar
	QUERY_STRING: 
	REMOTE_ADDR: 10.224.0.19
	REMOTE_PORT: 52186
	REQUEST_METHOD: GET
	REQUEST_SCHEME: https
	REQUEST_URI: ///XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar
	SCRIPT_FILENAME: /usr/share/rhn/wsgi/xmlrpc.py
	SCRIPT_NAME: /XMLRPC
	SCRIPT_URI: https://dc1-lsw01.york.lan/XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar
	SCRIPT_URL: /XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar
	SERVER_ADDR: 10.10.22.24
	SERVER_ADMIN: root at localhost
	SERVER_NAME: dc1-lsw01.york.lan
	SERVER_PORT: 443
	SERVER_PROTOCOL: HTTP/1.1
	SERVER_SIGNATURE: 
	SERVER_SOFTWARE: Apache
	UNIQUE_ID: Wl0IzKqBGMQ70RROgqQEbAAAAAE
	X-RHN-Auth: iuJRMAuvPnN8WmpEPqtELBZBj+XIDTYWwtzj1fTrFpU=
	X-RHN-Auth-Expire-Offset: 3600.0
	X-RHN-Auth-Server-Time: 1516046343.75
	X-RHN-Auth-User-Id: 
	X-RHN-Server-Id: 1000010084
	X-RHN-Transport-Capability: follow-redirects=3
	mod_wsgi.application_group: dc1-lsw01.york.lan|/xmlrpc
	mod_wsgi.callable_object: application
	mod_wsgi.enable_sendfile: 0
	mod_wsgi.handler_script: 
	mod_wsgi.input_chunked: 0
	mod_wsgi.listener_host: 
	mod_wsgi.listener_port: 443
	mod_wsgi.process_group: 
	mod_wsgi.queue_start: 1516046540708298
	mod_wsgi.request_handler: wsgi-script
	mod_wsgi.script_reloading: 1
	mod_wsgi.version: (3, 4)
	wsgi.errors: <mod_wsgi.Log object at 0x7f21c74246f0>
	wsgi.file_wrapper: <built-in method file_wrapper of mod_wsgi.Adapter object at 0x55976fbfc828>
	wsgi.input: <mod_wsgi.Input object at 0x7f21c740feb0>
	wsgi.multiprocess: True
	wsgi.multithread: False
	wsgi.run_once: False
	wsgi.url_scheme: https
	wsgi.version: (1, 0)
Extra information about this error:
Response sent back to the caller:
While running 'dep11': caught
<class 'spacewalk.server.apacheRequest.UnknownXML'> : Invalid request received (function 'dep11' invalid; path_info is /GET-REQ/xenial-backports/dep11/icons-64x64.tar).



Exception Handler Information
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/spacewalk/server/apacheRequest.py", line 134, in call_function
    func = self.method_ref(method)
  File "/usr/lib/python2.7/site-packages/spacewalk/server/apacheRequest.py", line 569, in method_ref
    method, self.req.path_info))
UnknownXML: Invalid request received (function 'dep11' invalid; path_info is /GET-REQ/xenial-backports/dep11/icons-64x64.tar).

Local variables by frame
Frame method_ref in /usr/lib/python2.7/site-packages/spacewalk/server/apacheRequest.py at line 569
	            username = <type 'str'> 
	           server_id = <type 'str'> 1000010084
	          repository = <type 'instance'> <spacewalk.server.rhnRepository.Repository instance at 0x55977036c4d0>
	                   f = <type 'NoneType'> None
	                self = <type 'instance'> <server.handlers.xmlrpc.get_handler.GetHandler instance at 0x55977045c1b8>
	                meth = <type 'str'> dep11
	              method = <type 'str'> dep11

Frame call_function in /usr/lib/python2.7/site-packages/spacewalk/server/apacheRequest.py at line 154
	               fault = <type 'int'> -1
	                self = <type 'instance'> <server.handlers.xmlrpc.get_handler.GetHandler instance at 0x55977045c1b8>
	      force_rollback = <type 'int'> 1
	              method = <type 'str'> dep11
	             exctype = <type 'type'> <class 'spacewalk.server.apacheRequest.UnknownXML'>
	              params = <type 'tuple'> ('icons-64x64.tar',)
	              e_type = <type 'type'> <class 'spacewalk.server.apacheRequest.UnknownXML'>
	             e_value = <class 'spacewalk.server.apacheRequest.UnknownXML'> Invalid request received (function 'dep11' invalid; path_info is /GET-REQ/xenial-backports/dep11/icons-64x64.tar).
	            response = <class 'xmlrpclib.Fault'> <Fault -1: "While running 'dep11': caught\n<class 'spacewalk.server.apacheRequest.UnknownXML'> : Invalid request received (function 'dep11' invalid; path_info is /GET-REQ/xenial-backports/dep11/icons-64x64.tar).\n">

Frame process in /usr/lib/python2.7/site-packages/spacewalk/server/apacheRequest.py at line 593
	                self = <type 'instance'> <server.handlers.xmlrpc.get_handler.GetHandler instance at 0x55977045c1b8>
	              params = <type 'tuple'> ('icons-64x64.tar',)
	              method = <type 'str'> dep11

Frame handler in /usr/lib/python2.7/site-packages/spacewalk/server/apacheHandler.py at line 203
	                   h = <type 'instance'> <spacewalk.server.rhnSQL.driver_postgresql.Cursor instance at 0x55977045c050>
	                self = <type 'instance'> <spacewalk.server.apacheHandler.apacheHandler instance at 0x55976fe5ee18>
	                 req = <type 'instance'> <wsgi.wsgiRequest.WsgiRequest instance at 0x5597700756c8>
	                 ret = <type 'int'> 1
	     templateStrings = <type 'dict'> {'email_account_info': '\nAccount Information:\n  Your Spacewalk login:         <login />\n  Your Spacewalk email address: <email-address />', 'email_footer': '--the Spacewalk Team', 'hostname': 'dc1-lsw01'}
	                 row = <type 'NoneType'> None

Frame handle in /usr/share/rhn/wsgi/wsgiHandler.py at line 44
	        replacements = <type 'dict'> {'Xml': 'XML', 'Actualuri': 'ActualURI', 'Md5Sum': 'MD5sum', '_': '-', 'Rhn': 'RHN'}
	      component_type = <type 'str'> server.xmlrpc
	      start_response = <type 'builtin_function_or_method'> <built-in method start_response of mod_wsgi.Adapter object at 0x55976fbfc828>
	                   k = <type 'str'> Rhn
	                 req = <type 'instance'> <wsgi.wsgiRequest.WsgiRequest instance at 0x5597700756c8>
	           parseServ = <type 'instancemethod'> <bound method apacheHandler.headerParserHandler of <spacewalk.server.apacheHandler.apacheHandler instance at 0x55976fe5ee18>>
	                 ret = <type 'int'> 0
	              server = <type 'str'> xmlrpc
	             environ = <type 'dict'> {'mod_wsgi.listener_port': '443', 'CONTEXT_DOCUMENT_ROOT': '/var/www/html', 'SERVER_SOFTWARE': 'Apache', 'SCRIPT_NAME': '/XMLRPC', 'mod_wsgi.enable_sendfile': '0', 'mod_wsgi.handler_script': '', 'SERVER_SIGNATURE': '', 'REQUEST_METHOD': 'GET', 'PATH_INFO': '/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'SERVER_PROTOCOL': 'HTTP/1.1', 'QUERY_STRING': '', 'HTTP_X_RHN_SERVER_ID': '1000010084', 'wsgi.url_scheme': 'https', 'SERVER_NAME': 'dc1-lsw01.york.lan', 'REMOTE_ADDR': '10.224.0.19', 'mod_wsgi.queue_start': '1516046540708298', 'mod_wsgi.request_handler': 'wsgi-script', 'mod_wsgi.version': (3, 4), 'HTTP_X_RHN_AUTH_SERVER_TIME': '1516046343.75', 'X-RHN-Auth-Server-Time': '1516046343.75', 'X-RHN-Transport-Capability': 'follow-redirects=3', 'PATH_TRANSLATED': '/var/www/html/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'SERVER_PORT': '443', 'wsgi.multiprocess': True, 'mod_wsgi.input_chunked': '0', 'SERVER_ADDR': '10.10.22.24', 'DOCUMENT_ROOT': 
 '/var/www/html', 'mod_wsgi.process_group': '', 'Accept-Encoding': 'identity', 'X-RHN-Auth': 'iuJRMAuvPnN8WmpEPqtELBZBj+XIDTYWwtzj1fTrFpU=', 'X-RHN-Auth-Expire-Offset': '3600.0', 'SCRIPT_FILENAME': '/usr/share/rhn/wsgi/xmlrpc.py', 'SERVER_ADMIN': 'root at localhost', 'SCRIPT_URI': 'https://dc1-lsw01.york.lan/XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'wsgi.input': <mod_wsgi.Input object at 0x7f21c740feb0>, 'HTTP_HOST': 'dc1-lsw01.york.lan', 'SCRIPT_URL': '/XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'wsgi.multithread': False, 'HTTP_X_RHN_AUTH_EXPIRE_OFFSET': '3600.0', 'mod_wsgi.callable_object': 'application', 'CONTEXT_PREFIX': '', 'REQUEST_URI': '///XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'HTTP_X_RHN_AUTH_USER_ID': '', 'Host': 'dc1-lsw01.york.lan', 'wsgi.version': (1, 0), 'X-RHN-Server-Id': '1000010084', 'GATEWAY_INTERFACE': 'CGI/1.1', 'wsgi.run_once': False, 'wsgi.errors': <mod_wsgi.Log object at 0x7f21c74246f0>, 'REMOTE_PORT': '52186', 'mod_ws
 gi.listener_host': '', 'REQUEST_SCHEME': 'https', 'HTTP_X_RHN_AUTH': 'iuJRMAuvPnN8WmpEPqtELBZBj+XIDTYWwtzj1fTrFpU=', 'HTTP_X_RHN_TRANSPORT_CAPABILITY': 'follow-redirects=3', 'mod_wsgi.application_group': 'dc1-lsw01.york.lan|/xmlrpc', 'mod_wsgi.script_reloading': '1', 'X-RHN-Auth-User-Id': '', 'wsgi.file_wrapper': <built-in method file_wrapper of mod_wsgi.Adapter object at 0x55976fbfc828>, 'HTTP_ACCEPT_ENCODING': 'identity', 'UNIQUE_ID': 'Wl0IzKqBGMQ70RROgqQEbAAAAAE'}
	                 key = <type 'str'> UNIQUE_ID
	                   v = <type 'str'> RHN
	          servertype = <type 'str'> spacewalk.server.apacheServer
	             new_key = <type 'str'> Accept-Encoding
	             appServ = <type 'instancemethod'> <bound method apacheHandler.handler of <spacewalk.server.apacheHandler.apacheHandler instance at 0x55976fe5ee18>>

Frame application in /usr/share/rhn/wsgi/xmlrpc.py at line 22
	      start_response = <type 'builtin_function_or_method'> <built-in method start_response of mod_wsgi.Adapter object at 0x55976fbfc828>
	             environ = <type 'dict'> {'mod_wsgi.listener_port': '443', 'CONTEXT_DOCUMENT_ROOT': '/var/www/html', 'SERVER_SOFTWARE': 'Apache', 'SCRIPT_NAME': '/XMLRPC', 'mod_wsgi.enable_sendfile': '0', 'mod_wsgi.handler_script': '', 'SERVER_SIGNATURE': '', 'REQUEST_METHOD': 'GET', 'PATH_INFO': '/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'SERVER_PROTOCOL': 'HTTP/1.1', 'QUERY_STRING': '', 'HTTP_X_RHN_SERVER_ID': '1000010084', 'wsgi.url_scheme': 'https', 'SERVER_NAME': 'dc1-lsw01.york.lan', 'REMOTE_ADDR': '10.224.0.19', 'mod_wsgi.queue_start': '1516046540708298', 'mod_wsgi.request_handler': 'wsgi-script', 'mod_wsgi.version': (3, 4), 'HTTP_X_RHN_AUTH_SERVER_TIME': '1516046343.75', 'X-RHN-Auth-Server-Time': '1516046343.75', 'X-RHN-Transport-Capability': 'follow-redirects=3', 'PATH_TRANSLATED': '/var/www/html/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'SERVER_PORT': '443', 'wsgi.multiprocess': True, 'mod_wsgi.input_chunked': '0', 'SERVER_ADDR': '10.10.22.24', 'DOCUMENT_ROOT': 
 '/var/www/html', 'mod_wsgi.process_group': '', 'Accept-Encoding': 'identity', 'X-RHN-Auth': 'iuJRMAuvPnN8WmpEPqtELBZBj+XIDTYWwtzj1fTrFpU=', 'X-RHN-Auth-Expire-Offset': '3600.0', 'SCRIPT_FILENAME': '/usr/share/rhn/wsgi/xmlrpc.py', 'SERVER_ADMIN': 'root at localhost', 'SCRIPT_URI': 'https://dc1-lsw01.york.lan/XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'wsgi.input': <mod_wsgi.Input object at 0x7f21c740feb0>, 'HTTP_HOST': 'dc1-lsw01.york.lan', 'SCRIPT_URL': '/XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'wsgi.multithread': False, 'HTTP_X_RHN_AUTH_EXPIRE_OFFSET': '3600.0', 'mod_wsgi.callable_object': 'application', 'CONTEXT_PREFIX': '', 'REQUEST_URI': '///XMLRPC/GET-REQ/xenial-backports/dep11/icons-64x64.tar', 'HTTP_X_RHN_AUTH_USER_ID': '', 'Host': 'dc1-lsw01.york.lan', 'wsgi.version': (1, 0), 'X-RHN-Server-Id': '1000010084', 'GATEWAY_INTERFACE': 'CGI/1.1', 'wsgi.run_once': False, 'wsgi.errors': <mod_wsgi.Log object at 0x7f21c74246f0>, 'REMOTE_PORT': '52186', 'mod_ws
 gi.listener_host': '', 'REQUEST_SCHEME': 'https', 'HTTP_X_RHN_AUTH': 'iuJRMAuvPnN8WmpEPqtELBZBj+XIDTYWwtzj1fTrFpU=', 'HTTP_X_RHN_TRANSPORT_CAPABILITY': 'follow-redirects=3', 'mod_wsgi.application_group': 'dc1-lsw01.york.lan|/xmlrpc', 'mod_wsgi.script_reloading': '1', 'X-RHN-Auth-User-Id': '', 'wsgi.file_wrapper': <built-in method file_wrapper of mod_wsgi.Adapter object at 0x55976fbfc828>, 'HTTP_ACCEPT_ENCODING': 'identity', 'UNIQUE_ID': 'Wl0IzKqBGMQ70RROgqQEbAAAAAE'}


Environment for PID=15558 on exception:
LANG = C
NOTIFY_SOCKET = /run/systemd/notify
PATH = /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin


Paul-Andre Panon
Senior systems administrator





More information about the Spacewalk-list mailing list