[Spacewalk-list] Antwort: Re: rhnpush fails with uninformative error msg

Mon May 23 14:25:16 UTC 2016

The library looks the same to me, but the URL is different.

Regards,
Robert

Mit freundlichen Grüßen

Robert Paschedag
Netlution GmbH
Landteilstr. 33
68163 Mannheim

im Auftrag des
SWR
Südwestrundfunk
Informations- und Kommunikationssysteme
Neckarstraße 230
70190 Stuttgart

Telefon +49 (0)711 /929-12654 oder
Telefon +49 (0)711 /929-13714
paschedag.netlution at swr.de

swr.de

Von:    Lachlan Musicman <datakid at gmail.com>
An:     spacewalk-list at redhat.com
Datum:  23.05.2016 04:53
Betreff:        Re: [Spacewalk-list] rhnpush fails with uninformative 
error msg
Gesendet von:   spacewalk-list-bounces at redhat.com

Ignore that, I've got dispatcher working again. That wasn't the problem 
apparently.

On the working server, when I successfully import via rhnpush, I see this 
in /var/log/httpd/access_log:

112.12.4.12 - - [23/May/2016:11:39:33 +1000] "POST /XMLRPC HTTP/1.1" 200 
11932 "-" "rhn.rpclib.py/2.5.77-1.el7"

When I do it on the server that doesn't work, I get this:

10.124.28.172 - - [23/May/2016:12:31:58 +1000] "POST /APP HTTP/1.1" 302 - 
"-" "rhn.rpclib.py/2.5.77-1.el7"

So I'm getting a different HTTP codes in my apache server for this 
rhn.rpclib.py....

L.

------
The most dangerous phrase in the language is, "We've always done it this 
way."

- Grace Hopper

On 23 May 2016 at 10:53, Lachlan Musicman <datakid at gmail.com> wrote:
Hmm. It looks like my osa-dispatcher isn't starting. Where are the 
osa-dispatcher config files?

cheers
L.

------
The most dangerous phrase in the language is, "We've always done it this 
way."

- Grace Hopper

On 23 May 2016 at 10:29, Lachlan Musicman <datakid at gmail.com> wrote:
No one has seen this error before? No one can even give me pointers on 
where to start looking for a solution?

It almost certainly seems to be a tomcat issue - that either the rhnpush 
isn't getting through a proxy (??! wtf) or it is an is failing on the 
other side of the proxy because some other reason?

I've check the tomcat conf on both servers - they are the same (as 
necessary). The rhn is set up as identically as possible, the server OS is 
the same revision...I don't understand. The only discernable difference is 
that one is a VMWare VM and one is a stand alone installation.

Cheers

L.

------
The most dangerous phrase in the language is, "We've always done it this 
way."

- Grace Hopper

On 20 May 2016 at 16:32, Lachlan Musicman <datakid at gmail.com> wrote:
In centos 7.2, using 

[root at vmpr-res-utils 16.05-rc2]# yum whatprovides rhnpush

rhnpush-5.5.89-1.el7.noarch : Package uploader for the Spacewalk or Red 
Hat Satellite Server
Repo        : spacewalk

rhnpush-5.5.89-1.el7.noarch : Package uploader for the Spacewalk or Red 
Hat Satellite Server
Repo        : @spacewalk

[root at vmpr-res-utils 16.05-rc2]# rhnpush --server localhost -u admin 
--channel slurm_16_05_rc2 *rpm --nosig         
Password: 

ERROR: unhandled exception occurred: (mismatched tag: line 164, column 2).

No logs are created at all (I've deleted them all and checked).

There is a log in /var/log/tomcat/localhost_access_{date}.txt

::1 - - [20/May/2016:13:29:49 +1000] "GET /rhn/errors/500.jsp HTTP/1.1" 
302 -
::1 - - [20/May/2016:13:29:49 +1000] "POST /rhn/errors/500.jsp HTTP/1.1" 
302 -
::1 - - [20/May/2016:13:29:50 +1000] "POST 
/rhn/Login.do?url_bounce=/rhn/errors/500.jsp&request_method=POST HTTP/1.1" 
200 5967

Note here that it's defaulting to IPv6 address. 

If I use the fqdn/hostname (same thing) I get it using the ipv4, same 
problem:

10.126.18.72 - - [20/May/2016:13:58:00 +1000] "GET /rhn/errors/500.jsp 
HTTP/1.1" 302 -
10.126.18.72 - - [20/May/2016:13:58:00 +1000] "POST /rhn/errors/500.jsp 
HTTP/1.1" 302 -
10.126.18.72 - - [20/May/2016:13:58:00 +1000] "POST 
/rhn/Login.do?url_bounce=/rhn/errors/500.jsp&request_method=POST HTTP/1.1" 
200 5967

Note that the username and password are correct - I've tested 100 times, 
and I'm also logged into the website, *using the same credentials*.

Further frustration is caused by the fact that I have it working on 
another server (and another domain/ip range), which was set up 
identically, runs the same software, and it works.

....

OK, I tried to add the server to itself as a system with 

rhnreg_ks --serverUrl=https://server/XMLRPC 
--sslCACert=/usr/share/rhn/RHN-ORG-TRUSTED-SSL-CERT --activationkey=1-x

and that also failed. 

Then I went into /var/log/up2date and noticed that the error was the same:
Traceback (most recent call last):
  File "/usr/sbin/rhnreg_ks", line 216, in <module>
    cli.run()
  File "/usr/share/rhn/up2date_client/rhncli.py", line 96, in run
    sys.exit(self.main() or 0)
  File "/usr/sbin/rhnreg_ks", line 91, in main
    rhnreg.getCaps()
  File "/usr/share/rhn/up2date_client/rhnreg.py", line 248, in getCaps
    s.capabilities.validate()
  File "/usr/share/rhn/up2date_client/rhnserver.py", line 178, in 
__get_capabilities
    self.registration.welcome_message()
  File "/usr/share/rhn/up2date_client/rhnserver.py", line 63, in __call__
    return rpcServer.doCall(method, *args, **kwargs)
  File "/usr/share/rhn/up2date_client/rpcServer.py", line 203, in doCall
    ret = method(*args, **kwargs)
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1233, in __call__
    return self.__send(self.__name, args)
  File "/usr/share/rhn/up2date_client/rpcServer.py", line 37, in _request1
    ret = self._request(methodname, params)
  File "/usr/lib/python2.7/site-packages/rhn/rpclib.py", line 384, in 
_request
    self._handler, request, verbose=self._verbose)
  File "/usr/lib/python2.7/site-packages/rhn/transports.py", line 187, in 
request
    return self._process_response(fd, connection)
  File "/usr/lib/python2.7/site-packages/rhn/transports.py", line 215, in 
_process_response
    return self.parse_response(fd)
  File "/usr/lib/python2.7/site-packages/rhn/transports.py", line 235, in 
parse_response
    p.feed(response)
  File "/usr/lib64/python2.7/xmlrpclib.py", line 558, in feed
    self._parser.Parse(data, 0)
<class 'xml.parsers.expat.ExpatError'>: mismatched tag: line 164, column 2

which lead me to this:

https://bugzilla.redhat.com/show_bug.cgi?id=1277623

but both of my systems have

python-debian-0.1.27-3.el7.noarch and python-six-1.9.0-2.el7.noarch

I'm reticent to downgrade since I don't know what else that will affect, 
and it's *working* on one of the servers without the downgrade?

I saw this reddit thread:

https://www.reddit.com/r/spacewalk/comments/3vnquh/centos_71_spacewalk_24_no_go/

but I wont try the solution(s) in the last comment bc both files in both 
systems are currently the same, so they are obv not the issue.

I tried the patch shown here:

https://www.redhat.com/archives/spacewalk-list/2015-November/msg00108.html

But it just output a whole bunch of blather - looks like something is 
being chomped though - either time out or buffer length or...?

asdIncoming headers:
    content-length : 5966
    set-cookie : JSESSIONID=69C01EA51CB966ABC58B3188A956B119; Path=/rhn/; 
Secure; HttpOnly; HttpOnly
    server : Apache
    x-ua-compatible : IE=edge,chrome=1
    date : Fri, 20 May 2016 06:17:12 GMT
    content-type : text/html;charset=UTF-8
('body:', '\'<!DOCTYPE HTML>\\n<html>\\n  <head>\\n    <!-- enclosing head 
tags in layout_c.jsp -->\\n    <meta http-equiv="X-UA-Compatible" 
content="IE=edge"/>\\n    <!-- HTML5 shim and Respond.js IE8 support of 
HTML5 elements and media queries -->\\n    <!--[if lt IE 9]>\\n      
<script type=\\\'text/javascript\\\' 
src="/javascript/html5.js"></script>\\n      <script 
type=\\\'text/javascript\\\' src="/javascript/respond.js"></script>\\n    
<![endif]-->\\n    \\n    <meta http-equiv="content-type" 
content="text/html;charset=UTF-8"/>\\n    <title>\\n      
Spacewalk\\n      \\n      \\n         - Sign In\\n      \\n      \\n    
</title>\\n    <link rel="shortcut icon" href="/img/favicon.ico" 
/>\\n\\n    <meta name="viewport" content="width=device-width, 
initial-scale=1.0" />\\n\\n    \\n    \\n      <link rel="stylesheet" 
href="/css/spacewalk.css" />\\n    \\n    <link rel="stylesheet" 
href="/css/jquery.timepicker.css" />\\n    <link rel="stylesheet" 
href="/css/bootstrap-datepicker.css" />\\n\\n    <link rel="stylesheet" 
href="/javascript/select2/select2.css" />\\n    <link rel="stylesheet" 
href="\'')
('body:', '\'/javascript/select2/select2-bootstrap.css" />\\n\\n    <link 
rel="stylesheet" href="/fonts/font-awesome/css/font-awesome.css" />\\n    
<link rel="stylesheet" href="/fonts/font-spacewalk/css/spacewalk-font.css" 
/>\\n\\n    <script src="/javascript/jquery.js"></script>\\n    <script 
src="/javascript/bootstrap.js"></script>\\n    <script 
src="/javascript/select2/select2.js"></script>\\n    <script 
src="/javascript/spacewalk-essentials.js"></script>\\n    <script 
src="/javascript/spacewalk-checkall.js"></script>\\n\\n    <script 
src="/rhn/dwr/engine.js"></script>\\n    <script 
src="/rhn/dwr/util.js"></script>\\n    <script 
src="/rhn/dwr/interface/DWRItemSelector.js"></script>\\n    <script 
src="/javascript/jquery.timepicker.js"></script>\\n    <script 
src="/javascript/bootstrap-datepicker.js"></script>\\n\\n    <meta 
name="decorator" content="layout_c" />\\n  <script 
src="/javascript/spacewalk-login.js"></script>\\n  </head>\\n  <body 
onload="">\\n    <div class="spacewalk-top-wrap">\\n      <nav 
class="navbar navbar-default navbar-pf" role="navigation">\\n \'')
('body:', '\'       \\n\\n\\n\\n<!-- header.jsp -->\\n\\n\\n\\n<div 
class="navbar-header">\\n  <button type="button" class="navbar-toggle" 
data-toggle="collapse" data-target=".navbar-collapse">\\n    <span 
class="sr-only">Toggle navigation</span>\\n    <span 
class="icon-bar"></span>\\n    <span class="icon-bar"></span>\\n    <span 
class="icon-bar"></span>\\n  </button>\\n  <a class="navbar-brand" href="
http://www.spacewalkproject.org/" title="Visit 
http://www.spacewalkproject.org/ for more information">\\n    <img 
src="/img/logo_vendor.png" alt="Spacewalk project" id="rhLogo" />\\n  
</a>\\n  <a class="navbar-brand" href="/" title="Spacewalk 
homepage">\\n    <img src="/img/logo_product.png" alt="Spacewalk" 
id="rhnLogo" accesskey="2"/>\\n  </a>\\n  \\n</div>\\n\\n<div 
class="navbar-collapse collapse">\\n  \\n\\n  \\n  \\n    <ul class="nav 
navbar-nav navbar-primary"><li class="active"><a href="/rhn/Login.do">Sign 
In</a></li>\\n<li><a href="/rhn/help/about.do">About</a></li>\\n</ul>\\n  
\\n</div>\\n<!-- end header.jsp -->\\n\\n      </nav>\\n      <div 
class="spacewalk-main-column-layout">\\n       \'')
('body:', '\' <aside id="spacewalk-aside" class="navbar-collapse 
collapse">\\n          \\n\\n<nav id="sidenav">\\n  \\n  \\n  \\n  
\\n</nav>\\n\\n          \\n\\n\\n\\n\\n\\n          \\n\\n\\n<!-- TODO 
make this more generic -->\\n\\n\\n\\n        </aside>\\n        <section 
id="spacewalk-content">\\n          <!-- Alerts and messages 
-->\\n          \\n          \\n          <div class="text-center">\\n    
\\n    \\n      \\n      \\n        <h1>Welcome to 
Spacewalk</h1>\\n        <p><strong>Spacewalk</strong> is an open source 
(GPLv2) Linux systems management solution. Below are some links that 
should prove useful if you have any questions regarding your Spacewalk 
server. </p>\\n      \\n    \\n\\n    <form name="loginForm" 
id="loginForm" method="post" 
action="/rhn/LoginSubmit.do;jsessionid=69C01EA51CB966ABC58B3188A956B119" 
class="form-horizontal col-md-6 col-md-offset-3 text-left">\\n      <input 
type="hidden" name="csrf_token" value="7530790251516499651">\\n      
\\n\\n    \\n    \\n    \\n    \\n    \\n    \\n    \\n\\n\\n<div 
class="form-group">\\n  <label for="username-field" class="col-xs-5 
control-label">Spacewal\'')
('body:', '\'k Login: </label>\\n  <div class="col-xs-7">\\n    <input 
type="text" id="username-field" class="form-control" tabindex="1" 
name="username" maxlength="63" placeholder="Login" />\\n  
</div>\\n</div>\\n\\n<div class="form-group">\\n  <label 
for="password-field" class="col-xs-5 control-label">Password: </label>\\n  
<div class="col-xs-7">\\n    <input type="password" id="password-field" 
class="form-control" tabindex="2" name="password" maxlength="32" 
placeholder="Password" />\\n  </div>\\n</div>\\n\\n<div 
class="text-right">\\n  <input type="hidden" name="login_cb" 
value="login">\\n   <input type="hidden" name="url_bounce" 
value="/rhn/errors/500.jsp">\\n   <input type="hidden" 
name="request_method" value="GET">\\n  <input type="submit" tabindex="3" 
value="Sign In" id="login" class="btn btn-primary">\\n</div>\\n\\n    
</form>\\n    <div class="col-md-6 col-md-offset-3 text-left">\\n    
\\n    \\n      \\n      \\n          <p>For details on Spacewalk, please 
visit our web-site at <a href="http://www.spacewalkproject.org/" 
target="_blank"> http://www.spacewalkprojec\'')

Would appreciate any ideas people might have?

cheers
L.

------
The most dangerous phrase in the language is, "We've always done it this 
way."

- Grace Hopper

_______________________________________________
Spacewalk-list mailing list
Spacewalk-list at redhat.com
https://www.redhat.com/mailman/listinfo/spacewalk-list

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/spacewalk-list/attachments/20160523/fb7b2895/attachment.htm>