[Spacewalk-list] proxy not updating after install of new OS release on master

Mon May 6 21:38:55 UTC 2019

Hi!
I am upgrading from CentOS 7.4 to 7.6 and have added the new 7.6 channel on
my master . . .  I have modified my kickstart to point to the new release,
however the proxy is not sending the squashfs.img file upon request.  I
can't even curl it from the proxy.  I get the following error in my apache
log on the proxy:

[Wed May 01 09:53:37.244532 2019] [:error] [pid 22642] Exception reported
from nyc-pkgms-lv01.schrodinger.com
[Wed May 01 09:53:37.244569 2019] [:error] [pid 22642] Time: Wed May  1
09:53:37 2019
[Wed May 01 09:53:37.244573 2019] [:error] [pid 22642] Exception type
<class 'socket.timeout'>
[Wed May 01 09:53:37.244577 2019] [:error] [pid 22642] Exception while
handling function SharedHandler._serverCommo
[Wed May 01 09:53:37.244581 2019] [:error] [pid 22642] Request object
information:
[Wed May 01 09:53:37.244584 2019] [:error] [pid 22642] URI:
/ks/dist/org/1/centos7-base-x86_64/LiveOS/squashfs.img
[Wed May 01 09:53:37.244587 2019] [:error] [pid 22642] Remote Host:
172.18.9.25
[Wed May 01 09:53:37.244590 2019] [:error] [pid 22642] Server Name:
nyc-pkgms-lv01.schrodinger.com:80
[Wed May 01 09:53:37.244594 2019] [:error] [pid 22642] Headers passed in:
[Wed May 01 09:53:37.244597 2019] [:error] [pid 22642] \tAccept: */*
[Wed May 01 09:53:37.244600 2019] [:error] [pid 22642]
\tCONTEXT_DOCUMENT_ROOT: /var/www/html
[Wed May 01 09:53:37.244603 2019] [:error] [pid 22642] \tCONTEXT_PREFIX:
[Wed May 01 09:53:37.244606 2019] [:error] [pid 22642] \tDOCUMENT_ROOT:
/var/www/html
[Wed May 01 09:53:37.244609 2019] [:error] [pid 22642] \tGATEWAY_INTERFACE:
CGI/1.1
[Wed May 01 09:53:37.244612 2019] [:error] [pid 22642] \tHTTP_ACCEPT: */*
[Wed May 01 09:53:37.244615 2019] [:error] [pid 22642] \tHTTP_HOST:
nyc-pkgms-lv01.schrodinger.com
[Wed May 01 09:53:37.244618 2019] [:error] [pid 22642] \tHTTP_USER_AGENT:
curl/7.29.0
[Wed May 01 09:53:37.244621 2019] [:error] [pid 22642]
\tHTTP_X_ANACONDA_ARCHITECTURE:
x86_64
[Wed May 01 09:53:37.244624 2019] [:error] [pid 22642]
\tHTTP_X_ANACONDA_SYSTEM_RELEASE: CentOS
[Wed May 01 09:53:37.244627 2019] [:error] [pid 22642] \tHost:
nyc-pkgms-lv01.schrodinger.com
[Wed May 01 09:53:37.244630 2019] [:error] [pid 22642] \tPATH_INFO:
/dist/org/1/centos7-base-x86_64/LiveOS/squashfs.img
[Wed May 01 09:53:37.244633 2019] [:error] [pid 22642] \tPATH_TRANSLATED:
/var/www/html/dist/org/1/centos7-base-x86_64/LiveOS/squashfs.img
[Wed May 01 09:53:37.244637 2019] [:error] [pid 22642] \tQUERY_STRING:
[Wed May 01 09:53:37.244640 2019] [:error] [pid 22642] \tREMOTE_ADDR:
172.18.9.25
[Wed May 01 09:53:37.244643 2019] [:error] [pid 22642] \tREMOTE_PORT: 38484
[Wed May 01 09:53:37.244646 2019] [:error] [pid 22642] \tREQUEST_METHOD: GET
[Wed May 01 09:53:37.244649 2019] [:error] [pid 22642] \tREQUEST_SCHEME:
http
[Wed May 01 09:53:37.244652 2019] [:error] [pid 22642] \tREQUEST_URI:
/ks/dist/org/1/centos7-base-x86_64/LiveOS/squashfs.img
[Wed May 01 09:53:37.244655 2019] [:error] [pid 22642] \tSCRIPT_FILENAME:
/usr/share/rhn/wsgi/xmlrpc.py
[Wed May 01 09:53:37.244659 2019] [:error] [pid 22642] \tSCRIPT_NAME: /ks
[Wed May 01 09:53:37.244662 2019] [:error] [pid 22642] \tSCRIPT_URI:
http://nyc-pkgms-lv01.schrodinger.com/ks/dist/org/1/centos7-base-x86_64/LiveOS/squashfs.img
[Wed May 01 09:53:37.244665 2019] [:error] [pid 22642] \tSCRIPT_URL:
/ks/dist/org/1/centos7-base-x86_64/LiveOS/squashfs.img
[Wed May 01 09:53:37.244668 2019] [:error] [pid 22642] \tSERVER_ADDR:
172.18.4.65
[Wed May 01 09:53:37.244671 2019] [:error] [pid 22642] \tSERVER_ADMIN:
root at localhost
[Wed May 01 09:53:37.244674 2019] [:error] [pid 22642] \tSERVER_NAME:
nyc-pkgms-lv01.schrodinger.com
[Wed May 01 09:53:37.244677 2019] [:error] [pid 22642] \tSERVER_PORT: 80
[Wed May 01 09:53:37.244680 2019] [:error] [pid 22642] \tSERVER_PROTOCOL:
HTTP/1.1
[Wed May 01 09:53:37.244683 2019] [:error] [pid 22642] \tSERVER_SIGNATURE:
[Wed May 01 09:53:37.244686 2019] [:error] [pid 22642] \tSERVER_SOFTWARE:
Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips mod_wsgi/3.4 Python/2.7.5
[Wed May 01 09:53:37.244704 2019] [:error] [pid 22642] \tUNIQUE_ID:
XMmkaWXwRKo2zJygVH2NzAAAAAI
[Wed May 01 09:53:37.244708 2019] [:error] [pid 22642] \tUser-Agent:
curl/7.29.0
[Wed May 01 09:53:37.244712 2019] [:error] [pid 22642]
\tX-Anaconda-Architecture: x86_64
[Wed May 01 09:53:37.244715 2019] [:error] [pid 22642]
\tX-Anaconda-System-Release: CentOS
[Wed May 01 09:53:37.244718 2019] [:error] [pid 22642]
\tmod_wsgi.application_group: nyc-pkgms-lv01.schrodinger.com|/ks
[Wed May 01 09:53:37.244721 2019] [:error] [pid 22642]
\tmod_wsgi.callable_object: application
[Wed May 01 09:53:37.244724 2019] [:error] [pid 22642]
\tmod_wsgi.enable_sendfile: 0
[Wed May 01 09:53:37.244727 2019] [:error] [pid 22642]
\tmod_wsgi.handler_script:
[Wed May 01 09:53:37.244730 2019] [:error] [pid 22642]
\tmod_wsgi.input_chunked: 0
[Wed May 01 09:53:37.244733 2019] [:error] [pid 22642]
\tmod_wsgi.listener_host:
[Wed May 01 09:53:37.244737 2019] [:error] [pid 22642]
\tmod_wsgi.listener_port: 80
[Wed May 01 09:53:37.244740 2019] [:error] [pid 22642]
\tmod_wsgi.process_group:
[Wed May 01 09:53:37.244743 2019] [:error] [pid 22642]
\tmod_wsgi.queue_start: 1556718697157324
[Wed May 01 09:53:37.244746 2019] [:error] [pid 22642]
\tmod_wsgi.request_handler: wsgi-script
[Wed May 01 09:53:37.244749 2019] [:error] [pid 22642]
\tmod_wsgi.script_reloading: 1
[Wed May 01 09:53:37.244752 2019] [:error] [pid 22642] \tmod_wsgi.version:
(3, 4)
[Wed May 01 09:53:37.244755 2019] [:error] [pid 22642] \twsgi.errors:
<mod_wsgi.Log object at 0x55e380bc98f0>
[Wed May 01 09:53:37.244759 2019] [:error] [pid 22642] \twsgi.file_wrapper:
<built-in method file_wrapper of mod_wsgi.Adapter object at 0x55e380cbe6c0>
[Wed May 01 09:53:37.244762 2019] [:error] [pid 22642] \twsgi.input:
<cStringIO.StringO object at 0x55e380f71e30>
[Wed May 01 09:53:37.244765 2019] [:error] [pid 22642] \twsgi.multiprocess:
True
[Wed May 01 09:53:37.244768 2019] [:error] [pid 22642] \twsgi.multithread:
False
[Wed May 01 09:53:37.244771 2019] [:error] [pid 22642] \twsgi.run_once:
False
[Wed May 01 09:53:37.244775 2019] [:error] [pid 22642] \twsgi.url_scheme:
http
[Wed May 01 09:53:37.244778 2019] [:error] [pid 22642] \twsgi.version: (1,
0)
[Wed May 01 09:53:37.244781 2019] [:error] [pid 22642]
[Wed May 01 09:53:37.244784 2019] [:error] [pid 22642] Exception Handler
Information
[Wed May 01 09:53:37.244787 2019] [:error] [pid 22642] Traceback (most
recent call last):
[Wed May 01 09:53:37.244790 2019] [:error] [pid 22642]   File
"/usr/share/rhn/proxy/rhnShared.py", line 210, in _serverCommo
[Wed May 01 09:53:37.244793 2019] [:error] [pid 22642]     status, headers,
bodyFd = self._proxy2server()
[Wed May 01 09:53:37.244796 2019] [:error] [pid 22642]   File
"/usr/share/rhn/proxy/rhnShared.py", line 385, in _proxy2server
[Wed May 01 09:53:37.244800 2019] [:error] [pid 22642]     response =
http_connection.getresponse()
[Wed May 01 09:53:37.244803 2019] [:error] [pid 22642]   File
"/usr/lib/python2.7/site-packages/rhn/connections.py", line 102, in
getresponse
[Wed May 01 09:53:37.244806 2019] [:error] [pid 22642]     response.begin()
[Wed May 01 09:53:37.244809 2019] [:error] [pid 22642]   File
"/usr/lib64/python2.7/httplib.py", line 444, in begin
[Wed May 01 09:53:37.244812 2019] [:error] [pid 22642]     version, status,
reason = self._read_status()
[Wed May 01 09:53:37.244816 2019] [:error] [pid 22642]   File
"/usr/lib64/python2.7/httplib.py", line 400, in _read_status
[Wed May 01 09:53:37.244819 2019] [:error] [pid 22642]     line =
self.fp.readline(_MAXLINE + 1)
[Wed May 01 09:53:37.244822 2019] [:error] [pid 22642]   File
"/usr/lib64/python2.7/socket.py", line 476, in readline
[Wed May 01 09:53:37.244825 2019] [:error] [pid 22642]     data =
self._sock.recv(self._rbufsize)
[Wed May 01 09:53:37.244828 2019] [:error] [pid 22642] timeout: timed out
[Wed May 01 09:53:37.244834 2019] [:error] [pid 22642]
[Wed May 01 09:53:48.826978 2019] [:error] [pid 22863] [client
172.18.4.65:55712] mod_wsgi (pid=22863): Exception occurred processing WSGI
script '/usr/share/rhn/wsgi/xmlrpc.py'.
[Wed May 01 09:53:48.827058 2019] [:error] [pid 22863] [client
172.18.4.65:55712] IOError: failed to write data

I see "IOError: failed to write data" and "timeout: timed out" but I can't
tell where this is going wrong.  Does anyone have a recommendation for how
to debug xmlrpc.py?

Thanks,
Guy
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/spacewalk-list/attachments/20190506/8b3e0974/attachment.htm>