<div dir="ltr"><div class="gmail_default" style="color:rgb(0,0,0)">I have about 3000 systems registered in spacewalk, but today we are focusing on applying package updates to 22 of them. Of the 22 systems scheduled to have security errata applied to them, 20 successfully completed the update without error. Unfortunately, there are two systems which have the task queued and have not picked it up yet.</div><div class="gmail_default" style="color:rgb(0,0,0)"><br></div><div class="gmail_default" style="color:rgb(0,0,0)">I have restarted osad, rhnsd, restarted jabberd on the spacewalk master and proxy through which these failed systems connect. Other clients which have successfully updated go through this proxy server as well.</div><div class="gmail_default" style="color:rgb(0,0,0)"><br></div><div class="gmail_default" style="color:rgb(0,0,0)">When looking at the GUI, the client appears to be healthy.</div><div class="gmail_default" style="color:rgb(0,0,0)"><br></div><div class="gmail_default" style="color:rgb(0,0,0)"><img src="cid:ii_14de3ec580cc87d3" alt="Inline image 1" width="533" height="286"><br></div><div class="gmail_default" style="color:rgb(0,0,0)"><br></div><div class="gmail_default" style="color:rgb(0,0,0)">These are the scheduled tasks:</div><div class="gmail_default" style="color:rgb(0,0,0)"><br></div><div class="gmail_default" style="color:rgb(0,0,0)"><img src="cid:ii_14de3ecb4590596c" alt="Inline image 2" width="533" height="298"><br></div><div class="gmail_default" style="color:rgb(0,0,0)"><br></div><div class="gmail_default" style="color:rgb(0,0,0)">Doing 'rhn_check -vvvv' over and over doesn't seem to do anything. I am not sure what else to check. No firewall is configured either on the client or the server. I am using the run plugins to install packages, so i know at least that is working.</div><div class="gmail_default" style="color:rgb(0,0,0)"><br></div><div class="gmail_default" style="color:rgb(0,0,0)">Here is nmap from the client to the proxy:</div><div class="gmail_default" style="color:rgb(0,0,0)"><br></div><div class="gmail_default" style="color:rgb(0,0,0)"><div class="gmail_default">Host is up (0.00017s latency).</div><div class="gmail_default">rDNS record for <a href="http://10.122.13.142">10.122.13.142</a>: proxy.domain.tld</div><div class="gmail_default">Not shown: 990 closed ports</div><div class="gmail_default">PORT STATE SERVICE</div><div class="gmail_default">22/tcp open ssh</div><div class="gmail_default">25/tcp open smtp</div><div class="gmail_default">80/tcp open http</div><div class="gmail_default">111/tcp open rpcbind</div><div class="gmail_default">443/tcp open https</div><div class="gmail_default">465/tcp open smtps</div><div class="gmail_default">587/tcp open submission</div><div class="gmail_default">5222/tcp open xmpp-client</div><div class="gmail_default">5269/tcp open xmpp-server</div><div class="gmail_default">8080/tcp open http-proxy</div><div class="gmail_default"><br></div><div class="gmail_default"><br></div></div><div class="gmail_default" style="color:rgb(0,0,0)"><br></div><div class="gmail_default" style="color:rgb(0,0,0)"><div class="" id="source" style="font-family:monospace"><ol><li class=""><div class=""># service osad status</div></li>
<li class=""><div class="">osad <span class="">(</span>pid <span class="">1842</span><span class="">)</span> is running...</div></li>
<li class=""><div class=""> </div></li>
<li class=""><div class=""># rhn-actions-control --report</div></li>
<li class=""><div class="">deploy is enabled</div></li>
<li class=""><div class="">diff is enabled</div></li>
<li class=""><div class="">upload is enabled</div></li>
<li class=""><div class="">mtime_upload is enabled</div></li>
<li class=""><div class="">run is enabled</div></li>
<li class=""><div class=""> </div></li>
<li class=""><div class=""> </div></li>
<li class=""><div class=""># rhn_check -vvv</div></li>
<li class=""><div class="">D: opening db environment /var/lib/rpm cdb:mpool:joinenv</div></li>
<li class=""><div class="">D: opening db index /var/lib/rpm/Packages rdonly mode=0x0</div></li>
<li class=""><div class="">D: locked db index /var/lib/rpm/Packages</div></li>
<li class=""><div class="">D: loading keyring from pubkeys in /var/lib/rpm/pubkeys/*.key</div></li>
<li class=""><div class="">D: couldn't find any keys in /var/lib/rpm/pubkeys/*.key</div></li>
<li class=""><div class="">D: loading keyring from rpmdb</div></li>
<li class=""><div class="">D: opening db index /var/lib/rpm/Name rdonly mode=0x0</div></li>
<li class=""><div class="">D: added key gpg-pubkey-c105b9de-4e0fd3a3 to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-0608b895-4bd22942 to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-442df0f8-4783f24a to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-548c16bf-4c29a642 to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-217521f6-45e8a532 to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-863a853d-4f55f54d to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-1bb35891-54f75af8 to keyring</div></li>
<li class=""><div class="">D: Using legacy gpg-pubkey<span class="">(</span>s<span class="">)</span> from rpmdb</div></li>
<li class=""><div class="">D: opening db index /var/lib/rpm/Providename rdonly mode=0x0</div></li>
<li class=""><div class="">D: do_call packages.checkNeedUpdate<span class="">(</span>'rhnsd=<span class="">1</span>',<span class="">)</span><span class="">{</span><span class="">}</span></div></li>
<li class=""><div class="">D: opening db environment /var/lib/rpm cdb:mpool:joinenv</div></li>
<li class=""><div class="">D: opening db index /var/lib/rpm/Packages rdonly mode=0x0</div></li>
<li class=""><div class="">D: loading keyring from pubkeys in /var/lib/rpm/pubkeys/*.key</div></li>
<li class=""><div class="">D: couldn't find any keys in /var/lib/rpm/pubkeys/*.key</div></li>
<li class=""><div class="">D: loading keyring from rpmdb</div></li>
<li class=""><div class="">D: opening db index /var/lib/rpm/Name rdonly mode=0x0</div></li>
<li class=""><div class="">D: added key gpg-pubkey-c105b9de-4e0fd3a3 to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-0608b895-4bd22942 to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-442df0f8-4783f24a to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-548c16bf-4c29a642 to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-217521f6-45e8a532 to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-863a853d-4f55f54d to keyring</div></li>
<li class=""><div class="">D: added key gpg-pubkey-1bb35891-54f75af8 to keyring</div></li>
<li class=""><div class="">D: Using legacy gpg-pubkey<span class="">(</span>s<span class="">)</span> from rpmdb</div></li>
<li class=""><div class="">D: opening db index /var/lib/rpm/Providename rdonly mode=0x0</div></li>
<li class=""><div class="">D: closed db index /var/lib/rpm/Providename</div></li>
<li class=""><div class="">D: closed db index /var/lib/rpm/Name</div></li>
<li class=""><div class="">D: closed db index /var/lib/rpm/Packages</div></li>
<li class=""><div class="">D: closed db environment /var/lib/rpm</div></li>
<li class=""><div class="">Loaded plugins: fastestmirror, presto, rhnplugin</div></li>
<li class=""><div class="">Config time: <span class="">0.038</span></div></li>
<li class=""><div class="">D: login<span class="">(</span>forceUpdate=False<span class="">)</span> invoked</div></li>
<li class=""><div class="">D: readCachedLogin invoked</div></li>
<li class=""><div class="">D: Unable to read pickled loginInfo at: /var/spool/up2date/loginAuth.pkl</div></li>
<li class=""><div class="">logging into up2date server</div></li>
<li class=""><div class="">D: rpcServer: Calling XMLRPC up2date.login</div></li>
<li class=""><div class="">D: writeCachedLogin<span class="">(</span><span class="">)</span> invoked</div></li>
<li class=""><div class="">D: Wrote pickled loginInfo at <span class="">1434032930.09</span> with expiration of <span class="">1434036530.09</span> seconds.</div></li>
<li class=""><div class="">successfully retrieved authentication token from up2date server</div></li>
<li class=""><div class="">D: logininfo:<span class="">{</span>'X-RHN-Server-Id': <span class="">1000010314</span>, 'X-RHN-Auth-Server-Time': '<span class="">1434032926.38</span>', 'X-RHN-Auth': '7RfB/XtV6EqZw8hGYqe+dFasQ+3q9QvfIzO+RrKIdd0=', 'X-RHN-Auth-Channels': <span class="">[</span><span class="">[</span>'centos6-base-x86_64', '<span class="">20150611060001</span>', '<span class="">1</span>', '<span class="">1</span>'<span class="">]</span>, <span class="">[</span>'spacewalk-client-x86_64', '<span class="">20150611061143</span>', '<span class="">0</span>', '<span class="">1</span>'<span class="">]</span>, <span class="">[</span>'epel6-x86_64', '<span class="">20150611061143</span>', '<span class="">0</span>', '<span class="">1</span>'<span class="">]</span>, <span class="">[</span>'centos6-sysops-x86_64', '<span class="">20150504165024</span>', '<span class="">0</span>', '<span class="">1</span>'<span class="">]</span>, <span class="">[</span>'centos6-updates-x86_64', '<span class="">20150611060258</span>', '<span class="">0</span>', '<span class="">1</span>'<span class="">]</span><span class="">]</span>, 'X-RHN-Auth-User-Id': '', 'X-RHN-Auth-Expire-Offset': '<span class="">3600.0</span>'<span class="">}</span></div></li>
<li class=""><div class="">D: rpcServer: Calling XMLRPC up2date.listChannels</div></li>
<li class=""><div class="">This system is receiving updates from RHN Classic or Red Hat Satellite.</div></li>
<li class=""><div class="">Setting up Package Sacks</div></li>
<li class=""><div class="">Loading mirror speeds from cached hostfile</div></li>
<li class=""><div class="">pkgsack time: <span class="">0.065</span></div></li>
<li class=""><div class="">rpmdb time: <span class="">0.000</span></div></li>
<li class=""><div class="">Loading mirror speeds from cached hostfile</div></li>
<li class=""><div class="">repo time: <span class="">0.000</span></div></li>
<li class=""><div class="">D: local action status: <span class="">(</span><span class="">0</span>, 'rpm database not modified since last update <span class="">(</span>or package list recently updated<span class="">)</span>', <span class="">{</span><span class="">}</span><span class="">)</span></div></li>
<li class=""><div class="">D: rpcServer: Calling XMLRPC registration.welcome_message</div></li>
<li class=""><div class="">D: closed db index /var/lib/rpm/Providename</div></li>
<li class=""><div class="">D: closed db index /var/lib/rpm/Name</div></li>
<li class=""><div class="">D: closed db index /var/lib/rpm/Packages</div></li>
<li class=""><div class="">D: closed db environment /var/lib/rpm</div></li></ol></div></div><div><div class="gmail_signature"><div><font color="#999999">BM</font></div></div></div>
</div>