<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style></style></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1>Since upgrading to v1.2, I’m no longer able to view “Completed Actions” under the Schedule tab. When I click on it, the server takes about 60 seconds to timeout and then just returns me an Apache page that the server is unresponsive. I can see in the httpd logs that the AJP connection to the tomcat server is lost as if this request is completely killing the tomcat server. I don’t get much in the catalina.out when this is going on, but after it finally times out, I get this error:<o:p></o:p><o:p> </o:p>Dec 10, 2010 6:19:42 AM org.apache.jk.core.MsgContext action<o:p></o:p>WARNING: Error sending end packet<o:p></o:p>java.net.SocketException: Broken pipe<o:p></o:p> at java.net.SocketOutputStream.socketWrite0(Native Method)<o:p></o:p> at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)<o:p></o:p> at java.net.SocketOutputStream.write(SocketOutputStream.java:136)<o:p></o:p> at org.apache.jk.common.ChannelSocket.send(ChannelSocket.java:538)<o:p></o:p> at org.apache.jk.common.JkInputStream.endMessage(JkInputStream.java:127)<o:p></o:p> at org.apache.jk.core.MsgContext.action(MsgContext.java:302)<o:p></o:p> at org.apache.coyote.Response.action(Response.java:183)<o:p></o:p> at org.apache.coyote.Response.finish(Response.java:305)<o:p></o:p> at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:205)<o:p></o:p> at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:291)<o:p></o:p> at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:775)<o:p></o:p> at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:704)<o:p></o:p> at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:897)<o:p></o:p> at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:685)<o:p></o:p> at java.lang.Thread.run(Thread.java:662)<o:p></o:p>Dec 10, 2010 6:19:42 AM org.apache.jk.common.ChannelSocket processConnection<o:p></o:p>WARNING: processCallbacks status 2<o:p></o:p><o:p> </o:p>Where can I look to try to troubleshoot this? All other actions under the Schedule tab work just fine.<o:p></o:p><o:p> </o:p><o:p> </o:p>A quick bump on this one. It seems that the query continues running on the external DB server and that the connection might be timing out on my Spacewalk server. The relevant query seems to be: <o:p></o:p><o:p> </o:p><tt>SELECT</tt><tt> </tt><tt>DISTINCT</tt><tt> UAO.</tt><tt>id</tt><tt> </tt><tt>AS</tt><tt> </tt><tt>ID</tt><tt>,</tt> <tt>UAO.earliest_action </tt><tt>AS</tt><tt> EARLIEST,</tt> <tt>UAO.type_name,</tt> <tt>(DECODE(UAO.action_name, </tt><tt>NULL</tt><tt>, UAO.type_name, UAO.action_name)) </tt><tt>AS</tt><tt> ACTION_NAME,</tt> <tt>UAO.scheduler,</tt> <tt>WC.login </tt><tt>AS</tt><tt> SCHEDULER_NAME,</tt> <tt>(</tt><tt>SELECT</tt><tt> COUNT(server_id) </tt><tt>FROM</tt><tt> rhnServerAction </tt><tt>WHERE</tt><tt> action_id = UAO.</tt><tt>id</tt><tt> </tt><tt>AND</tt><tt> status </tt><tt>IN</tt><tt> (0,1)) </tt><tt>AS</tt><tt> "IN_PROGRESS_SYSTEMS",</tt> <tt>(</tt><tt>SELECT</tt><tt> COUNT(server_id) </tt><tt>FROM</tt><tt> rhnServerAction </tt><tt>WHERE</tt><tt> action_id = UAO.</tt><tt>id</tt><tt> </tt><tt>AND</tt><tt> status = 2) </tt><tt>AS</tt><tt> "COMPLETED_SYSTEMS",</tt> <tt>(</tt><tt>SELECT</tt><tt> COUNT(server_id) </tt><tt>FROM</tt><tt> rhnServerAction </tt><tt>WHERE</tt><tt> action_id = UAO.</tt><tt>id</tt><tt> </tt><tt>AND</tt><tt> status = 3) </tt><tt>AS</tt><tt> "FAILED_SYSTEMS"</tt> <tt>FROM</tt><tt> rhnUserActionOverview UAO left </tt><tt>join</tt> <tt>web_contact WC </tt><tt>on</tt><tt> UAO.scheduler = WC.</tt><tt>id</tt> <tt>WHERE</tt><tt> UAO.org_id = :1</tt> <tt>AND</tt><tt> UAO.user_id = :2</tt> <tt>AND</tt><tt> UAO.action_status_id = 2</tt> <tt>AND</tt><tt> UAO.archived = 0</tt> <tt>ORDER</tt><tt> </tt><tt>BY</tt><tt> EARLIEST </tt><tt>DESC</tt><o:p></o:p><o:p> </o:p>I run it manually via sqlplus (after replacing the variables, of course) and it does take a few minutes to complete before a get quite a deluge of rows returned. Is there perhaps a misconfigured timeout somewhere in my config?<o:p></o:p><o:p> </o:p>Thanks,<o:p></o:p><o:p> </o:p>Andy<o:p></o:p></div></body></html>