[Spacewalk-list] ERROR com.redhat.rhn.taskomatic.task.SynchProbeState - Error during probe state sync

[Christian Fröstl]

Hi there,

I get some deadlocks since a few days during the spacewalk sync probe, but I cannot figure out why. Any ideas?
I get the error messages in log file:

2014-10-30 14:57:01,263 [DefaultQuartzScheduler_Worker-1] ERROR com.redhat.rhn.taskomatic.task.SynchProbeState  - Error during probe state sync
com.redhat.rhn.common.db.WrappedSQLException: ERROR: deadlock detected
  Detail: Process 3792 waits for ShareLock on transaction 26404507; blocked by process 19943.
Process 19943 waits for ShareLock on transaction 26404529; blocked by process 3792.
  Hint: See server log for query details.
  Where: SQL statement "update rhn_probe_state set state = 'PENDING', output = 'Awaiting update' where last_check < ( select current_timestamp - interval '1 minute' * greatest(15, (3 * rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe where rhn_deployed_probe.recid = rhn_probe_state.probe_id )"
PL/pgSQL function "rhn_synch_probe_state" line 2 at SQL statement
        at com.redhat.rhn.common.translation.SqlExceptionTranslator.postgreSqlException(SqlExceptionTranslator.java:54)
        at com.redhat.rhn.common.translation.SqlExceptionTranslator.sqlException(SqlExceptionTranslator.java:44)
        at com.redhat.rhn.common.db.datasource.CachedStatement.executeCallable(CachedStatement.java:543)
        at com.redhat.rhn.common.db.datasource.CallableMode.execute(CallableMode.java:35)
        at com.redhat.rhn.taskomatic.task.SynchProbeState.execute(SynchProbeState.java:44)
        at com.redhat.rhn.taskomatic.task.RhnJavaJob.execute(RhnJavaJob.java:82)
        at com.redhat.rhn.taskomatic.TaskoJob.execute(TaskoJob.java:169)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
Caused by: org.postgresql.util.PSQLException: ERROR: deadlock detected
  Detail: Process 3792 waits for ShareLock on transaction 26404507; blocked by process 19943.
Process 19943 waits for ShareLock on transaction 26404529; blocked by process 3792.
  Hint: See server log for query details.
  Where: SQL statement "update rhn_probe_state set state = 'PENDING', output = 'Awaiting update' where last_check < ( select current_timestamp - interval '1 minute' * greatest(15, (3 * rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe where rhn_deployed_probe.recid = rhn_probe_state.probe_id )"
PL/pgSQL function "rhn_synch_probe_state" line 2 at SQL statement
        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:360)
        at com.mchange.v2.c3p0.impl.NewProxyCallableStatement.execute(NewProxyCallableStatement.java:2417)
        at com.redhat.rhn.common.db.NamedPreparedStatement.execute(NamedPreparedStatement.java:117)
        at com.redhat.rhn.common.db.datasource.CachedStatement.executeCallable(CachedStatement.java:528)
        ... 6 more
2014-10-30 14:57:01,267 [DefaultQuartzScheduler_Worker-1] ERROR com.redhat.rhn.taskomatic.task.SynchProbeState  - com.redhat.rhn.common.db.WrappedSQLException: ERROR: deadlock detected
  Detail: Process 3792 waits for ShareLock on transaction 26404507; blocked by process 19943.
Process 19943 waits for ShareLock on transaction 26404529; blocked by process 3792.
  Hint: See server log for query details.
  Where: SQL statement "update rhn_probe_state set state = 'PENDING', output = 'Awaiting update' where last_check < ( select current_timestamp - interval '1 minute' * greatest(15, (3 * rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe where rhn_deployed_probe.recid = rhn_probe_state.probe_id )"
PL/pgSQL function "rhn_synch_probe_state" line 2 at SQL statement
2014-10-30 14:57:01,267 [DefaultQuartzScheduler_Worker-1] ERROR com.redhat.rhn.taskomatic.task.SynchProbeState  - com.redhat.rhn.common.db.WrappedSQLException: ERROR: deadlock detected
  Detail: Process 3792 waits for ShareLock on transaction 26404507; blocked by process 19943.
Process 19943 waits for ShareLock on transaction 26404529; blocked by process 3792.
  Hint: See server log for query details.
  Where: SQL statement "update rhn_probe_state set state = 'PENDING', output = 'Awaiting update' where last_check < ( select current_timestamp - interval '1 minute' * greatest(15, (3 * rhn_deployed_probe.check_interval_minutes)) from rhn_deployed_probe where rhn_deployed_probe.recid = rhn_probe_state.probe_id )"
PL/pgSQL function "rhn_synch_probe_state" line 2 at SQL statement

Thanks in advance,
Christian

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/spacewalk-list/attachments/20141031/70b47199/attachment.htm>