[Spacewalk-list] Spacewalk 1.6 Database problem
John Hodrien
J.H.Hodrien at leeds.ac.uk
Thu Jan 5 14:22:38 UTC 2012
I've upgrade from 1.5 to 1.6 Postgresql and nominally things look passable.
No errors during upgrade. Database is on a physically different server.
Web interface works, and almost everything within the ui works as expected.
>From a clean start of the services, I visit the overview, systems, then
channels. I've done nothing else. After about a minute or two I start getting
stuck SQL queries. Over time these build up until I run out of connections to
postgres.
ps lists them as "UPDATE waiting".
>From within postgres I've done:
select * from pg_stat_activity;
spaceschema=# select * from pg_stat_activity;
datid | datname | procpid | usesysid | usename | current_query
| waiting | xact_start | query_start | backend_start | client_addr | client_port
-------+-------------+---------+----------+-----------+--------------------------------------------------------------------------------------------------------------------------------------------------------
--+---------+-------------------------------+-------------------------------+-------------------------------+---------------+-------------
16386 | spaceschema | 30891 | 10 | postgres | select * from pg_stat_activity;
| f | 2012-01-05 14:29:33.098941+00 | 2012-01-05 14:29:33.098941+00 | 2012-01-05 14:25:17.232954+00 | | -1
16386 | spaceschema | 30893 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:29:28.934342+00 | 2012-01-05 14:25:19.298269+00 | 129.11.144.27 | 35965
16386 | spaceschema | 30898 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:28:30.444127+00 | 2012-01-05 14:25:26.960474+00 | 129.11.144.27 | 35968
16386 | spaceschema | 30899 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:28:30.459342+00 | 2012-01-05 14:25:26.960813+00 | 129.11.144.27 | 35969
16386 | spaceschema | 30900 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:28:30.460331+00 | 2012-01-05 14:25:26.961175+00 | 129.11.144.27 | 35970
16386 | spaceschema | 30902 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:27:55.740841+00 | 2012-01-05 14:25:27.087321+00 | 129.11.144.27 | 35972
16386 | spaceschema | 30901 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:27:56.159519+00 | 2012-01-05 14:25:27.086394+00 | 129.11.144.27 | 35971
16386 | spaceschema | 30909 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:18.04167+00 | 2012-01-05 14:29:18.044377+00 | 2012-01-05 14:25:35.217119+00 | 129.11.144.27 | 35973
16386 | spaceschema | 30911 | 16385 | spaceuser |
| t | 2012-01-05 14:28:26.839008+00 | 2012-01-05 14:28:30.590495+00 | 2012-01-05 14:25:35.728386+00 | 129.11.144.27 | 35975
: update rhnServerAction
: set status = 1,
: pickup_time = current_timestamp,
: remaining_tries = 2 - 1
: where action_id = 16272
: and server_id = 1000010143
:
16386 | spaceschema | 30913 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:26:19.484672+00 | 2012-01-05 14:26:19.507405+00 | 2012-01-05 14:25:36.408451+00 | 129.11.144.27 | 35976
16386 | spaceschema | 30916 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:27:41.174417+00 | 2012-01-05 14:27:41.20187+00 | 2012-01-05 14:25:37.073507+00 | 129.11.144.27 | 35983
16386 | spaceschema | 30917 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:26:19.38988+00 | 2012-01-05 14:26:19.424821+00 | 2012-01-05 14:25:37.31493+00 | 129.11.144.27 | 35985
16386 | spaceschema | 30918 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:27:41.167912+00 | 2012-01-05 14:27:41.194812+00 | 2012-01-05 14:25:37.399529+00 | 129.11.144.27 | 35986
16386 | spaceschema | 30920 | 16385 | spaceuser |
| t | 2012-01-05 14:28:27.780709+00 | 2012-01-05 14:28:27.785768+00 | 2012-01-05 14:25:37.92749+00 | 129.11.144.27 | 35989
: update rhnServerAction
: set status = 3,
: result_code = NULL,
: result_msg = E'This action has been picked up multiple times without a successful transaction; this action is now failed for this system.'
,
: completion_time = current_timestamp
: where action_id = 16268
: and server_id = 1000010129
:
16386 | spaceschema | 30924 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:29:14.119535+00 | 2012-01-05 14:25:38.696203+00 | 129.11.144.27 | 35993
16386 | spaceschema | 30932 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:25:46.744915+00 | 2012-01-05 14:25:42.820402+00 | 129.11.144.27 | 35994
16386 | spaceschema | 30933 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:25:46.330574+00 | 2012-01-05 14:25:46.530221+00 | 2012-01-05 14:25:42.820781+00 | 129.11.144.27 | 35995
16386 | spaceschema | 30934 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:25:46.733166+00 | 2012-01-05 14:25:42.821112+00 | 129.11.144.27 | 35996
16386 | spaceschema | 30935 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:28:44.945009+00 | 2012-01-05 14:25:42.84162+00 | 129.11.144.27 | 35997
16386 | spaceschema | 30936 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:25:46.366109+00 | 2012-01-05 14:25:46.366907+00 | 2012-01-05 14:25:42.844717+00 | 129.11.144.27 | 35998
16386 | spaceschema | 30939 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:28:46.275595+00 | 2012-01-05 14:25:46.252718+00 | 129.11.144.27 | 35999
16386 | spaceschema | 30940 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:28:44.957741+00 | 2012-01-05 14:25:46.258876+00 | 129.11.144.27 | 36000
16386 | spaceschema | 30941 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:27:44.880293+00 | 2012-01-05 14:25:46.682777+00 | 129.11.144.27 | 36008
16386 | spaceschema | 30942 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:25:46.687834+00 | 2012-01-05 14:25:46.683258+00 | 129.11.144.27 | 36009
16386 | spaceschema | 30943 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:28:44.956283+00 | 2012-01-05 14:25:46.683694+00 | 129.11.144.27 | 36010
16386 | spaceschema | 30966 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:19.900094+00 | 2012-01-05 14:29:19.901499+00 | 2012-01-05 14:26:14.958512+00 | 129.11.144.27 | 36059
16386 | spaceschema | 30977 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:27:55.683539+00 | 2012-01-05 14:27:55.377356+00 | 129.11.144.27 | 36092
16386 | spaceschema | 30979 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:27:55.38271+00 | 2012-01-05 14:27:55.378176+00 | 129.11.144.27 | 36094
16386 | spaceschema | 30978 | 16385 | spaceuser | <IDLE>
| f | | 2012-01-05 14:27:55.383215+00 | 2012-01-05 14:27:55.377757+00 | 129.11.144.27 | 36093
16386 | spaceschema | 30992 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:20.114883+00 | 2012-01-05 14:29:20.115855+00 | 2012-01-05 14:29:17.654797+00 | 129.11.144.27 | 36109
16386 | spaceschema | 30993 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:20.224701+00 | 2012-01-05 14:29:20.227038+00 | 2012-01-05 14:29:17.917054+00 | 129.11.144.27 | 36110
16386 | spaceschema | 30994 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:18.264705+00 | 2012-01-05 14:29:18.26505+00 | 2012-01-05 14:29:18.259556+00 | 129.11.144.27 | 36111
16386 | spaceschema | 30995 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:18.498333+00 | 2012-01-05 14:29:18.498683+00 | 2012-01-05 14:29:18.493114+00 | 129.11.144.27 | 36112
16386 | spaceschema | 30996 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:18.726607+00 | 2012-01-05 14:29:18.726942+00 | 2012-01-05 14:29:18.721476+00 | 129.11.144.27 | 36113
16386 | spaceschema | 30997 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:19.002521+00 | 2012-01-05 14:29:19.002859+00 | 2012-01-05 14:29:18.997323+00 | 129.11.144.27 | 36114
16386 | spaceschema | 30998 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:19.238934+00 | 2012-01-05 14:29:19.239283+00 | 2012-01-05 14:29:19.233857+00 | 129.11.144.27 | 36115
16386 | spaceschema | 30999 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:19.482998+00 | 2012-01-05 14:29:19.483332+00 | 2012-01-05 14:29:19.47789+00 | 129.11.144.27 | 36116
16386 | spaceschema | 31000 | 16385 | spaceuser | <IDLE> in transaction
| f | 2012-01-05 14:29:19.790205+00 | 2012-01-05 14:29:19.790539+00 | 2012-01-05 14:29:19.785174+00 | 129.11.144.27 | 36117
(38 rows)
Some form of locking problem?
Database is postgresql-8.4.9-1.el6_1.1.x86_64
Thanks for any pointers,
jh
More information about the Spacewalk-list
mailing list