[Spacewalk-list] osa-dispatcher crashing, but no trace

Ree, Jan-Albert van J.A.v.Ree at marin.nl
Wed Jul 27 08:37:57 UTC 2016


We've recently installed a new spacewalk server, using Scientific Linux 7 with Spacewalk 2.5
The machine has a lot of RAM and with only around 70 clients it's load is always very low.

It's been running fine for around 8 weeks, but last week the OSAD mechanism failed.
osa-dispatcher crashes around 1-3 seconds after startup and unfortunately even with debug turned up to 9 there is no useful error logging
I've checked everything, jabberd processes are running fine and I see the osa-dispatcher connecting:

>From /var/lib/jabberd/log/sm.log
Wed Jul 27 10:31:05 2016 [notice] session started: jid=rhn-dispatcher-sat at spacewalk.marin.local/superclient
Wed Jul 27 10:31:06 2016 [notice] session ended: jid=rhn-dispatcher-sat at spacewalk.marin.local/superclient
Wed Jul 27 10:31:06 2016 [notice] user unloaded jid=rhn-dispatcher-sat at spacewalk.marin.local

>From /var/lib/jabberd/log/c2s.log
Wed Jul 27 10:31:05 2016 [notice] [283] [172.16.201.69, port=41456] connect
Wed Jul 27 10:31:05 2016 [notice] [283] traditional.digest authentication succeeded: rhn-dispatcher-sat@/superclient 172.16.201.69:41456 TLS
Wed Jul 27 10:31:05 2016 [notice] [283] requesting session: jid=rhn-dispatcher-sat at spacewalk.marin.local/superclient
Wed Jul 27 10:31:06 2016 [notice] [283] [172.16.201.69, port=41456] disconnect jid=rhn-dispatcher-sat at spacewalk.marin.local/superclient, packets: 1336, bytes: 18694

>From /var/log/rhn/osa-dispatcher.log the last few lines when in debug=9 :

2016/07/27 10:31:06 +02:00 10750 0.0.0.0: osad/jabber_lib.send_presence(osad-fe74456273 at spacewalk.marin.local/osad, 'subscribed')
2016/07/27 10:31:06 +02:00 10750 0.0.0.0: osad/jabber_lib.subscribe_to_presence('Subscribed to', {'osad-af18332ef7 at spacewalk.marin.local': {'jid': 'osad-af18332ef7 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-eb3e98791c at spacewalk.marin.local': {'jid': 'osad-eb3e98791c at spacewalk.marin.local', 'subscription': u'to'}, 'osad-ad61c9c6e1 at spacewalk.marin.local': {'jid': 'osad-ad61c9c6e1 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-5e6fadf3b4 at spacewalk.marin.local': {'jid': 'osad-5e6fadf3b4 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-b2c1c717f3 at spacewalk.marin.local': {'jid': 'osad-b2c1c717f3 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-a9f0851cce at spacewalk.marin.local': {'jid': 'osad-a9f0851cce at spacewalk.marin.local', 'subscription': u'to'}, 'osad-d11dab34ec at spacewalk.marin.local': {'jid': 'osad-d11dab34ec at spacewalk.marin.local', 'subscription': u'to'}, 'osad-b684d167db at spacewalk.marin.local': {'jid': 'osad-b684d167db at spacewalk.marin.local', 'subscription': u'to'}, 'osad-b4c5d27521 at spacewalk.marin.local': {'jid': 'osad-b4c5d27521 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-76c17d7cda at spacewalk.marin.local': {'jid': 'osad-76c17d7cda at spacewalk.marin.local', 'subscription': u'to'}, 'osad-3071fe4c7c at spacewalk.marin.local': {'jid': 'osad-3071fe4c7c at spacewalk.marin.local', 'subscription': u'to'}, 'osad-dda2268f61 at spacewalk.marin.local': {'jid': 'osad-dda2268f61 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-132fac1c18 at spacewalk.marin.local': {'jid': 'osad-132fac1c18 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-1250a6fea3 at spacewalk.marin.local': {'jid': 'osad-1250a6fea3 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-753db34630 at spacewalk.marin.local': {'jid': 'osad-753db34630 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-1dff8eb15d at spacewalk.marin.local': {'jid': 'osad-1dff8eb15d at spacewalk.marin.local', 'subscription': u'to'}, 'osad-74f8a799a1 at spacewalk.marin.local': {'jid': 'osad-74f8a799a1 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-8b9f38
7cb3 at spacewalk.marin.local': {'jid': 'osad-8b9f387cb3 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-9a6b6cb67e at spacewalk.marin.local': {'jid': 'osad-9a6b6cb67e at spacewalk.marin.local', 'subscription': u'to'}, 'osad-2738c71eff at spacewalk.marin.local': {'jid': 'osad-2738c71eff at spacewalk.marin.local', 'subscription': u'to'}, 'osad-4caa3b20f5 at spacewalk.marin.local': {'jid': 'osad-4caa3b20f5 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-d7dfbe923c at spacewalk.marin.local': {'jid': 'osad-d7dfbe923c at spacewalk.marin.local', 'subscription': u'to'}, 'osad-4c64769b44 at spacewalk.marin.local': {'jid': 'osad-4c64769b44 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-bb86df3870 at spacewalk.marin.local': {'jid': 'osad-bb86df3870 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-e82765bbb2 at spacewalk.marin.local': {'jid': 'osad-e82765bbb2 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-14757ede4f at spacewalk.marin.local': {'jid': 'osad-14757ede4f at spacewalk.marin.local', 'subscription': u'to'}, 'osad-9260ed59b4 at spacewalk.marin.local': {'jid': 'osad-9260ed59b4 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-fa00d081fd at spacewalk.marin.local': {'jid': 'osad-fa00d081fd at spacewalk.marin.local', 'subscription': u'to'}, 'osad-855c4f9896 at spacewalk.marin.local': {'jid': 'osad-855c4f9896 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-26d8567899 at spacewalk.marin.local': {'jid': 'osad-26d8567899 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-3965155ea0 at spacewalk.marin.local': {'jid': 'osad-3965155ea0 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-6a1ea9236b at spacewalk.marin.local': {'jid': 'osad-6a1ea9236b at spacewalk.marin.local', 'subscription': u'to'}, 'osad-aae152f426 at spacewalk.marin.local': {'jid': 'osad-aae152f426 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-22b63000a4 at spacewalk.marin.local': {'jid': 'osad-22b63000a4 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-df4fe6f3f1 at spacewalk.marin.local': {'jid': 'osad-df4fe6f3f1 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-16
690d3068 at spacewalk.marin.local': {'jid': 'osad-16690d3068 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-fdb317cdb9 at spacewalk.marin.local': {'jid': 'osad-fdb317cdb9 at spacewalk.marin.local', 'subscription': u'to'}, 'osad-b3e88c3b95 at spacewalk.marin.local': {'jid': 'osad-b3e88c3b95 at spacewalk.marin.local', 'subscription': u'to'}})
2016/07/27 10:31:06 +02:00 10750 0.0.0.0: osad/jabber_lib.subscribe_to_presence('Subscribed both', {})
2016/07/27 10:31:06 +02:00 10750 0.0.0.0: osad/jabber_lib.subscribe_to_presence('Subscribed none', {'osad-b003b96060 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-b003b96060 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-708d031ff0 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-708d031ff0 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-6f9db9317e at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-6f9db9317e at spacewalk.marin.local', 'subscription': u'none'}, 'osad-3f4bae5c6f at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-3f4bae5c6f at spacewalk.marin.local', 'subscription': u'none'}, 'osad-9af0bd3bc2 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-9af0bd3bc2 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-76997ff128 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-76997ff128 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-500fb4350b at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-500fb4350b at spacewalk.marin.local', 'subscription': u'none'}, 'osad-41bec84b7b at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-41bec84b7b at spacewalk.marin.local', 'subscription': u'none'}, 'osad-9e746cbe56 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-9e746cbe56 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-4fd3d59167 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-4fd3d59167 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-bfcb9050ad at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-bfcb9050ad at spacewalk.marin.local', 'subscription': u'none'}, 'osad-6bfc507253 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-6bfc507253 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-c7e038a8d7 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-c7e038a8d7 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-aec49bb393 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-aec49bb393 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-0f9e45687f at spacewalk.mar
in.local': {'ask': u'subscribe', 'jid': 'osad-0f9e45687f at spacewalk.marin.local', 'subscription': u'none'}, 'osad-7f2d30c68c at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-7f2d30c68c at spacewalk.marin.local', 'subscription': u'none'}, 'osad-da2f218ca7 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-da2f218ca7 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-3b3864cec6 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-3b3864cec6 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-bfed4e9ccf at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-bfed4e9ccf at spacewalk.marin.local', 'subscription': u'none'}, 'osad-98dcded1bb at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-98dcded1bb at spacewalk.marin.local', 'subscription': u'none'}, 'osad-d35f864e5d at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-d35f864e5d at spacewalk.marin.local', 'subscription': u'none'}, 'osad-27af6264ec at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-27af6264ec at spacewalk.marin.local', 'subscription': u'none'}, 'osad-c26066bb63 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-c26066bb63 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-0be3fc942e at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-0be3fc942e at spacewalk.marin.local', 'subscription': u'none'}, 'osad-b0ea4afafe at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-b0ea4afafe at spacewalk.marin.local', 'subscription': u'none'}, 'osad-50cec246e7 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-50cec246e7 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-a637720bfe at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-a637720bfe at spacewalk.marin.local', 'subscription': u'none'}, 'osad-ff02af2aa9 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-ff02af2aa9 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-84ce80a897 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-84ce80a897 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-27454662c7 at spacew
alk.marin.local': {'ask': u'subscribe', 'jid': 'osad-27454662c7 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-685bf71d1c at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-685bf71d1c at spacewalk.marin.local', 'subscription': u'none'}, 'osad-49b52ed24f at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-49b52ed24f at spacewalk.marin.local', 'subscription': u'none'}, 'osad-ace3386f82 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-ace3386f82 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-8b6380e372 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-8b6380e372 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-4ab6bcb5e5 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-4ab6bcb5e5 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-8450750196 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-8450750196 at spacewalk.marin.local', 'subscription': u'none'}, 'osad-9d9db29bdb at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-9d9db29bdb at spacewalk.marin.local', 'subscription': u'none'}, 'osad-aa75765e91 at spacewalk.marin.local': {'ask': u'subscribe', 'jid': 'osad-aa75765e91 at spacewalk.marin.local', 'subscription': u'none'}})
2016/07/27 10:31:06 +02:00 10750 0.0.0.0: osad/jabber_lib.subscribe_to_presence('Subscribed from', {})
2016/07/27 10:31:06 +02:00 10750 0.0.0.0: osad/jabber_lib.subscribe_to_presence('osad-fe74456273 at spacewalk.marin.local',)
2016/07/27 10:31:06 +02:00 10750 0.0.0.0: rhnSQL/driver_postgresql.convert_named_query_params('Converting query for PostgreSQL: select * from rhnPushClient where jabber_id = :p1',)
2016/07/27 10:31:06 +02:00 10750 0.0.0.0: rhnSQL/driver_postgresql.convert_named_query_params('New query: select * from rhnPushClient where jabber_id = %(p1)s',)
2016/07/27 10:31:06 +02:00 10750 0.0.0.0: rhnSQL/driver_postgresql._execute_wrapper('Executing SQL: "select * from rhnPushClient where jabber_id = %(p1)s" with bind params: {p1: osad-fe74456273 at spacewalk.marin.local/osad}',)
2016/07/27 10:31:06 +02:00 10750 0.0.0.0: osad/jabber_lib.main('ERROR', 'Error caught:')

The database table rhnPushClient appears to be fine :

rhnschema=# select * from rhnPushClient;
 id |       name       | server_id  |                 jabber_id                  |                shared_key                | state_id | next_action_time |       last_message_time       | last_ping_time |            created            |           modified
----+------------------+------------+--------------------------------------------+------------------------------------------+----------+------------------+-------------------------------+----------------+-------------------------------+-------------------------------
 95 | b7ed022e4c59bbbd | 1000010105 | osad-855c4f9896 at spacewalk.marin.local/osad | 0d03d48ae4d5223997734a04f9e8251de48b0433 |        1 |                  |                               |                | 2016-07-19 15:52:12.466221+02 | 2016-07-27 10:08:20.722363+02
 97 | 335437e15495daec | 1000010107 | osad-aae152f426 at spacewalk.marin.local/osad | f0e4e18b6841511fda4566042a356cfe79c868de |        1 |                  |                               |                | 2016-07-26 14:45:48.912174+02 | 2016-07-27 10:08:20.726826+02
 96 | 5d2f245876d16f3d | 1000010106 | osad-bfcb9050ad at spacewalk.marin.local/osad | c12b7417986a7900b586305833669b5d91619163 |        2 |                  |                               |                | 2016-07-22 09:01:03.62445+02  | 2016-07-27 09:55:22.041885+02
 24 | 70a98d6f8c92e019 | 1000010009 | osad-da2f218ca7 at spacewalk.marin.local/osad | b9d0ef9851bc14e6996193f3191b951b328ec1f8 |        1 |                  |                               |                | 2016-03-11 10:10:25.229894+01 | 2016-06-13 08:43:19.939437+02
 78 | 7c433106d4682100 | 1000010088 | osad-9af0bd3bc2 at spacewalk.marin.local/osad | aad6c4e3dd02ba2539c8bdd9e81bf8893b010db7 |        2 |                  | 2016-06-27 07:55:28.217043+02 |                | 2016-06-08 18:17:16.328625+02 | 2016-06-27 16:36:07.39227+02
 31 | 7581d036e2f3f54b | 1000010039 | osad-bfed4e9ccf at spacewalk.marin.local/osad | 16a616a7c4190b40d0a04ded494b36bbdfdb8a93 |        2 |                  | 2016-07-18 10:37:20.906234+02 |                | 2016-03-21 16:43:05.287972+01 | 2016-07-26 15:40:22.619562+02
 75 | 6e959d236b5b3b84 | 1000010019 | osad-14757ede4f at spacewalk.marin.local/osad | e6704e89a0c5e6dde2618c84d8460911a7cd7245 |        1 |                  | 2016-07-17 23:00:32.473397+02 |                | 2016-06-03 12:30:38.944507+02 | 2016-07-27 10:08:20.811451+02
 10 | 80fa3cbfbaa59a3f | 1000010020 | osad-26d8567899 at spacewalk.marin.local/osad | e49fe1424b28a1f187b2525e97cea6cd7197c721 |        1 |                  | 2016-07-17 23:00:33.024979+02 |                | 2016-03-11 03:19:12.554004+01 | 2016-07-27 10:08:20.823584+02
 52 | e9ade6e57038f621 | 1000010055 | osad-d7dfbe923c at spacewalk.marin.local/osad | 85fbdd1c6b450a9ee8f3d999014dd18275ee7457 |        1 |                  | 2016-07-04 14:13:24.52467+02  |                | 2016-05-28 03:55:07.027512+02 | 2016-07-27 10:08:20.836239+02
 23 | a8f1069de194ff9d | 1000010031 | osad-b2c1c717f3 at spacewalk.marin.local/osad | 54b231852f01477fe250cb132cb37c8936664259 |        1 |                  | 2016-07-17 23:00:32.565137+02 |                | 2016-03-11 10:05:19.560423+01 | 2016-07-27 10:14:21.364567+02
 13 | 9ad271dd5425c8a6 | 1000010032 | osad-dda2268f61 at spacewalk.marin.local/osad | cc8593da6dee3d867fb53b31f22dd9217d174f4c |        1 |                  | 2016-07-17 23:00:32.65713+02  |                | 2016-03-11 09:36:14.438632+01 | 2016-07-27 10:14:21.369745+02
 73 | 00ac9e50ae8fd3c8 | 1000010066 | osad-a9f0851cce at spacewalk.marin.local/osad | f892f3dfb9f99720efb21d8d9ed3aa27dc436ed1 |        1 |                  | 2016-07-18 10:37:21.327314+02 |                | 2016-06-03 12:16:11.034158+02 | 2016-07-27 10:14:21.374628+02
 22 | dff9cb18d6cb670f | 1000010034 | osad-d11dab34ec at spacewalk.marin.local/osad | 9b5fd91c520afd28e491af6d604e3676dd0cd0ad |        1 |                  | 2016-07-17 23:00:33.347142+02 |                | 2016-03-11 10:00:24.137955+01 | 2016-07-27 10:14:21.378919+02
 35 | 53a463f8f8a5d904 | 1000010043 | osad-3071fe4c7c at spacewalk.marin.local/osad | a869844a36e475591e80dcc1ba524a348d820c5a |        1 |                  | 2016-06-29 17:00:46.437475+02 |                | 2016-03-31 11:10:51.575355+02 | 2016-07-27 10:14:21.394341+02
 27 | cfc1ea82e9fee6e7 | 1000010033 | osad-1dff8eb15d at spacewalk.marin.local/osad | 6ae538ee6769a1b3e6bd9a7009f0b7e41923d120 |        1 |                  | 2016-07-17 23:00:32.703343+02 |                | 2016-03-11 10:27:36.140262+01 | 2016-07-27 10:14:21.418411+02
 51 | 2ab9634fcd4765cc | 1000010062 | osad-9d9db29bdb at spacewalk.marin.local/osad | 21a8fdf26a780d40f8f524cc83fa61a0b4275c10 |        2 |                  | 2016-07-04 14:13:24.441803+02 |                | 2016-05-28 03:50:40.327961+02 | 2016-07-27 09:55:51.40639+02
 60 | 9d726e1df623e44e | 1000010075 | osad-ace3386f82 at spacewalk.marin.local/osad | 374e1c73c762daf1dd0ddf86418639836a8e2f0a |        2 |                  | 2016-07-17 23:00:33.668079+02 |                | 2016-06-03 09:19:38.551973+02 | 2016-07-27 09:55:53.372438+02
 29 | 924aaec575cad2a0 | 1000010005 | osad-0be3fc942e at spacewalk.marin.local/osad | f9e976e9ef7f7a76fb2d02b8043b710a75351aed |        2 |                  | 2016-07-12 10:45:14.572236+02 |                | 2016-03-11 11:16:04.298542+01 | 2016-07-27 09:56:05.176487+02
 26 | c66b9a49516c5610 | 1000010012 | osad-22b63000a4 at spacewalk.marin.local/osad | 7b7362a3e25a0ae0ade795ca6f0a72e3736719ec |        1 |                  | 2016-06-27 07:55:14.908977+02 |                | 2016-03-11 10:25:12.715185+01 | 2016-07-27 10:08:20.635056+02
 12 | 06f9eb3ea60a4a35 | 1000010024 | osad-4ab6bcb5e5 at spacewalk.marin.local/osad | 1a15e3d0a2b42ecafe1bc1e70603292a97321644 |        1 |                  | 2016-07-17 23:00:32.841204+02 |                | 2016-03-11 03:41:50.672088+01 | 2016-07-27 09:58:19.01623+02
 77 | a42861edc389b820 | 1000010065 | osad-fdb317cdb9 at spacewalk.marin.local/osad | fdc22ccb9287c66b084a809f1f6e788a07463c28 |        1 |                  | 2016-07-18 10:37:21.093864+02 |                | 2016-06-03 15:49:51.275645+02 | 2016-07-27 10:08:20.686719+02
 81 | 4ea713ba69028ea7 | 1000010091 | osad-df4fe6f3f1 at spacewalk.marin.local/osad | 09bdc98750aaba522b01a276eba1020cda0bc17e |        1 |                  | 2016-07-18 10:37:21.466606+02 |                | 2016-06-17 10:09:26.603485+02 | 2016-07-27 10:08:20.854074+02
  1 | 336eb26be51762cd | 1000010000 | osad-a637720bfe at spacewalk.marin.local/osad | afc331ace84fa181cd8eaea6a7e37d21edd90a00 |        2 |                  | 2016-07-18 09:25:38.474404+02 |                | 2016-03-04 11:34:31.961266+01 | 2016-07-27 09:55:22.213669+02
 90 | 68f4f8d2990f4edb | 1000010100 | osad-9a6b6cb67e at spacewalk.marin.local/osad | acb8018768c7e834bafbf97e80fa149c1e503735 |        1 |                  | 2016-07-18 10:37:21.792134+02 |                | 2016-07-05 13:24:27.897595+02 | 2016-07-27 10:08:20.9057+02
 72 | 4fa746b8b8d64ac8 | 1000010064 | osad-2738c71eff at spacewalk.marin.local/osad | c48a2086ad95f7865cacff160e620d1e2cbd3796 |        1 |                  | 2016-07-18 10:37:21.140857+02 |                | 2016-06-03 11:57:19.310303+02 | 2016-07-27 10:08:20.918107+02
 63 | c76711654adaaafe | 1000010078 | osad-16690d3068 at spacewalk.marin.local/osad | 070d0611b5199a888b5ceddd13bc32b849272e32 |        1 |                  | 2016-07-17 23:00:33.806124+02 |                | 2016-06-03 09:53:21.828569+02 | 2016-07-27 10:08:20.93038+02
 58 | 760c2ab228cdad19 | 1000010070 | osad-4c64769b44 at spacewalk.marin.local/osad | 15a02102c343527c8a6bad68bfe068aa771c6b79 |        1 |                  | 2016-07-18 10:37:21.559514+02 |                | 2016-06-02 16:53:18.218228+02 | 2016-07-27 10:08:20.942811+02
 50 | 52cb70f13b8998ea | 1000010059 | osad-685bf71d1c at spacewalk.marin.local/osad | 4359065c8a4416cba93fc345d43917f92bffcc2a |        1 |                  | 2016-07-04 14:13:24.469404+02 |                | 2016-05-28 03:47:22.011313+02 | 2016-07-27 09:58:19.092075+02
 45 | 5476268011bb14dd | 1000010061 | osad-c26066bb63 at spacewalk.marin.local/osad | 15125b19b711d245bdfc7c03b3b88756029bd5a9 |        1 |                  | 2016-07-12 10:45:29.767878+02 |                | 2016-05-28 03:24:50.36637+02  | 2016-07-27 09:58:19.102025+02
  3 | a5b5b4d40c118ee0 | 1000010002 | osad-e82765bbb2 at spacewalk.marin.local/osad | 96e4da24aa293608f07fcd2f25ed0033f41b88fa |        1 |                  | 2016-07-18 10:37:20.859642+02 |                | 2016-03-04 13:44:12.489388+01 | 2016-07-27 10:08:20.955161+02
 47 | beab7fdff05c218a | 1000010052 | osad-b3e88c3b95 at spacewalk.marin.local/osad | 8d74518243a9cef8565a1aa036ebf580f814ad8f |        1 |                  | 2016-07-04 14:13:24.743751+02 |                | 2016-05-28 03:30:01.488517+02 | 2016-07-27 10:14:21.398591+02
 94 | c81a24accc503a0c | 1000010104 | osad-132fac1c18 at spacewalk.marin.local/osad | 31f1bb282c9d897fe62984d8df826ca56a9fe45f |        1 |                  | 2016-07-17 23:00:33.991497+02 |                | 2016-07-07 14:31:33.279246+02 | 2016-07-27 10:14:21.402706+02
 85 | 1bd20a1de03c3808 | 1000010095 | osad-753db34630 at spacewalk.marin.local/osad | ebf73acc6be67deff521b2c93b46e81c372e01eb |        1 |                  | 2016-07-18 10:37:21.605879+02 |                | 2016-06-24 16:28:35.965369+02 | 2016-07-27 10:14:21.414603+02
 21 | 5e7d78f32b59721f | 1000010030 | osad-74f8a799a1 at spacewalk.marin.local/osad | 1a1aa4b05c9c286645585435fd5830a3f7cb835b |        1 |                  | 2016-07-17 23:00:32.611291+02 |                | 2016-03-11 09:54:06.448909+01 | 2016-07-27 10:14:21.422074+02
 14 | b12137c4f9fb4561 | 1000010008 | osad-ff02af2aa9 at spacewalk.marin.local/osad | 66de23f0bddd601173b8bb40248557000e06f446 |        1 |                  | 2016-07-27 09:06:09.561711+02 |                | 2016-03-11 09:38:55.855995+01 | 2016-07-27 09:58:45.776927+02
 70 | 1c997dedae5ff6ab | 1000010071 | osad-27454662c7 at spacewalk.marin.local/osad | d216268e473bb7e9fd95d6e7b675150fb6130c0f |        1 |                  | 2016-07-18 10:37:21.513077+02 |                | 2016-06-03 11:47:36.131994+02 | 2016-07-27 09:58:45.787188+02
 55 | e4db869c7213f3f5 | 1000010072 | osad-fa00d081fd at spacewalk.marin.local/osad | 56db70e2cd19bfaad065240237b5bc8a38c838e0 |        1 |                  | 2016-07-18 10:37:21.420211+02 |                | 2016-05-31 13:25:58.83374+02  | 2016-07-27 09:58:45.812345+02
 37 | 3ba95b650f59ebe9 | 1000010045 | osad-3965155ea0 at spacewalk.marin.local/osad | a15bc700b71a1069ebf782d6d2cb4a77e31d0f64 |        1 |                  | 2016-07-18 10:37:21.047007+02 |                | 2016-04-13 12:36:53.058494+02 | 2016-07-27 09:58:45.872276+02
 28 | e7776ad851e22421 | 1000010013 | osad-84ce80a897 at spacewalk.marin.local/osad | bd1e317329f7ca175d7f5328fabc6ae424b9fb65 |        1 |                  | 2016-07-27 09:17:24.459466+02 |                | 2016-03-11 10:36:24.314667+01 | 2016-07-27 09:58:19.111877+02
  4 | 2c423950328fa656 | 1000010007 | osad-aec49bb393 at spacewalk.marin.local/osad | ed64b78d93fa409725bad8520a0d128214aad28c |        1 |                  | 2016-05-23 11:49:21.929288+02 |                | 2016-03-07 09:57:15.081125+01 | 2016-06-13 08:43:19.900015+02
 42 | 7d2d501c8b7b73eb | 1000010050 | osad-4fd3d59167 at spacewalk.marin.local/osad | 9a5e22ecbb570ad79be98b19c093b4d18f18570d |        1 |                  | 2016-06-09 23:00:10.7464+02   |                | 2016-05-26 14:43:26.602547+02 | 2016-06-13 08:43:19.958598+02
 43 | 27a1c72b97981b2e | 1000010051 | osad-b684d167db at spacewalk.marin.local/osad | 60cb17ebef2b121b01d4de7df49c6ec9718da876 |        1 |                  | 2016-07-03 23:00:25.737411+02 |                | 2016-05-26 17:32:10.390221+02 | 2016-07-27 10:14:21.382652+02
 53 | 24e6bbc355da734f | 1000010057 | osad-27af6264ec at spacewalk.marin.local/osad | bcf72f6dff5a2838e1468d517560ad0ca6888473 |        1 |                  | 2016-07-04 14:13:24.689386+02 |                | 2016-05-28 03:55:10.051151+02 | 2016-07-27 09:58:19.231011+02
 44 | 653d3622776a4f06 | 1000010060 | osad-9260ed59b4 at spacewalk.marin.local/osad | 8aa60ff1d2c5848ae88e8c9fa3541bfae3337af3 |        1 |                  | 2016-07-04 14:13:37.302763+02 |                | 2016-05-28 03:23:00.27892+02  | 2016-07-27 10:14:21.410619+02
 74 | 43de1377b499e2ea | 1000010068 | osad-af18332ef7 at spacewalk.marin.local/osad | 5da07f8965eee54d6b0d5639fa9d930a8ad725d4 |        1 |                  | 2016-07-18 10:37:21.373798+02 |                | 2016-06-03 12:28:39.269959+02 | 2016-07-27 09:58:45.2716+02
 41 | 344bfc8d63ec220f | 1000010049 | osad-ad61c9c6e1 at spacewalk.marin.local/osad | 02fde128d017e77db613d4d233737a841ddc2519 |        1 |                  | 2016-07-18 10:37:21.280843+02 |                | 2016-05-23 15:22:57.422387+02 | 2016-07-27 09:58:45.363571+02
 36 | f373d349a6a68ec5 | 1000010044 | osad-aa75765e91 at spacewalk.marin.local/osad | 356ad87c45d9db65b34c67ba395acc1b95075b5a |        1 |                  | 2016-07-07 23:00:26.707892+02 |                | 2016-04-06 12:15:51.553637+02 | 2016-07-27 09:58:19.181507+02
 25 | 592656d182140a28 | 1000010006 | osad-8b6380e372 at spacewalk.marin.local/osad | 013fa85392a1fce7102f0b709d37d48295430d0d |        1 |                  | 2016-06-27 07:55:28.312413+02 |                | 2016-03-11 10:13:50.231711+01 | 2016-07-27 09:58:19.131901+02
 46 | e2819bb6720e4c4c | 1000010058 | osad-1250a6fea3 at spacewalk.marin.local/osad | cf96f5fcda870db987e25a20e5d59ddefe1327f4 |        1 |                  | 2016-07-04 14:12:56.793902+02 |                | 2016-05-28 03:29:47.166926+02 | 2016-07-27 10:14:21.40657+02
 49 | 2275dec385d73d1a | 1000010053 | osad-76c17d7cda at spacewalk.marin.local/osad | 743dbabe61744eb22b54ca862b4c684446719691 |        1 |                  | 2016-07-04 14:14:47.891042+02 |                | 2016-05-28 03:45:19.932061+02 | 2016-07-27 10:14:21.390464+02
 18 | 1dcad250ad27a0f5 | 1000010010 | osad-7f2d30c68c at spacewalk.marin.local/osad | 3b4945ebc245a0db99f8b652cbc58b0dbd537e3e |        2 |                  | 2016-06-29 10:34:23.978388+02 |                | 2016-03-11 09:43:39.201337+01 | 2016-07-14 11:31:32.97125+02
 15 | 4ab9acf97b43e9dd | 1000010011 | osad-d35f864e5d at spacewalk.marin.local/osad | 5ce5161cb602fa1ed22b910cc3a1e905503096a9 |        1 |                  | 2016-06-29 16:58:54.339996+02 |                | 2016-03-11 09:39:39.904478+01 | 2016-07-27 09:58:19.259873+02
 48 | 1c391889871c6a20 | 1000010056 | osad-bb86df3870 at spacewalk.marin.local/osad | bc7532b98b27269114ab96a970f2306b14262ee4 |        1 |                  | 2016-07-04 14:13:24.358827+02 |                | 2016-05-28 03:40:25.163873+02 | 2016-07-27 09:58:45.73266+02
 19 | a4bb08d5784ad332 | 1000010014 | osad-c7e038a8d7 at spacewalk.marin.local/osad | f74ed043b95c4d59e2e8aebe2525ecf83e268f28 |        1 |                  | 2016-06-29 10:34:59.621535+02 |                | 2016-03-11 09:45:44.382342+01 | 2016-07-27 09:58:19.25041+02
 82 | 96248ed04feada0b | 1000010092 | osad-500fb4350b at spacewalk.marin.local/osad | aaddb2dde6cdda74513f8baf4d36b36c1d361ff6 |        1 |                  | 2016-07-18 10:37:21.652797+02 |                | 2016-06-21 14:24:20.590017+02 | 2016-07-27 09:58:19.27955+02
 88 | 85f933ee97b6cdbb | 1000010098 | osad-5e6fadf3b4 at spacewalk.marin.local/osad | 9cc08ec072373703dccb0b6f242ce7ab48036aac |        1 |                  | 2016-07-17 23:00:34.083407+02 |                | 2016-06-27 14:45:55.722846+02 | 2016-07-27 10:14:21.358956+02
 83 | bcf5c26382cd2a3b | 1000010093 | osad-76997ff128 at spacewalk.marin.local/osad | 086aa0a8c9e7dd5b1aba34478f194222fc25efa3 |        1 |                  | 2016-07-18 10:57:32.264156+02 |                | 2016-06-21 16:00:19.638172+02 | 2016-07-27 09:58:19.26975+02
 89 | aba2cc67b419c56a | 1000010099 | osad-50cec246e7 at spacewalk.marin.local/osad | b5a4beb0e5d29437778abfc9e73eff2bb410c3bc |        1 |                  | 2016-07-18 10:37:21.745753+02 |                | 2016-07-01 16:15:48.130354+02 | 2016-07-27 09:58:19.298916+02
 91 | d354ef773e348052 | 1000010101 | osad-6f9db9317e at spacewalk.marin.local/osad | a07f14d2b95e81ce34d1e436c8ded5c9272b2fb1 |        1 |                  | 2016-07-18 10:37:21.699253+02 |                | 2016-07-06 09:02:19.189787+02 | 2016-07-27 09:58:19.318504+02
 93 | 85fac835b9ba8628 | 1000010103 | osad-4caa3b20f5 at spacewalk.marin.local/osad | 076fe0379b52d61407a9257da95c3a8b0eaa9a36 |        1 |                  | 2016-07-17 23:00:33.945314+02 |                | 2016-07-07 09:57:11.251298+02 | 2016-07-27 09:58:45.702219+02
 40 | ad9be96c262c90ec | 1000010048 | osad-6a1ea9236b at spacewalk.marin.local/osad | 3e438ee02b48e8c220ea6a8bbdec746733dd9f61 |        1 |                  | 2016-07-04 14:13:24.634795+02 |                | 2016-05-03 13:22:31.923278+02 | 2016-07-27 10:08:20.583703+02
 11 | d5ef5cf32ff1ffcc | 1000010025 | osad-6bfc507253 at spacewalk.marin.local/osad | c69ff6a999b18204c8eaf13000ba482bac92ea16 |        1 |                  | 2016-07-17 23:00:32.519318+02 |                | 2016-03-11 03:25:24.950734+01 | 2016-07-27 09:58:19.328362+02
  9 | 26a52c0e6c76edc4 | 1000010022 | osad-b4c5d27521 at spacewalk.marin.local/osad | 1a8896b76deacafb52c88ce65231367bcecdcf64 |        1 |                  | 2016-07-17 23:00:32.795293+02 |                | 2016-03-11 03:17:04.02066+01  | 2016-07-27 10:14:21.386486+02
  2 | 72b87fe8fae7ad0e | 1000010001 | osad-9e746cbe56 at spacewalk.marin.local/osad | 5fcdfcd1f0c901797180877b45f6277b349f92c4 |        1 |                  | 2016-07-27 09:17:24.666323+02 |                | 2016-03-04 13:36:47.783569+01 | 2016-07-27 09:58:19.347547+02
 20 | 31c27fb9918d3673 | 1000010004 | osad-3b3864cec6 at spacewalk.marin.local/osad | 9b42135ea5fdeefb0ab8af3ca83807cb58344c2e |        1 |                  | 2016-07-17 23:00:32.381059+02 |                | 2016-03-11 09:47:43.771994+01 | 2016-07-27 09:58:19.366615+02
 71 | 5a2689068c0ba73a | 1000010063 | osad-b0ea4afafe at spacewalk.marin.local/osad | d0f3345a24102b92da898ba46154301e19e70e23 |        1 |                  | 2016-07-18 10:37:21.23437+02  |                | 2016-06-03 11:53:46.255785+02 | 2016-07-27 09:58:19.385679+02
 33 | d48e8605f9eb877f | 1000010041 | osad-0f9e45687f at spacewalk.marin.local/osad | 8f2e771533c621193758989dade9985f3870353f |        1 |                  | 2016-07-18 10:37:20.952852+02 |                | 2016-03-24 13:23:09.4004+01   | 2016-07-27 09:58:19.395361+02
 17 | 63e66b53992f3d40 | 1000010035 | osad-41bec84b7b at spacewalk.marin.local/osad | 582e27425d668c5c93bc6c4e641e8c390e94bd45 |        1 |                  | 2016-07-17 23:00:32.74935+02  |                | 2016-03-11 09:40:14.453959+01 | 2016-07-27 09:58:19.405451+02
 56 | c1579b663363ae66 | 1000010067 | osad-708d031ff0 at spacewalk.marin.local/osad | 12efdaa06293b47bc9a2fa6517e55cdca7bf8f7f |        1 |                  | 2016-07-18 10:37:21.187701+02 |                | 2016-06-01 09:13:08.404041+02 | 2016-07-27 09:58:19.415118+02
 16 | 6809839a4135a83a | 1000010003 | osad-3f4bae5c6f at spacewalk.marin.local/osad | 48170f7543cf40b2a2230048220aa4adbcbc5580 |        1 |                  | 2016-07-18 10:37:20.812941+02 |                | 2016-03-11 09:39:59.755307+01 | 2016-07-27 09:58:19.424911+02
 32 | 4723dc4c59c5bc21 | 1000010040 | osad-49b52ed24f at spacewalk.marin.local/osad | a6e805c32077c97701acf1a7d7e8a6fb8df8a8cb |        1 |                  | 2016-07-18 10:37:20.999886+02 |                | 2016-03-23 18:44:38.054874+01 | 2016-07-27 09:58:19.43441+02
(71 rows)

Can anybody point me in the right direction?
Regards,
--
Jan-Albert van Ree



Jan-Albert van Ree  | Linux System Administrator | MARIN Support Group
MARIN | T +31 317 49 35 48 | mailto:J.A.v.Ree at marin.nl | http://www.marin.nl

MARIN news: http://www.marin.nl/web/News/News-items/Joint-Industry-Project-LifeLine-kicks-off.htm





More information about the Spacewalk-list mailing list