Aug 31 08:59:21 corosync [MAIN ] Corosync Cluster Engine ('trunk'): started and ready to provide service. Aug 31 08:59:21 corosync [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'. Aug 31 08:59:21 corosync [corosy] Warning: the to_file config paramater has been obsoleted. See corosync.conf man page to_logfile directive. Aug 31 08:59:21 corosync [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0). Aug 31 08:59:21 corosync [TOTEM ] The network interface [198.38.17.40] is now up. Aug 31 08:59:21 corosync [pcmk ] info: process_ais_conf: Reading configure Aug 31 08:59:21 corosync [pcmk ] info: config_find_init: Local handle: 2013064636357672961 for logging Aug 31 08:59:21 corosync [pcmk ] info: config_find_next: Processing additional logging options... Aug 31 08:59:21 corosync [pcmk ] info: get_config_opt: Found 'off' for option: debug Aug 31 08:59:21 corosync [pcmk ] info: get_config_opt: Found 'yes' for option: to_file Aug 31 08:59:21 corosync [pcmk ] info: get_config_opt: Found 'yes' for option: to_syslog Aug 31 08:59:21 corosync [pcmk ] info: get_config_opt: Found '/var/log/corosync.log' for option: logfile Aug 31 08:59:21 corosync [pcmk ] info: get_config_opt: Defaulting to 'daemon' for option: syslog_facility Aug 31 08:59:21 corosync [pcmk ] info: config_find_init: Local handle: 4730966301143465986 for service Aug 31 08:59:21 corosync [pcmk ] info: config_find_next: Processing additional service options... Aug 31 08:59:21 corosync [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_logd Aug 31 08:59:21 corosync [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_mgmtd Aug 31 08:59:21 corosync [pcmk ] info: pcmk_plugin_init: CRM: Initialized Aug 31 08:59:21 corosync [pcmk ] Logging: Initialized pcmk_plugin_init Aug 31 08:59:21 corosync [pcmk ] info: pcmk_plugin_init: Service: 9 Aug 31 08:59:21 corosync [pcmk ] info: pcmk_plugin_init: Local node id: 672212678 Aug 31 08:59:21 corosync [pcmk ] info: pcmk_plugin_init: Local hostname: royal Aug 31 08:59:21 corosync [pcmk ] info: update_member: Creating entry for node 672212678 born on 0 Aug 31 08:59:21 corosync [pcmk ] info: update_member: 0xb6a720 Node 672212678 now known as royal (was: (null)) Aug 31 08:59:21 corosync [pcmk ] info: update_member: Node royal now has 1 quorum votes (was 0) Aug 31 08:59:21 corosync [pcmk ] info: update_member: Node 672212678/royal is now: member Aug 31 08:59:21 corosync [pcmk ] info: spawn_child: Forked child 24772 for process stonithd Aug 31 08:59:21 royal stonithd: [24772]: info: G_main_add_SignalHandler: Added signal handler for signal 10 Aug 31 08:59:21 royal stonithd: [24772]: info: G_main_add_SignalHandler: Added signal handler for signal 12 Aug 31 08:59:21 royal stonithd: [24772]: info: Stack hogger failed 0xffffffff Aug 31 08:59:21 royal cib: [24773]: info: G_main_add_TriggerHandler: Added signal manual handler Aug 31 08:59:21 royal cib: [24773]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 08:59:21 royal lrmd: [24774]: info: G_main_add_SignalHandler: Added signal handler for signal 15 Aug 31 08:59:21 royal cib: [24773]: info: retrieveCib: Reading cluster configuration from: /var/lib/lib/heartbeat/crm/cib.xml (digest: /var/lib/lib/heartbeat/crm/cib.xml.sig) Aug 31 08:59:21 royal lrmd: [24774]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 08:59:21 royal lrmd: [24774]: info: G_main_add_SignalHandler: Added signal handler for signal 10 Aug 31 08:59:21 royal lrmd: [24774]: info: G_main_add_SignalHandler: Added signal handler for signal 12 Aug 31 08:59:21 royal lrmd: [24774]: info: Started. Aug 31 08:59:21 corosync [pcmk ] info: spawn_child: Forked child 24773 for process cib Aug 31 08:59:21 corosync [pcmk ] info: spawn_child: Forked child 24774 for process lrmd Aug 31 08:59:21 corosync [pcmk ] info: spawn_child: Forked child 24775 for process attrd Aug 31 08:59:21 corosync [pcmk ] info: spawn_child: Forked child 24776 for process pengine Aug 31 08:59:21 corosync [pcmk ] info: spawn_child: Forked child 24777 for process crmd Aug 31 08:59:21 corosync [pcmk ] info: pcmk_startup: CRM: Initialized Aug 31 08:59:21 corosync [SERV ] Service initialized 'Pacemaker Cluster Manager' Aug 31 08:59:21 corosync [SERV ] Service initialized 'corosync extended virtual synchrony service' Aug 31 08:59:21 royal pengine: [24776]: info: main: Starting pengine Aug 31 08:59:21 royal attrd: [24775]: info: main: Starting up Aug 31 08:59:21 royal attrd: [24775]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 08:59:21 royal attrd: [24775]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 08:59:21 royal attrd: [24775]: info: init_ais_connection: Connection to our AIS plugin (9) failed: Try again (6) Aug 31 08:59:21 corosync [SERV ] Service initialized 'corosync configuration service' Aug 31 08:59:21 corosync [SERV ] Service initialized 'corosync cluster closed process group service v1.01' Aug 31 08:59:21 corosync [SERV ] Service initialized 'corosync cluster config database access v1.01' Aug 31 08:59:21 corosync [SERV ] Service initialized 'corosync profile loading service' Aug 31 08:59:21 corosync [MAIN ] Compatibility mode set to whitetank. Using V1 and V2 of the synchronization engine. Aug 31 08:59:21 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 688: memb=0, new=0, lost=0 Aug 31 08:59:21 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 688: memb=1, new=1, lost=0 Aug 31 08:59:21 corosync [pcmk ] info: pcmk_peer_update: NEW: royal 672212678 Aug 31 08:59:21 corosync [pcmk ] info: pcmk_peer_update: MEMB: royal 672212678 Aug 31 08:59:21 corosync [pcmk ] info: update_member: Node royal now has process list: 00000000000000000000000000013312 (78610) Aug 31 08:59:21 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed. Aug 31 08:59:21 corosync [MAIN ] Completed service synchronization, ready to provide service. Aug 31 08:59:21 royal crmd: [24777]: info: main: CRM Hg Version: 462f1569a43740667daf7b0f6b521742e9eb8fa7 Aug 31 08:59:21 royal cib: [24773]: info: startCib: CIB Initialization completed successfully Aug 31 08:59:21 royal crmd: [24777]: info: crmd_init: Starting crmd Aug 31 08:59:21 royal cib: [24773]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 08:59:21 royal cib: [24773]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 08:59:21 royal crmd: [24777]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 08:59:21 royal cib: [24773]: info: init_ais_connection: AIS connection established Aug 31 08:59:21 royal stonithd: [24772]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 08:59:21 royal stonithd: [24772]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 08:59:21 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0xb75350 for cib/24773 Aug 31 08:59:21 corosync [pcmk ] info: pcmk_ipc: Sending membership update 688 to cib Aug 31 08:59:21 royal cib: [24773]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 08:59:21 royal cib: [24773]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 08:59:21 royal cib: [24773]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 08:59:21 royal cib: [24773]: info: cib_init: Starting cib mainloop Aug 31 08:59:21 royal cib: [24773]: info: ais_dispatch: Membership 688: quorum still lost Aug 31 08:59:21 royal cib: [24773]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=0 seen=688 proc=00000000000000000000000000013312 (new) Aug 31 08:59:21 royal stonithd: [24772]: info: init_ais_connection: AIS connection established Aug 31 08:59:21 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0xb757a0 for stonithd/24772 Aug 31 08:59:21 royal stonithd: [24772]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 08:59:21 royal stonithd: [24772]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 08:59:21 royal stonithd: [24772]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 08:59:21 royal stonithd: [24772]: notice: /usr/lib64/heartbeat/stonithd start up successfully. Aug 31 08:59:21 royal stonithd: [24772]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 08:59:21 royal cib: [24779]: info: write_cib_contents: Archived previous version as /var/lib/lib/heartbeat/crm/cib-15.raw Aug 31 08:59:22 royal cib: [24779]: info: write_cib_contents: Wrote version 0.2.0 of the CIB to disk (digest: abe41542d5d8a1123f527edecca7fbe1) Aug 31 08:59:22 royal cib: [24779]: info: retrieveCib: Reading cluster configuration from: /var/lib/lib/heartbeat/crm/cib.8Y3xSn (digest: /var/lib/lib/heartbeat/crm/cib.riHhoC) Aug 31 08:59:22 royal attrd: [24775]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 08:59:22 royal attrd: [24775]: info: init_ais_connection: AIS connection established Aug 31 08:59:22 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0xb76c10 for attrd/24775 Aug 31 08:59:22 royal attrd: [24775]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 08:59:22 royal attrd: [24775]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 08:59:22 royal attrd: [24775]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 08:59:22 royal attrd: [24775]: info: main: Cluster connection active Aug 31 08:59:22 royal attrd: [24775]: info: main: Accepting attribute updates Aug 31 08:59:22 royal attrd: [24775]: info: main: Starting mainloop... Aug 31 08:59:22 royal crmd: [24777]: info: do_cib_control: CIB connection established Aug 31 08:59:22 royal crmd: [24777]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 08:59:22 royal crmd: [24777]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 08:59:22 royal crmd: [24777]: info: init_ais_connection: AIS connection established Aug 31 08:59:22 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0xb77060 for crmd/24777 Aug 31 08:59:22 corosync [pcmk ] info: pcmk_ipc: Sending membership update 688 to crmd Aug 31 08:59:22 royal crmd: [24777]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 08:59:22 royal crmd: [24777]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 08:59:22 royal crmd: [24777]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 08:59:22 royal crmd: [24777]: info: do_ha_control: Connected to the cluster Aug 31 08:59:22 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:22 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 1 (30 max) times Aug 31 08:59:22 royal crmd: [24777]: info: crmd_init: Starting crmd's mainloop Aug 31 08:59:22 royal crmd: [24777]: info: config_query_callback: Checking for expired actions every 900000ms Aug 31 08:59:22 corosync [pcmk ] info: update_expected_votes: Expected quorum votes 1024 -> 2 Aug 31 08:59:22 royal crmd: [24777]: info: ais_dispatch: Membership 688: quorum still lost Aug 31 08:59:22 royal crmd: [24777]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=0 seen=688 proc=00000000000000000000000000013312 (new) Aug 31 08:59:22 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:22 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 2 (30 max) times Aug 31 08:59:22 royal crmd: [24777]: info: ais_dispatch: Membership 688: quorum still lost Aug 31 08:59:22 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:22 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 3 (30 max) times Aug 31 08:59:23 royal attrd: [24775]: info: cib_connect: Connected to the CIB after 1 signon attempts Aug 31 08:59:23 royal attrd: [24775]: info: cib_connect: Sending full refresh Aug 31 08:59:24 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:24 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:24 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 4 (30 max) times Aug 31 08:59:26 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:26 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:26 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 5 (30 max) times Aug 31 08:59:28 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:28 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:28 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 6 (30 max) times Aug 31 08:59:30 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:30 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:30 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 7 (30 max) times Aug 31 08:59:32 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:32 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:32 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 8 (30 max) times Aug 31 08:59:34 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:34 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:34 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 9 (30 max) times Aug 31 08:59:36 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:36 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:36 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 10 (30 max) times Aug 31 08:59:38 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:38 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:38 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 11 (30 max) times Aug 31 08:59:40 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:40 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:40 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 12 (30 max) times Aug 31 08:59:42 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:42 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:42 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 13 (30 max) times Aug 31 08:59:44 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:44 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:44 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 14 (30 max) times Aug 31 08:59:46 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:46 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:46 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 15 (30 max) times Aug 31 08:59:48 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:48 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:48 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 16 (30 max) times Aug 31 08:59:50 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:50 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:50 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 17 (30 max) times Aug 31 08:59:52 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:52 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:52 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 18 (30 max) times Aug 31 08:59:54 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:54 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:54 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 19 (30 max) times Aug 31 08:59:56 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:56 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:56 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 20 (30 max) times Aug 31 08:59:58 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 08:59:58 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 08:59:58 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 21 (30 max) times Aug 31 09:00:00 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:00 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:00 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 22 (30 max) times Aug 31 09:00:02 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:02 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:02 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 23 (30 max) times Aug 31 09:00:04 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:04 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:05 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 24 (30 max) times Aug 31 09:00:07 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:07 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:07 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 25 (30 max) times Aug 31 09:00:09 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:09 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:09 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 26 (30 max) times Aug 31 09:00:11 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:11 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:11 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 27 (30 max) times Aug 31 09:00:13 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:13 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:13 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 28 (30 max) times Aug 31 09:00:15 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:15 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:15 royal crmd: [24777]: WARN: do_lrm_control: Failed to sign on to the LRM 29 (30 max) times Aug 31 09:00:17 royal crmd: [24777]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:17 royal crmd: [24777]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:17 royal crmd: [24777]: ERROR: do_lrm_control: Failed to sign on to the LRM 30 (max) times Aug 31 09:00:17 royal crmd: [24777]: ERROR: do_log: FSA: Input I_ERROR from do_lrm_control() received in state S_STARTING Aug 31 09:00:17 royal crmd: [24777]: info: do_state_transition: State transition S_STARTING -> S_RECOVERY [ input=I_ERROR cause=C_FSA_INTERNAL origin=do_lrm_control ] Aug 31 09:00:17 royal crmd: [24777]: ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported Aug 31 09:00:17 royal crmd: [24777]: ERROR: do_started: Start cancelled... S_RECOVERY Aug 31 09:00:17 royal crmd: [24777]: ERROR: do_log: FSA: Input I_TERMINATE from do_recover() received in state S_RECOVERY Aug 31 09:00:17 royal crmd: [24777]: info: do_state_transition: State transition S_RECOVERY -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_recover ] Aug 31 09:00:17 royal crmd: [24777]: info: do_ha_control: Disconnected from OpenAIS Aug 31 09:00:17 royal crmd: [24777]: info: do_cib_control: Disconnecting CIB Aug 31 09:00:17 royal crmd: [24777]: info: crmd_cib_connection_destroy: Connection to the CIB terminated... Aug 31 09:00:17 royal crmd: [24777]: info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd Aug 31 09:00:17 royal crmd: [24777]: ERROR: do_exit: Could not recover from internal error Aug 31 09:00:17 royal cib: [24773]: WARN: send_ipc_message: IPC Channel to 24777 is not connected Aug 31 09:00:17 royal crmd: [24777]: info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=do_stop ] Aug 31 09:00:17 royal cib: [24773]: WARN: send_via_callback_channel: Delivery of reply to client 24777/cfa16481-d1da-4792-b7fc-fb7f0c87a590 failed Aug 31 09:00:17 royal crmd: [24777]: info: do_exit: [crmd] stopped (2) Aug 31 09:00:17 royal cib: [24773]: WARN: do_local_notify: A-Sync reply to crmd failed: reply failed Aug 31 09:00:17 corosync [pcmk ] ERROR: pcmk_wait_dispatch: Child process crmd exited (pid=24777, rc=2) Aug 31 09:00:17 corosync [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: crmd Aug 31 09:00:17 corosync [pcmk ] info: spawn_child: Forked child 24817 for process crmd Aug 31 09:00:17 royal crmd: [24817]: info: main: CRM Hg Version: 462f1569a43740667daf7b0f6b521742e9eb8fa7 Aug 31 09:00:17 royal crmd: [24817]: info: crmd_init: Starting crmd Aug 31 09:00:17 royal crmd: [24817]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 09:00:17 royal crmd: [24817]: info: do_cib_control: CIB connection established Aug 31 09:00:17 royal crmd: [24817]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 09:00:17 royal crmd: [24817]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 09:00:17 royal crmd: [24817]: info: init_ais_connection: AIS connection established Aug 31 09:00:17 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0xb77060 for crmd/24817 Aug 31 09:00:17 royal crmd: [24817]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 09:00:17 corosync [pcmk ] info: pcmk_ipc: Sending membership update 688 to crmd Aug 31 09:00:17 royal crmd: [24817]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 09:00:17 royal crmd: [24817]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 09:00:17 royal crmd: [24817]: info: do_ha_control: Connected to the cluster Aug 31 09:00:17 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:17 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 1 (30 max) times Aug 31 09:00:17 royal crmd: [24817]: info: crmd_init: Starting crmd's mainloop Aug 31 09:00:17 royal crmd: [24817]: info: config_query_callback: Checking for expired actions every 900000ms Aug 31 09:00:17 royal crmd: [24817]: info: ais_dispatch: Membership 688: quorum still lost Aug 31 09:00:17 royal crmd: [24817]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=0 seen=688 proc=00000000000000000000000000013312 (new) Aug 31 09:00:17 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:17 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 2 (30 max) times Aug 31 09:00:17 royal crmd: [24817]: info: ais_dispatch: Membership 688: quorum still lost Aug 31 09:00:17 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:17 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 3 (30 max) times Aug 31 09:00:19 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:19 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:19 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 4 (30 max) times Aug 31 09:00:21 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:21 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:21 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 5 (30 max) times Aug 31 09:00:23 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:23 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:23 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 6 (30 max) times Aug 31 09:00:25 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:25 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:25 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 7 (30 max) times Aug 31 09:00:27 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:27 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:27 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 8 (30 max) times Aug 31 09:00:29 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:29 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:29 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 9 (30 max) times Aug 31 09:00:31 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:31 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:31 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 10 (30 max) times Aug 31 09:00:33 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:33 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:33 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 11 (30 max) times Aug 31 09:00:35 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:35 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:35 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 12 (30 max) times Aug 31 09:00:37 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:37 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:37 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 13 (30 max) times Aug 31 09:00:39 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:39 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:39 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 14 (30 max) times Aug 31 09:00:41 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:41 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:41 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 15 (30 max) times Aug 31 09:00:43 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:43 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:43 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 16 (30 max) times Aug 31 09:00:45 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:45 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:45 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 17 (30 max) times Aug 31 09:00:47 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:47 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:47 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 18 (30 max) times Aug 31 09:00:49 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:49 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:49 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 19 (30 max) times Aug 31 09:00:51 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:51 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:51 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 20 (30 max) times Aug 31 09:00:53 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:53 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:53 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 21 (30 max) times Aug 31 09:00:55 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:55 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:55 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 22 (30 max) times Aug 31 09:00:57 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:57 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:57 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 23 (30 max) times Aug 31 09:00:59 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:00:59 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:00:59 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 24 (30 max) times Aug 31 09:01:01 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:01 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:01 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 25 (30 max) times Aug 31 09:01:03 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:03 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:03 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 26 (30 max) times Aug 31 09:01:05 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:05 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:05 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 27 (30 max) times Aug 31 09:01:07 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:07 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:07 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 28 (30 max) times Aug 31 09:01:09 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:09 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:09 royal crmd: [24817]: WARN: do_lrm_control: Failed to sign on to the LRM 29 (30 max) times Aug 31 09:01:11 royal crmd: [24817]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:11 royal crmd: [24817]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:11 royal crmd: [24817]: ERROR: do_lrm_control: Failed to sign on to the LRM 30 (max) times Aug 31 09:01:11 royal crmd: [24817]: ERROR: do_log: FSA: Input I_ERROR from do_lrm_control() received in state S_STARTING Aug 31 09:01:11 royal crmd: [24817]: info: do_state_transition: State transition S_STARTING -> S_RECOVERY [ input=I_ERROR cause=C_FSA_INTERNAL origin=do_lrm_control ] Aug 31 09:01:11 royal crmd: [24817]: ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported Aug 31 09:01:11 royal crmd: [24817]: ERROR: do_started: Start cancelled... S_RECOVERY Aug 31 09:01:11 royal crmd: [24817]: ERROR: do_log: FSA: Input I_TERMINATE from do_recover() received in state S_RECOVERY Aug 31 09:01:11 royal crmd: [24817]: info: do_state_transition: State transition S_RECOVERY -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_recover ] Aug 31 09:01:11 royal crmd: [24817]: info: do_ha_control: Disconnected from OpenAIS Aug 31 09:01:11 royal crmd: [24817]: info: do_cib_control: Disconnecting CIB Aug 31 09:01:11 royal crmd: [24817]: info: crmd_cib_connection_destroy: Connection to the CIB terminated... Aug 31 09:01:11 royal crmd: [24817]: info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd Aug 31 09:01:11 royal crmd: [24817]: ERROR: do_exit: Could not recover from internal error Aug 31 09:01:11 royal crmd: [24817]: info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=do_stop ] Aug 31 09:01:11 royal crmd: [24817]: info: do_exit: [crmd] stopped (2) Aug 31 09:01:11 corosync [pcmk ] info: pcmk_ipc_exit: Client crmd (conn=0xb77060, async-conn=0xb77060) left Aug 31 09:01:11 corosync [pcmk ] ERROR: pcmk_wait_dispatch: Child process crmd exited (pid=24817, rc=2) Aug 31 09:01:11 corosync [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: crmd Aug 31 09:01:11 corosync [pcmk ] info: spawn_child: Forked child 24824 for process crmd Aug 31 09:01:11 royal crmd: [24824]: info: main: CRM Hg Version: 462f1569a43740667daf7b0f6b521742e9eb8fa7 Aug 31 09:01:11 royal crmd: [24824]: info: crmd_init: Starting crmd Aug 31 09:01:11 royal crmd: [24824]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 09:01:11 royal crmd: [24824]: info: do_cib_control: CIB connection established Aug 31 09:01:11 royal crmd: [24824]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 09:01:11 royal crmd: [24824]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 09:01:11 royal crmd: [24824]: info: init_ais_connection: AIS connection established Aug 31 09:01:11 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0xb77060 for crmd/24824 Aug 31 09:01:11 corosync [pcmk ] info: pcmk_ipc: Sending membership update 688 to crmd Aug 31 09:01:11 royal crmd: [24824]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 09:01:11 royal crmd: [24824]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 09:01:11 royal crmd: [24824]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 09:01:11 royal crmd: [24824]: info: do_ha_control: Connected to the cluster Aug 31 09:01:11 royal crmd: [24824]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:11 royal crmd: [24824]: WARN: do_lrm_control: Failed to sign on to the LRM 1 (30 max) times Aug 31 09:01:11 royal crmd: [24824]: info: crmd_init: Starting crmd's mainloop Aug 31 09:01:11 royal crmd: [24824]: info: config_query_callback: Checking for expired actions every 900000ms Aug 31 09:01:11 royal crmd: [24824]: info: ais_dispatch: Membership 688: quorum still lost Aug 31 09:01:11 royal crmd: [24824]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=0 seen=688 proc=00000000000000000000000000013312 (new) Aug 31 09:01:11 royal crmd: [24824]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:11 royal crmd: [24824]: WARN: do_lrm_control: Failed to sign on to the LRM 2 (30 max) times Aug 31 09:01:11 royal crmd: [24824]: info: ais_dispatch: Membership 688: quorum still lost Aug 31 09:01:11 royal crmd: [24824]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:11 royal crmd: [24824]: WARN: do_lrm_control: Failed to sign on to the LRM 3 (30 max) times Aug 31 09:01:13 royal crmd: [24824]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:13 royal crmd: [24824]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:13 royal crmd: [24824]: WARN: do_lrm_control: Failed to sign on to the LRM 4 (30 max) times Aug 31 09:01:15 royal crmd: [24824]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:15 royal crmd: [24824]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:15 royal crmd: [24824]: WARN: do_lrm_control: Failed to sign on to the LRM 5 (30 max) times Aug 31 09:01:17 royal crmd: [24824]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:17 royal crmd: [24824]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:17 royal crmd: [24824]: WARN: do_lrm_control: Failed to sign on to the LRM 6 (30 max) times Aug 31 09:01:19 royal crmd: [24824]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:01:19 royal crmd: [24824]: WARN: lrm_signon: can not initiate connection Aug 31 09:01:19 royal crmd: [24824]: WARN: do_lrm_control: Failed to sign on to the LRM 7 (30 max) times Aug 31 09:01:20 corosync [SERV ] Unloading all corosync components Aug 31 09:01:20 royal lrmd: [24774]: info: lrmd is shutting down Aug 31 09:01:20 corosync [SERV ] Unloading corosync component: corosync_evs v0 Aug 31 09:01:20 corosync [SERV ] Unloading corosync component: corosync_cfg v0 Aug 31 09:01:20 corosync [pcmk ] ERROR: pcmk_wait_dispatch: Child process attrd terminated with signal 2 (pid=24775, core=false) Aug 31 09:01:20 corosync [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: attrd Aug 31 09:01:20 corosync [SERV ] Unloading corosync component: corosync_cpg v0 Aug 31 09:01:20 corosync [SERV ] Unloading corosync component: corosync_confdb v0 Aug 31 09:01:20 corosync [SERV ] Unloading corosync component: corosync_pload v0 Aug 31 09:01:20 corosync [SERV ] Unloading corosync component: pacemaker v0 Aug 31 09:01:20 corosync [pcmk ] notice: pcmk_shutdown: Begining shutdown Aug 31 09:01:20 corosync [pcmk ] notice: stop_child: Sent -15 to crmd: [24824] Aug 31 09:01:20 corosync [pcmk ] notice: pcmk_shutdown: crmd (pid=24824) confirmed dead Aug 31 09:01:20 corosync [pcmk ] notice: stop_child: Sent -15 to pengine: [24776] Aug 31 09:01:20 corosync [pcmk ] notice: pcmk_shutdown: pengine (pid=24776) confirmed dead Aug 31 09:01:20 corosync [pcmk ] notice: pcmk_shutdown: attrd (pid=0) confirmed dead Aug 31 09:01:20 corosync [pcmk ] notice: stop_child: Sent -15 to lrmd: [24774] Aug 31 09:01:20 corosync [pcmk ] info: spawn_child: Forked child 24827 for process attrd Aug 31 09:01:20 royal attrd: [24827]: info: main: Starting up Aug 31 09:01:20 royal attrd: [24827]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 09:01:20 royal attrd: [24827]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 09:01:21 corosync [pcmk ] notice: pcmk_shutdown: lrmd (pid=24774) confirmed dead Aug 31 09:01:21 corosync [pcmk ] notice: stop_child: Sent -15 to cib: [24773] Aug 31 09:01:21 corosync [pcmk ] notice: pcmk_shutdown: cib (pid=24773) confirmed dead Aug 31 09:01:21 corosync [pcmk ] notice: stop_child: Sent -15 to stonithd: [24772] Aug 31 09:01:21 royal stonithd: [24772]: notice: /usr/lib64/heartbeat/stonithd normally quit. Aug 31 09:01:22 corosync [pcmk ] notice: pcmk_shutdown: stonithd (pid=24772) confirmed dead Aug 31 09:01:22 corosync [pcmk ] info: update_member: Node royal now has process list: 00000000000000000000000000001002 (4098) Aug 31 09:01:22 corosync [pcmk ] notice: pcmk_shutdown: Shutdown complete Aug 31 09:01:22 corosync [MAIN ] Corosync Cluster Engine exiting with status -1 at main.c:171. Aug 31 09:01:22 royal attrd: [24827]: info: init_ais_connection: Connection to our AIS plugin (9) failed: Library error (2) Aug 31 09:01:22 royal attrd: [24827]: ERROR: main: HA Signon failed Aug 31 09:01:22 royal attrd: [24827]: info: main: Cluster connection active Aug 31 09:01:22 royal attrd: [24827]: info: main: Accepting attribute updates Aug 31 09:01:22 royal attrd: [24827]: ERROR: main: Aborting startup Aug 31 09:10:05 corosync [MAIN ] Corosync Cluster Engine ('trunk'): started and ready to provide service. Aug 31 09:10:05 corosync [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'. Aug 31 09:10:05 corosync [corosy] Warning: the to_file config paramater has been obsoleted. See corosync.conf man page to_logfile directive. Aug 31 09:10:05 corosync [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0). Aug 31 09:10:05 corosync [TOTEM ] The network interface [198.38.17.40] is now up. Aug 31 09:10:05 corosync [pcmk ] info: process_ais_conf: Reading configure Aug 31 09:10:05 corosync [pcmk ] info: config_find_init: Local handle: 2013064636357672961 for logging Aug 31 09:10:05 corosync [pcmk ] info: config_find_next: Processing additional logging options... Aug 31 09:10:05 corosync [pcmk ] info: get_config_opt: Found 'off' for option: debug Aug 31 09:10:05 corosync [pcmk ] info: get_config_opt: Found 'yes' for option: to_file Aug 31 09:10:05 corosync [pcmk ] info: get_config_opt: Found 'yes' for option: to_syslog Aug 31 09:10:05 corosync [pcmk ] info: get_config_opt: Found '/var/log/corosync.log' for option: logfile Aug 31 09:10:05 corosync [pcmk ] info: get_config_opt: Defaulting to 'daemon' for option: syslog_facility Aug 31 09:10:05 corosync [pcmk ] info: config_find_init: Local handle: 4730966301143465986 for service Aug 31 09:10:05 corosync [pcmk ] info: config_find_next: Processing additional service options... Aug 31 09:10:05 corosync [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_logd Aug 31 09:10:05 corosync [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_mgmtd Aug 31 09:10:05 corosync [pcmk ] info: pcmk_plugin_init: CRM: Initialized Aug 31 09:10:05 corosync [pcmk ] Logging: Initialized pcmk_plugin_init Aug 31 09:10:05 corosync [pcmk ] info: pcmk_plugin_init: Service: 9 Aug 31 09:10:05 corosync [pcmk ] info: pcmk_plugin_init: Local node id: 672212678 Aug 31 09:10:05 corosync [pcmk ] info: pcmk_plugin_init: Local hostname: royal Aug 31 09:10:05 corosync [pcmk ] info: update_member: Creating entry for node 672212678 born on 0 Aug 31 09:10:05 corosync [pcmk ] info: update_member: 0x25c76b0 Node 672212678 now known as royal (was: (null)) Aug 31 09:10:05 corosync [pcmk ] info: update_member: Node royal now has 1 quorum votes (was 0) Aug 31 09:10:05 corosync [pcmk ] info: update_member: Node 672212678/royal is now: member Aug 31 09:10:05 royal stonithd: [24883]: info: G_main_add_SignalHandler: Added signal handler for signal 10 Aug 31 09:10:05 royal stonithd: [24883]: info: G_main_add_SignalHandler: Added signal handler for signal 12 Aug 31 09:10:05 royal stonithd: [24883]: info: Stack hogger failed 0xffffffff Aug 31 09:10:05 royal lrmd: [24885]: info: G_main_add_SignalHandler: Added signal handler for signal 15 Aug 31 09:10:05 royal cib: [24884]: info: G_main_add_TriggerHandler: Added signal manual handler Aug 31 09:10:06 royal cib: [24884]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 09:10:06 royal cib: [24884]: info: retrieveCib: Reading cluster configuration from: /var/lib/lib/heartbeat/crm/cib.xml (digest: /var/lib/lib/heartbeat/crm/cib.xml.sig) Aug 31 09:10:06 royal lrmd: [24885]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 09:10:06 royal lrmd: [24885]: info: G_main_add_SignalHandler: Added signal handler for signal 10 Aug 31 09:10:06 royal lrmd: [24885]: info: G_main_add_SignalHandler: Added signal handler for signal 12 Aug 31 09:10:06 royal lrmd: [24885]: info: Started. Aug 31 09:10:06 royal attrd: [24886]: info: main: Starting up Aug 31 09:10:06 royal attrd: [24886]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 09:10:06 royal attrd: [24886]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 09:10:06 royal attrd: [24886]: info: init_ais_connection: Connection to our AIS plugin (9) failed: Try again (6) Aug 31 09:10:06 royal pengine: [24887]: info: main: Starting pengine Aug 31 09:10:05 corosync [pcmk ] info: spawn_child: Forked child 24883 for process stonithd Aug 31 09:10:06 corosync [pcmk ] info: spawn_child: Forked child 24884 for process cib Aug 31 09:10:06 corosync [pcmk ] info: spawn_child: Forked child 24885 for process lrmd Aug 31 09:10:06 corosync [pcmk ] info: spawn_child: Forked child 24886 for process attrd Aug 31 09:10:06 corosync [pcmk ] info: spawn_child: Forked child 24887 for process pengine Aug 31 09:10:06 corosync [pcmk ] info: spawn_child: Forked child 24888 for process crmd Aug 31 09:10:06 corosync [pcmk ] info: pcmk_startup: CRM: Initialized Aug 31 09:10:06 corosync [SERV ] Service initialized 'Pacemaker Cluster Manager' Aug 31 09:10:06 corosync [SERV ] Service initialized 'corosync extended virtual synchrony service' Aug 31 09:10:06 corosync [SERV ] Service initialized 'corosync configuration service' Aug 31 09:10:06 corosync [SERV ] Service initialized 'corosync cluster closed process group service v1.01' Aug 31 09:10:06 corosync [SERV ] Service initialized 'corosync cluster config database access v1.01' Aug 31 09:10:06 corosync [SERV ] Service initialized 'corosync profile loading service' Aug 31 09:10:06 corosync [MAIN ] Compatibility mode set to whitetank. Using V1 and V2 of the synchronization engine. Aug 31 09:10:06 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 692: memb=0, new=0, lost=0 Aug 31 09:10:06 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 692: memb=1, new=1, lost=0 Aug 31 09:10:06 corosync [pcmk ] info: pcmk_peer_update: NEW: royal 672212678 Aug 31 09:10:06 corosync [pcmk ] info: pcmk_peer_update: MEMB: royal 672212678 Aug 31 09:10:06 corosync [pcmk ] info: update_member: Node royal now has process list: 00000000000000000000000000013312 (78610) Aug 31 09:10:06 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed. Aug 31 09:10:06 corosync [MAIN ] Completed service synchronization, ready to provide service. Aug 31 09:10:06 royal crmd: [24888]: info: main: CRM Hg Version: 462f1569a43740667daf7b0f6b521742e9eb8fa7 Aug 31 09:10:06 royal crmd: [24888]: info: crmd_init: Starting crmd Aug 31 09:10:06 royal crmd: [24888]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 09:10:06 royal cib: [24884]: info: startCib: CIB Initialization completed successfully Aug 31 09:10:06 royal cib: [24884]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 09:10:06 royal cib: [24884]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 09:10:06 royal cib: [24884]: info: init_ais_connection: AIS connection established Aug 31 09:10:06 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x7f97b80020c0 for cib/24884 Aug 31 09:10:06 corosync [pcmk ] info: pcmk_ipc: Sending membership update 692 to cib Aug 31 09:10:06 royal cib: [24884]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 09:10:06 royal cib: [24884]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 09:10:06 royal cib: [24884]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 09:10:06 royal cib: [24884]: info: cib_init: Starting cib mainloop Aug 31 09:10:06 royal cib: [24884]: info: ais_dispatch: Membership 692: quorum still lost Aug 31 09:10:06 royal cib: [24884]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=0 seen=692 proc=00000000000000000000000000013312 (new) Aug 31 09:10:06 royal stonithd: [24883]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 09:10:06 royal stonithd: [24883]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 09:10:06 royal stonithd: [24883]: info: init_ais_connection: AIS connection established Aug 31 09:10:06 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x25d1d90 for stonithd/24883 Aug 31 09:10:06 royal stonithd: [24883]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 09:10:06 royal cib: [24890]: info: write_cib_contents: Archived previous version as /var/lib/lib/heartbeat/crm/cib-16.raw Aug 31 09:10:06 royal stonithd: [24883]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 09:10:06 royal stonithd: [24883]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 09:10:06 royal stonithd: [24883]: notice: /usr/lib64/heartbeat/stonithd start up successfully. Aug 31 09:10:06 royal stonithd: [24883]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Aug 31 09:10:06 royal cib: [24890]: info: write_cib_contents: Wrote version 0.2.0 of the CIB to disk (digest: 3a43ad543ed0b25207bca2c9ce26f1f4) Aug 31 09:10:06 royal cib: [24890]: info: retrieveCib: Reading cluster configuration from: /var/lib/lib/heartbeat/crm/cib.rU7Z9q (digest: /var/lib/lib/heartbeat/crm/cib.xTIyHu) Aug 31 09:10:07 royal attrd: [24886]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 09:10:07 royal attrd: [24886]: info: init_ais_connection: AIS connection established Aug 31 09:10:07 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x25d21e0 for attrd/24886 Aug 31 09:10:07 royal attrd: [24886]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 09:10:07 royal attrd: [24886]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 09:10:07 royal attrd: [24886]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 09:10:07 royal attrd: [24886]: info: main: Cluster connection active Aug 31 09:10:07 royal attrd: [24886]: info: main: Accepting attribute updates Aug 31 09:10:07 royal attrd: [24886]: info: main: Starting mainloop... Aug 31 09:10:07 royal crmd: [24888]: info: do_cib_control: CIB connection established Aug 31 09:10:07 royal crmd: [24888]: info: crm_cluster_connect: Connecting to OpenAIS Aug 31 09:10:07 royal crmd: [24888]: info: init_ais_connection: Creating connection to our AIS plugin Aug 31 09:10:07 royal crmd: [24888]: info: init_ais_connection: AIS connection established Aug 31 09:10:07 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x25d2630 for crmd/24888 Aug 31 09:10:07 corosync [pcmk ] info: pcmk_ipc: Sending membership update 692 to crmd Aug 31 09:10:07 royal crmd: [24888]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Aug 31 09:10:07 royal crmd: [24888]: info: crm_new_peer: Node royal now has id: 672212678 Aug 31 09:10:07 royal crmd: [24888]: info: crm_new_peer: Node 672212678 is now known as royal Aug 31 09:10:07 royal crmd: [24888]: info: do_ha_control: Connected to the cluster Aug 31 09:10:07 royal crmd: [24888]: WARN: lrm_signon: can not initiate connection Aug 31 09:10:07 royal crmd: [24888]: WARN: do_lrm_control: Failed to sign on to the LRM 1 (30 max) times Aug 31 09:10:07 royal crmd: [24888]: info: crmd_init: Starting crmd's mainloop Aug 31 09:10:07 royal crmd: [24888]: info: config_query_callback: Checking for expired actions every 900000ms Aug 31 09:10:07 corosync [pcmk ] info: update_expected_votes: Expected quorum votes 1024 -> 2 Aug 31 09:10:07 royal crmd: [24888]: info: ais_dispatch: Membership 692: quorum still lost Aug 31 09:10:07 royal crmd: [24888]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=0 seen=692 proc=00000000000000000000000000013312 (new) Aug 31 09:10:07 royal crmd: [24888]: WARN: lrm_signon: can not initiate connection Aug 31 09:10:07 royal crmd: [24888]: WARN: do_lrm_control: Failed to sign on to the LRM 2 (30 max) times Aug 31 09:10:07 royal crmd: [24888]: info: ais_dispatch: Membership 692: quorum still lost Aug 31 09:10:07 royal crmd: [24888]: WARN: lrm_signon: can not initiate connection Aug 31 09:10:07 royal crmd: [24888]: WARN: do_lrm_control: Failed to sign on to the LRM 3 (30 max) times Aug 31 09:10:08 royal attrd: [24886]: info: cib_connect: Connected to the CIB after 1 signon attempts Aug 31 09:10:08 royal attrd: [24886]: info: cib_connect: Sending full refresh Aug 31 09:10:09 royal crmd: [24888]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:10:09 royal crmd: [24888]: WARN: lrm_signon: can not initiate connection Aug 31 09:10:09 royal crmd: [24888]: WARN: do_lrm_control: Failed to sign on to the LRM 4 (30 max) times Aug 31 09:10:11 royal crmd: [24888]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:10:11 royal crmd: [24888]: WARN: lrm_signon: can not initiate connection Aug 31 09:10:11 royal crmd: [24888]: WARN: do_lrm_control: Failed to sign on to the LRM 5 (30 max) times Aug 31 09:10:13 royal crmd: [24888]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:10:13 royal crmd: [24888]: WARN: lrm_signon: can not initiate connection Aug 31 09:10:13 royal crmd: [24888]: WARN: do_lrm_control: Failed to sign on to the LRM 6 (30 max) times Aug 31 09:10:15 royal crmd: [24888]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Aug 31 09:10:15 royal crmd: [24888]: WARN: lrm_signon: can not initiate connection Aug 31 09:10:15 royal crmd: [24888]: WARN: do_lrm_control: Failed to sign on to the LRM 7 (30 max) times Aug 31 09:10:16 corosync [SERV ] Unloading all corosync components Aug 31 09:10:16 corosync [SERV ] Unloading corosync component: corosync_evs v0 Aug 31 09:10:16 corosync [SERV ] Unloading corosync component: corosync_cfg v0 Aug 31 09:10:16 corosync [SERV ] Unloading corosync component: corosync_cpg v0 Aug 31 09:10:16 corosync [SERV ] Unloading corosync component: corosync_confdb v0 Aug 31 09:10:16 corosync [SERV ] Unloading corosync component: corosync_pload v0 Aug 31 09:10:16 corosync [SERV ] Unloading corosync component: pacemaker v0 Aug 31 09:10:16 corosync [pcmk ] notice: pcmk_shutdown: Begining shutdown Aug 31 09:10:16 corosync [pcmk ] notice: stop_child: Sent -15 to crmd: [24888] Aug 31 09:10:16 corosync [SERV ] Unloading all corosync components Aug 31 09:10:16 corosync [SERV ] Unloading corosync component: pacemaker v0 Aug 31 09:10:16 corosync [pcmk ] notice: pcmk_shutdown: Begining shutdown Aug 31 09:10:16 corosync [pcmk ] notice: stop_child: Sent -15 to crmd: [24888] Aug 31 09:10:16 royal lrmd: [24885]: info: lrmd is shutting down Aug 31 09:10:16 corosync [pcmk ] notice: pcmk_shutdown: crmd (pid=24888) confirmed dead Aug 31 09:10:16 corosync [pcmk ] notice: stop_child: Sent -15 to pengine: [24887] Aug 31 09:10:16 corosync [pcmk ] notice: pcmk_shutdown: pengine (pid=24887) confirmed dead Aug 31 09:10:16 corosync [pcmk ] notice: stop_child: Sent -15 to attrd: [24886] Aug 31 09:10:16 corosync [pcmk ] notice: pcmk_shutdown: attrd (pid=24886) confirmed dead Aug 31 09:10:16 corosync [pcmk ] notice: stop_child: Sent -15 to lrmd: [24885] Aug 31 09:10:16 royal stonithd: [24883]: notice: /usr/lib64/heartbeat/stonithd normally quit.